{"id":7288,"date":"2017-12-28T15:31:47","date_gmt":"2017-12-28T22:31:47","guid":{"rendered":"https:\/\/www.scotthyoung.com\/blog\/?page_id=7288"},"modified":"2017-12-28T15:41:39","modified_gmt":"2017-12-28T22:41:39","slug":"2017-12-book-club-transcript","status":"publish","type":"page","link":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/","title":{"rendered":"2017-12 Book Club Transcript"},"content":{"rendered":"<p class=\"p1\"><span class=\"s1\">Hello and welcome to my book club, this month we read <a href=\"https:\/\/www.amazon.com\/G%C3%B6del-Escher-Bach-Eternal-Golden\/dp\/0465026567\/ref=pd_lpo_sbs_14_img_0?_encoding=UTF8&amp;psc=1&amp;refRID=5YH0ZV5GY48EG3NQTZ0X\"><span class=\"s2\">Godel, Escher, Bach<\/span><\/a> by Douglas Hofstadter. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now this book is not the easiest book to read, it\u2019s over 750 pages, when you include the notes and annotations and it\u2019s about a difficult topic. It\u2019s something that even me, having learned about a lot of these ideas in other classes and other places before, there were some sections that I had to stop and pause and re-read it to make sure I understood and it\u2019s not because Douglas Hofstadter is bad at explaining things, it\u2019s not because he\u2019s not a sophisticated and eloquent writer, the difficulty is the ideas themselves.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">However, I think the these ideas are very important and some of the most interesting ideas that I\u2019ve ever read about. Now, what is the idea of the book? Well the core of the book is the idea of a strange loop. So what is a strange loop? Well I think it\u2019s easiest to visualize what a strange loop is if we look at the second person in the Godel, Escher, Bach trilogy here of names: M.C. Escher. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">M.C. Escher was an artist who was famous for doing mind-bending, paradoxical kinds of images where one setting which appears to be the foreground becomes the background or the subject becomes the object. So some of the classic ones you\u2019ve probably seen before include the staircase that continually goes upwards. It\u2019s a two-dimensional picture that shows a paradox that couldn\u2019t exist in the physical world. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Another example is the drawing hands where he has drawn two pictures of hands which are holding pencils and drawing themselves. Other ones he has includes birds which turn into other animals and shift between the foreground and background. He even has one where there is a person looking at a picture in a museum and the scene is warping so that he is part of the museum itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So, this is something that I think is easy to see to visually, this kind of paradox, and it\u2019s easy to dismiss it as well as being a bit of trickery. You might not even be a fan of M.C. Escher\u2019s art, you might consider it too obvious. Perhaps you see it and you think, <i>oh yeah, he\u2019s trying to do a visual illusion, tricking us because it\u2019s really a two dimensional picture and we\u2019re operating with our three-dimensional brains.<\/i><\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">However, I think it\u2019s a really good entry point to grasping this idea of a strange loop. Now what I think Douglas Hofstadter calls a strange loop or this tangled hierarchy is where you have layers of something where something is built on top of something else.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">We can think about this in the physical world: we know that the world is made out of atoms and quarks and basic elementary particles but then on top of that level we have chemistry and chemistry is a a greater abstraction (something built on top of physics) and on top of chemistry we have, let\u2019s say, biology, and on top of that psychology and sociology, etc., etc., etc. So that\u2019s a hierarchy.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">And what a strange loop is, is where this hierarchy flips back in on itself. It\u2019s where the top layer somehow also becomes the bottom layer. This is where the M.C. Escher idea comes in where the staircases just go up and up and up but they somehow end at the same starting point. Now, I have to admit, Johan Sebastian Bach was not someone that I knew a lot about prior to this book. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I am much less well versed than Douglas Hofstadter was so I\u2019m going to take his word for it that a lot of the music conventions that Bach used had this similar quality of ideas that are repeating and turning on each other and having the same kind of self-referential paradoxical quality but in a musical domain as opposed to M.C. Escher who is in an artistic domain.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">But what about the first name in this book? Godel. Now really it\u2019s called Godel, Escher, Bach but those names don\u2019t have equal weight. This book is mostly about the mathematician Kurt Godel or the logistician Kurt Godel. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now, he has one of the most amazing discoveries in math, in logic, in just, the ability to reason, I think I\u2019ve ever heard. I think it\u2019s worth studying; it\u2019s worth studying in and of itself because the ideas he presents are so mind boggling and it\u2019s difficult to really fathom the implications of but also because the way he did it is a perfect example of this strange loop. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">It\u2019s a perfect example of this M.C. Escher idea of one idea being built on top of each other, now, the difference between M.C. Escher and Kurt Godel is kind of doing a bit of a trick. He\u2019s drawing a situation which can\u2019t possibly exist but we\u2019re easy to dismiss it because we know, that, well, it\u2019s really just a two-dimensional picture it doesn\u2019t have to represent something that is physically realizable.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Whereas Kurt Godel I think his trick is much more impressive because he\u2019s doing it within the field of math and logic itself. So he\u2019s doing this bending, twisting, this hierarchy of one lower level being built on top and top and top of each other until it comes down and reaches the bottom again. Within the realm of logic, something you\u2019d think would escape the ideas of paradox, would escape the ideas of self-referentiality, which is the work that we can find in Escher and Bach. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now why is this important? So before I go into Godel\u2019s actual proof and explaining why it\u2019s so mind-bending and why honestly it\u2019s one of the most interesting things I\u2019ve ever learned, before that, I want to talk about the implications because at the end of the day, this might be interesting but maybe not enough for you to wade through 750 pages of a book to talk about some esoteric idea of strange loops. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Well the basic idea of where this is going is that Douglas Hofstadter believes that this very potent tool, a very potent idea that we can apply to human consciousness itself. So what are we actually? Is in Hofstadter\u2019s mind a strange loop? Is it a situation where the hierarchies that were built upon flip back down onto themselves. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now that may sound confusing and I hope as I explain the nature it will show how it was done and later draw links to human consciousness and it will make more sense. It is a bit of an abstract idea and it\u2019s hard to wrap your mind around, not only is it a 750 page book and I read all of it, but I had to go back and re-read some parts especially when he\u2019s talking about Godel\u2019s proof and how it was executed technically because it\u2019s very difficult to wrap your head around. So if you\u2019re listening to this podcast and you think, <i>I didn\u2019t get any of that at all<\/i>, that\u2019s okay!<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">But keep in mind, I want you to just keep a kernel, even if what I\u2019m saying sounds a little weird or you don\u2019t get it, keep it in mind because you might want to couple back a few years later, a few months later, read this book again, maybe you will watch a documentary about Kurt Godel (there\u2019s a really good one) you can read books about it, essentially I think that if you spend a little bit of time with this idea maybe over a couple years, it will really strike you as profound, it will strike you as something I think upheaves a lot of our ideas about how the world works, about who we are, about how we can be related to something that seems alien to us. In the sense that when we imagine the world our sense of consciousness seems so divorced, so alien from the quantum mechanical rules that physicists discover or the mechanical ideas of chemistry and molecular biology, how can we be related to that? <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I think there\u2019s a real profundity to this. In addition, I think this is an idea that is one of those analogies that if you really get it, it applies to many, many places. It certainly applies to human minds. It also applies to DNA \u2014 as we\u2019re talking about in the book \u2014 the very machinery that makes us alive, this is an idea that underpins it. Computers, is a huge idea, I know that many people after reading this book decided to study computer science because they thought it was so fascinating this idea of a tangled hierarchy or a strange loop. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So, I\u2019m going to start explaining the idea but I want you to keep this in mind because it may sound a little over your head or too esoteric or <i>who cares about mathematical logic <\/i>but if you invest in it and you put in the effort to get to the other end of the idea, you\u2019ll see it has pretty broad implications. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Let\u2019s get started: Kurt Godel\u2019s mathematical idea comes together in what is known as his incompleteness proof. To understand this you have to understand the setting of the time. So it\u2019s jus the beginning of the 20th century and there are a number of unsolved, outstanding problems in mathematics. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The mathematician David Hilbert even formulated a lot of these problems as a \u201cTo Do List\u201d for mathematicians to solve and one of them was to prove consistency and completeness of axiomatized mathematics. So what does that mean? What on Earth does that mean?<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Let\u2019s think about it this way: in mathematical reasoning we all have some informal idea of what it means to prove something. Maybe in a math class we\u2019ve all seen a proof of Pythagoras\u2019 Theorem where a squared plus B squared equals C squared for the lengths of sides of a right angle triangle. Even if you\u2019ve gone through a math calculation of that or maybe you\u2019ve seen a visual representation where the put the grids on the sides of the triangles and they just happen to add up. Now we can understand this intuitive level of a proof but there was always a worry that perhaps we\u2019ve making a mistake. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">How do you know you\u2019ve proved something? Maybe you\u2019ve convinced yourself but there\u2019s a secret glitch that undermines a lot of your reasoning. So one of the efforts to really make this more rigorous was to axiomatize mathematics which was to basically turn this process of coming up with elegant and intuitive proofs into something that was completely mechanical \u2014 something that a computer could do and assuming you didn\u2019t write any bugs into the program, it would return a correct response. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So the basic idea is that you have a formal system where you have some axioms. These are things you take for granted as being true. It may seem problematic (how do you know where the axioms are) but think of them as things that characterize what you want to discuss. So if you want to discuss geometry you\u2019d come up with different axioms then if you want to discuss number theory or something else. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Basically the axioms are going to tell you what areas of mathematics broadly conceived, you can explore. Alright so you come up with some list of axioms, hopefully it\u2019s a small list or if there are a large number of axioms they can be represented by a rule for creating those axioms. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Next you want to come up with some rules for manipulating these symbols. So you write out the axioms with a list of symbols, just like you would in a computer program, and then you come up with straightforward rules that if you apply it to an axiom, you get something that\u2019s true at the end. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Again, this may sound a little complicated but really we do this all the time. If you\u2019ve ever studied algebra you know about, well, if you have multiply by 2 on one side you can divide both sides by 2 eliminated on one side and then have divided by 2 or multiply by one half on the other. This is pretty basic, this is something that we learn in grade seven or eight. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now, this algebraic manipulation is very similar to what\u2019s happening with axioms and theorems. Basically, what we\u2019re doing is we\u2019re starting with the axioms (our 1 + 1 = 2) or similar types of propositions. Then we\u2019re manipulating them in a way where we can get other true statements in arithmetic. Basically if we\u2019re following these rules eventually perhaps we can reach 2 + 2 = 4, for example. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now, this is a purely mechanical process\u2014I can\u2019t stress this enough. This isn\u2019t the case, well, what was happening here is we\u2019re discovering the truth of math. What\u2019s happening is we\u2019re taking these axioms, we\u2019re taking these basic rules and we\u2019re just following very mechanical procedures and turning them into other statements which we hope, if the system is designed properly, will give us true statements.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So what was Hilbert\u2019s problem? Well, Hilbert\u2019s problem was that at the time there were no different axiomatic systems for mathematics. In particular a later one that was developed (for Godel\u2019s proof) was <i>principia mathematica<\/i> which was a really exhaustive attempt to underpin all the foundations of mathematics. To codify, as it were, what it was. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">This is essential idea is that you\u2019re going to take these these axioms and you\u2019re going to manipulate them with mechanical rules. What we would like to know are two things about this system: <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So first off, is it consistent? What I mean by that is does it ever derive a contradiction. Now because we\u2019re not talking about \u201creal math\u201d we\u2019re talking about a mechanical system that\u2019s taking about mechanical rules, there\u2019s always the chance that you could have written a rule incorrectly and that could lead to a situation where you get 2 + 2 = 4 or if you follow a certain set of combinations you could get 2 + 2 = 5 or it gets, 2 + 2 doesn\u2019t equal 4. So this is a situation that we want to avoid obviously because if we want our system to represent truth in mathematics (to find the answers of what are actual, real formulas) this is something we want to avoid. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now, there\u2019s another thing we\u2019d like to do with this system. It\u2019s possible to make a consistent system that nonetheless doesn\u2019t follow certain rules. It doesn\u2019t allow things that we consider to be important in order to get true statements. So if it\u2019s too underpowered\u2014let\u2019s say it lacks the ability to represent multiplication\u2014then there\u2019s going to be a whole set of numbers that we agree are true that are going to be outside the realm of this system to solve them. We are going to have a huge set of numbers that we accept as true but are unprovable within this formal system. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So Hilbert\u2019s idea was that if someone could come up with a proof that shows these axioms exists, was consistent and also complete, that would be a major triumph. We could feel very secure resting in our knowledge that this mechanical would work all the time. And what Godel did in the 1930\u2019s, was that he showed that this was actually impossible. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Godel showed that any system that you have, any set of rules that you have, is powerful enough to represent the basics of natural numbers (the basics of arithmetic) will ultimately undermine itself by creating situations that we know are true but cannot be represented. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So this is a real fascinating result. What does this mean? So I think we can go through the proof now, and understand a bit about how it works. Now I\u2019m going to be glossing over a lot of details. Douglas Hofstadter goes through these details in painstaking efforts so you can see from start to finish the entirety of the proof and I think there\u2019s merit in that. I know this book is quite long but I think there\u2019s merit in understand the proof because whenever someone presents you with a mind bending idea, it\u2019s easy to dismiss it if you don\u2019t fully understand. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I think that is the case here that in my cursory overview you might think, oh well what about this or what about that, I just want to caution you even if I\u2019m not the best at explaining this idea, even if I skip a lot of parts, the what about\u2019ism, is not going to work here. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">There\u2019s not going to be a situation where you say what about this and it\u2019s going to undermine the idea of the proof. It really is <em>that<\/em> ironclad. However you have to go through all the pages to see how it works. It\u2019s a summary but I am going to ask you be careful with your objections if you see a problem with the idea. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So here\u2019s the idea of the proof and here is really the trick to understanding Godel\u2019s strange loop: this is where Douglas Hofstadter decided to pin his book on this profound idea. Here is the idea: we take the formulas in this system so we take the formulas that say, you know, all the little symbols that make these things, and we represent them in a code just the way we would in a computer program, we make them into a code in actual numbers, now these numbers the rules of operating on these axioms to get new, true statements, to get new theorems of this arithmetic system the way of operation on this can get us a mirror version of this system in mathematics itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So you can imagine, like I was saying with algebra, this divide on one hand, and divide on the other hand, let\u2019s say a rule of algebra, that if you have something that is multiplied by everything you divide on one side, you divide on the other, the equality still holds. Well what you could imagine doing is taking that rule of having that sort of progression of multiplying this and representing it as an actual statement about number. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So you have actual numbers representing the dividing sign and then these relationships between these things, the relationship between the statement after you divided by two, isn\u2019t just a progression in the numbers in the actual symbols of math, it is an actual transformation of one number into another number. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">This means that we can within the system itself ask questions about these numbers the same way we can ask questions about prime numbers or we can ask questions lets say which numbers are powers of two or is this number to this number a valid transformation within the existing system. Now the <em>exact way<\/em> of coding that up is complicated but I want you to leave with the essential insight here which is that the actual system we\u2019re dealing with here is a bunch of systems that use numbers and what he is doing is turning those systems into numbers. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So you can think about how 2 + 2 = 4 so you have a two, you have a plus sign, you have a two, you have an equal sign, and you have a four. What Godel is doing is saying, let\u2019s take that 2 and put it in a number, let\u2019s take that plus sign, let\u2019s take that 2 and put it in a number, let\u2019s take that equal sign and put it into a number and let\u2019s take that 4 and put it into a number. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So now you have one super long number that represents 2 + 2 = 4 as a just a number not as something that involves plus signs and equals signs and has separate numbers but as just one big number.\u00c2\u00a0<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Okay so what can you do with this? Well if you go through a little bit of work what you can end up doing with this process is you can make a statement that is the mathematical equivalent of saying \u201cthis statement is false\u201d or more specifically what it is saying is \u201cthis statement has no proof.\u201d <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Because you\u2019re representing within themselves you can have a statement that refers to its own number so you can make a proof that says there is no proof for this particular statement. Now what does that mean? Well it\u2019s interesting: it\u2019s not saying that the statement is false. Let\u2019s be clear about that. It\u2019s saying that it can\u2019t be proven. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">And what that means is that a statement that says essentially this statement has no proof, well, if the statement is saying it has no proof then that means that if its true then it doesn\u2019t have a proof or if it\u2019s false then it means that there is a contradiction here. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So you can see if you go back to Hilbert\u2019s problem of consistency and completeness that this is now impossible because you have a statement that gives you a forking path. On the one hand you choose inconsistency: a statement that is false and we know it to be true. Okay, how do we deal with that?<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The other statement is that, let\u2019s say we take it to be true, let\u2019s say we say this is a true statement well now we know that it doesn\u2019t have a proof so we know there are results in mathematics that are going to be forever outside the realm of our logic and our understanding. Now, there\u2019s a lot of profound ideas in logic and mathematics and because of this there\u2019s also a lot of related proof for instance, I think a little bit less elegant, but Touring\u2019s (Alan Touring) <i>halting problem<\/i> from computer science. Basically it says it\u2019s impossible to create a computer program that can analyze another computer program and say for sure whether they stop. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">It\u2019s also related to Canter\u2019s diagonal argument which is the idea that if you make a list of all the real list (meaning numbers that have decimal and whatever numbers after that) that it\u2019s impossible to list them out because it\u2019s always possible to create a new number that\u2019s not on your list. So all these cases, I think, hint at some limits of the ability to reason within these systems they show that it\u2019s impossible paradox, it\u2019s impossible to make a situation where you have complete rational control over the universe. That\u2019s one of the really profound ideas. But if we follow Godel, Escher, Bach, that isn\u2019t the crux of what the author is trying to argue that isn\u2019t why he brought up this proof. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Instead what he wanted to talk about were two things: first the idea of formal systems. The idea of a system that just mechanically following rules and then building something more complicated out of that. This is the basis behind computers, yes, but also the basis behind the physical world. The idea behind objects that interact based on physical laws, the basis behind how DNA combines and replicates, all the machinery in our cells, so there\u2019s something worth studying in the idea of formal system itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">The second idea is that of the strange loop \u2014 the insight that Godel had which was to represent the rules of the system within the system itself. This kind of inception-like idea of taking a system and mirroring it within the system itself. And that might sound impossible but Godel was able to do this and you follow the proof to its end you can see it logically follows. It doesn\u2019t involve magic it\u2019s just a simple fact that when a system becomes sufficiently powerful it can eventually represent itself or a version of itself within it.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So what does that mean? Well what I think that means here is first of all understanding things in terms of formal systems is a potent idea and being able to think about things in terms of following ironclad rules is very powerful but the second idea is that once a system can reach a level of sophistication it\u2019ll have this ability to loop back on itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">What\u2019s the extension here? One of them is the idea of human consciousness. He\u2019s saying that what perhaps the self is, what we are, as not bodies but sort of abstract quality, what makes us different from rocks or computer programs that we have today is that our machinery for representing things is sufficiently complex and we can represent ourselves in that machinery and we can represent ourselves representing ourselves. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">We can have thoughts about our own thoughts and about the person thinking the thoughts and about their relation to the world at large. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">This kind of, turning back on itself, of the thought machinery that this can happen within a system which nonetheless is just obeying mindless rules and mechanical properties. Another idea that comes up here and this is a philosophical concept but it\u2019s the idea between syntax and semantics. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">What is syntax? It is the rules and mechanical structures of language and sentences and semantics and what those words mean. What Godel showed is that this boundary between syntax and semantics is not cleanly dividing, it\u2019s not the case that there\u2019s just syntax on one end of mechanical rules and the meaning is cut off from that. The reason that we know this is because Godel\u2019s own proof was done within a system that was entirely syntactical. It\u2019s not necessary for you\u2014any interpretation that you have\u2014on these rules saying that they correspond to real statements in math or real statements in number theory; that\u2019s just your interpretation. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">What you say they mean is what you\u2019re applying on top of it. And yet what is happening here is that this system itself is creating its own substructures so that it can refer to itself even though it\u2019s only a syntactic system.<\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">By setting up the formula just right, you can get a system that talks about itself, the rules of itself and makes those inferences. You could argue that perhaps this doesn\u2019t represent genuine meaning or genuine semantics in the sense that we can write out this proof but someone still has to know what it means. I think it provides an important bootstrapping; it shows how a system compose of meaningless symbols can acquire meaning and it can do it within itself. It can bootstrap itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I think this has really profound consequences for many areas. Now what\u2019s the implication here for artificial intelligence and those kinds of things? Well, this book was written quite a while ago and because it\u2019s been written quite a long time ago it was written prior to the recent developments in AI certainly deep learning and machine learning (the things that everyone is talking about these days) so in some sense this book is dated. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">When we get to the end and the author is talking about AI he\u2019s very much stuck in the old paradigm where humans thought well, if we\u2019re going to make a computer that thinks it\u2019s going to think the way that we do but in terms of here are some symbols and I\u2019m going to manipulate them in a procedural way and get some answer. This was the dominant paradigm at the time and it was shown through a lot of starts and failures that this wasn\u2019t a workable solution for artificial intelligence. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now since then we\u2019ve developed much more powerful computers. We\u2019ve developed processors that can go far beyond what was there when Hofstadter was writing his book. And because of this certain algorithms that were prohibitive that we were not quite sure how to execute, we can now execute. So we have situations like Alpha Zero, the new deep mind program for playing chess, that can just operate with five thousand specially designed hardware units to test against itself many, many times so that it can learn the rules of chess incredibly well. Now this is just something that is not really programed into the computer but it is something that we\u2019re developing with it. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So there\u2019s some anachronisms later on in the book when we talk about AI however, with that in mind, the same fundamental rules apply. AI has grown more sophisticated and some of the tools we\u2019re using are different, but we\u2019re not at a point where we\u2019d consider any of the AI\u2019s we\u2019ve seen to be conscious in the way a human is and not developing the kind of self-awareness where that\u2019s even up for debate. That\u2019s still restricted to TV and movies where we have robots that wax poetically about this own humanity. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">We\u2019re still in an era where AI is a limited tool. But what I think Hofstadter gets right (and what is still correct today) is that the future goal of AI and how it relates to what we are as human beings and what we can possibly achieve, namely, that if this strange loop idea is to be fully realized, is to be fully understood, then it means that creating an AI robot that has consciousness that has that self-awareness that ability to think for itself and decide for itself and is functionally similar to human beings is at least possible in theory. Whether or not we\u2019ll reach it, whether or not we\u2019ll make something that is similar to ourselves or alien to it, whether or not the AI we end up developed is going to be handicapped in some way is yet to be seen. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">But, whether it\u2019s possible in principle is still a debate amongst many philosophers \u2014 many philosophers think that this type of AI therefore resulting in some higher level semantics, higher level intelligence consciousness, is impossible. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">I think if you follow the idea in Godel, Escher, Bach it\u2019s at least suggestive if not iron clad proof that that\u2019s not the case. That we can get systems that have meaning and the meaning is bootstrapped out of something that doesn\u2019t have meaning. That you can have a system in Godel\u2019s case of symbols being manipulated by very straightforward rules that nonetheless if you get complicated enough can reach back and refer to itself. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now one of the things I think is interesting is that Godel\u2019s proof is somewhat pessimistic: it\u2019s proving something about the limits to human reasoning. It\u2019s about our inability to find a complete and consistent set of mathematics. But one of the statements (I\u2019m blanking on the name of the mathematicians named in the book) but one of the statements is the idea of a very different but very slightly different statement which is instead of having a statement that says that this statement cannot be proven you change it to say this statement can be proven. In this case that actually is enough to bootstrap the truth; you can have something that merely states that this statement can be proven. Without actually knowing what the proof is, you can know that that\u2019s the case. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So this is something I think is more analogous to human consciousness. It\u2019s a set of symbol manipulation yet sophisticated enough and robust enough that it can say about itself these qualities that it has they become true sort of as an incantation almost a magical ritual where merely stating that this is the case becomes true\u2014it becomes a self-fulfilling prophecy. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now I\u2019m not saying that if a computer were to merely output the text, \u201cI am conscious\u201d it would become a conscious machine but merely that the mechanism for underpinning our own consciousness is very likely similar to this strange loop idea. I think there\u2019s a lot of very interesting ideas in this book. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">It goes beyond Kurt Godel\u2019s famous proof although a lot of the book is devoted to really understanding it so you can get an intuitive idea of exactly how such a feat was done. But there\u2019s also a lot of interesting ideas of logic itself, about what constitutes knowing something, one of the interesting results discussed in the book is that a corollary to Godel\u2019s incompleteness proof is that it\u2019s actually not possible to say that truth\u2014whether or not something can be true or not\u2014can actually be represented in mathematics for a very similar reason. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">You can get a situation that says \u201cthis statement is false\u201d in mathematics (you can make it say that idea) if you assume the idea that truth and falsity can be directly inferred from these mechanical statements. This also points to the idea that what makes something true or false is quite elusive. It\u2019s something that is maybe not possible for mechanical systems to fully realize truth or falsity. And just before that makes you think of a distinction between humans and machines I think there\u2019s a very important section where he talks about, because of these complications, it\u2019s not the case that human beings have some transcendental power to lift ourselves above the power and see outside of it and say well this system is too weak to prove it but I can see this is true because well, this statement is true, this is false, it actually continues up higher and higher up the levels. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">So as human beings we may be a <i>somewhat<\/i> more sophisticated system for recognizing these intuitive flaws then a computer but because there\u2019s an infinite chain of these types inconsistencies and what you accept as true or false it goes up and up and up\u2014it\u2019s actually impossible for us as human beings to assess the same thing. So the implications of that\u2014the idea that truth and falsity in this very mathematical sense, forget knowing about the world, forget doing scientific experiments and knowing physics, just even in logic, even in mathematics itself\u2014we\u2019re not able to know with certainty or arrive at this certainty of truth and of falsehood is also I think quite profound. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">There\u2019s many ideas of this nature; there\u2019s a huge discussion about genetics and about how molecules again following simple mechanical rules bootstrap themselves into existence. How DNA replicates and then creates its own machinery for replicating itself. It goes on and on and on. I think there\u2019s a lot to discover in this book that I have not talked about but I think if you\u2019re interested in this idea\u2014if the idea of strange loops, of things that loop back on themselves, sort of paradoxical self-references that must be true\u2014I highly recommend reading this book. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now it\u2019s certainly the case that this is not an easy book to read. As I said myself earlier there were some passages I had to re-read to make sure I understood everything but I would\u2019t say it\u2019s not an unenjoyable read. Douglas Hofstadter has this unique way of mixing topic which are about these esoteric ideas and logic and computation with dialogues\u2014with these invented characters who themselves mirror some of the concepts by talking about perhaps more ordinary everyday things. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Additionally because the book is somewhat about how the form or structure or syntax of things eventually the meaning I think it\u2019s quite playful how he\u2019s put the book together in that it involves many acts of self-reference, puns, names for things double standing for something else and so you can see even in the form of the book that it very much exemplifies the philosophy of the strange loop that the form and the substance are not separable that they can link up and mirror each other. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Even for that, this book is really I think a work of art even if you decided after you read it that you fundamentally disagree with you have to admire how the book was composed and indeed in its era it one a Pulitzer for that very reason. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Now I think this is an important book; I certainly would like to discuss more ideas related to cognitive science and philosophy of mind in this review. If you have any suggestions or ideas that you think I should cover or you think I got wrong, I\u2019d be happy to get some emails from you and listen to your own thoughts because this is a subject that fascinates me and I\u2019d be happy to discuss it more. <\/span><\/p>\n<p class=\"p1\"><span class=\"s1\">Next month we\u2019ve going to be doing the book <a href=\"https:\/\/www.amazon.com\/Seeing-like-State-Certain-Condition\/dp\/0300078153\">Seeing Like A Sate by James C. Scott<\/a> and this is a fascinating book about the limits of organization and indeed how many of the evolutions that we\u2019ve gone through as a society and civilization perhaps were not done with the best intentions. So thank you very much for that, this was December\u2019s book, Godel, Escher, Bach. Thank you very much.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hello and welcome to my book club, this month we read Godel, Escher, Bach by Douglas Hofstadter. Now this book is not the easiest book to read, it\u2019s over 750 pages, when you include the notes and annotations and it\u2019s about a difficult topic. It\u2019s something that even me, having learned about a lot of [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":"","_links_to":"","_links_to_target":""},"class_list":{"0":"post-7288","1":"page","2":"type-page","3":"status-publish","5":"entry"},"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.3 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>2017-12 Book Club Transcript - Scott H Young<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"2017-12 Book Club Transcript - Scott H Young\" \/>\n<meta property=\"og:description\" content=\"Hello and welcome to my book club, this month we read Godel, Escher, Bach by Douglas Hofstadter. Now this book is not the easiest book to read, it\u2019s over 750 pages, when you include the notes and annotations and it\u2019s about a difficult topic. It\u2019s something that even me, having learned about a lot of [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/\" \/>\n<meta property=\"og:site_name\" content=\"Scott H Young\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/AuthorScottYoung\/\" \/>\n<meta property=\"article:modified_time\" content=\"2017-12-28T22:41:39+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@scotthyoung\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"32 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/2017-12-book-club-transcript\\\/\",\"url\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/2017-12-book-club-transcript\\\/\",\"name\":\"2017-12 Book Club Transcript - Scott H Young\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/#website\"},\"datePublished\":\"2017-12-28T22:31:47+00:00\",\"dateModified\":\"2017-12-28T22:41:39+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/2017-12-book-club-transcript\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/2017-12-book-club-transcript\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/2017-12-book-club-transcript\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"2017-12 Book Club Transcript\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/\",\"name\":\"Scott H Young\",\"description\":\"Learn faster, achieve more\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.scotthyoung.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"2017-12 Book Club Transcript - Scott H Young","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/","og_locale":"en_US","og_type":"article","og_title":"2017-12 Book Club Transcript - Scott H Young","og_description":"Hello and welcome to my book club, this month we read Godel, Escher, Bach by Douglas Hofstadter. Now this book is not the easiest book to read, it\u2019s over 750 pages, when you include the notes and annotations and it\u2019s about a difficult topic. It\u2019s something that even me, having learned about a lot of [&hellip;]","og_url":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/","og_site_name":"Scott H Young","article_publisher":"https:\/\/www.facebook.com\/AuthorScottYoung\/","article_modified_time":"2017-12-28T22:41:39+00:00","twitter_card":"summary_large_image","twitter_site":"@scotthyoung","twitter_misc":{"Est. reading time":"32 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/","url":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/","name":"2017-12 Book Club Transcript - Scott H Young","isPartOf":{"@id":"https:\/\/www.scotthyoung.com\/blog\/#website"},"datePublished":"2017-12-28T22:31:47+00:00","dateModified":"2017-12-28T22:41:39+00:00","breadcrumb":{"@id":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.scotthyoung.com\/blog\/2017-12-book-club-transcript\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.scotthyoung.com\/blog\/"},{"@type":"ListItem","position":2,"name":"2017-12 Book Club Transcript"}]},{"@type":"WebSite","@id":"https:\/\/www.scotthyoung.com\/blog\/#website","url":"https:\/\/www.scotthyoung.com\/blog\/","name":"Scott H Young","description":"Learn faster, achieve more","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.scotthyoung.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/pages\/7288","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/comments?post=7288"}],"version-history":[{"count":3,"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/pages\/7288\/revisions"}],"predecessor-version":[{"id":7291,"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/pages\/7288\/revisions\/7291"}],"wp:attachment":[{"href":"https:\/\/www.scotthyoung.com\/blog\/wp-json\/wp\/v2\/media?parent=7288"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}