My usual approach on this blog is to write about a strategy once I’ve already got it working. This time, I thought it would be interesting to instead focus on a current learning challenge I have, and my thinking process about resolving it.
One of the big learning challenges I’m working on right now is to learn cognitive science [1]. Here’s a quick summary:
- Cognitive science is a multidisciplinary field crossing psychology, neuroscience, computer science, linguistics and philosophy, all using different tools to answer the question of how the mind works.
- My current benchmark for the curriculum is UC San Diego’s reading list [2] for their incoming doctoral students with backgrounds in other fields. This consists of about 40 textbooks.
- My first goal is to read these textbooks, but I’ve also studied from outside this list when appropriate. For instance, when struggling with a Neurobiology textbook, I did Duke’s Medical Neuroscience [3] class via Coursera first.
- So far I’ve completed about eight of the textbooks, with another few partially completed.
The challenge is still early on, and since I’ve opted to not make this one heavily time-constrained, I’m still figuring out what’s the best way to learn as I go.
How Do You Practice a Theoretical Subject?
One of the key ingredients of all of my other ultralearning projects was practice. The MIT Challenge [4] had tough final exams. The Year Without English [5] had immersive conversation practice. My Portrait Drawing Challenge [6] was almost entirely practicing drawing.
Part of the reason for practice is simply as a way to test yourself. If I hadn’t done the final exams for MIT, my confidence as to how well I had learned the material would be pretty low. After all, it’s certainly possible to watch a lot of lectures or read a book and not be able to use the knowledge.
However, verifying your ability is only a small part of the benefit of practice. Doing practice is actually a much better way to learn the material. Exams didn’t just confirm I knew the MIT material, it was how I actually learned it.
Practice, therefore, is a crucial ingredient to learning well. But how do I practice cognitive science?
This has been a tricky problem because my curriculum is fundamentally a reading list, not classes. So there are no exams, assignments or projects. The nature of the material also makes practice difficult. While reading a programming textbook might not require practice, it will suggest some possible projects after. But what practice does a neuroscience textbook suggest?
I’d like to share some of what I’ve been trying to cope with this problem, discuss the strengths and weaknesses, and share some of my future attempts to resolve this problem going forward.
#1. Writing Book Summaries
My first attempt was an effort of least resistance—writing book summaries. After I finished a book, I would write a 1000-2000 word article, summarizing the contents of the book. I’ve done this for most of the books I’ve completed so far. I usually go chapter-by-chapter to prevent skipping.
The advantage of this approach is that it is quite easy to do, maybe an hour of work for a book that took 10+ hours to read. It also provides notes for the book, so you can later review a condensed version. Finally, summarizing forces me to think about what the big ideas were and organize my thinking.
Despite this, there’s some clear disadvantages to this approach. Importantly, a lot of depth is sacrificed in a review. Taking 600+ pages of tersely written description into 2-3 pages of summary means I’m simply dumping 99% of the information provided.
Because there’s no exact criteria of what I need to include, this compression also allows me to be selective in what I write, meaning I can write about the things I understood well and avoid those I didn’t.
The book summary approach also doesn’t practice any technical skill. So if I’m reading a book on natural language processing, I have zero experience working with any of those systems. If I’m reading a book about Boltzmann machines, I’ve never used any of the equations. I know from doing the MIT Challenge, that this kind of practice was more than half of the actual learning experience, and it’s being entirely omitted by just summarizing.
#2. Taking Question & Answer Notes While Reading
Something I attempted for one book was to take notes which were in question-form, with a note to the page number in the book. My idea was that this would mean reading created its own practice questions later.
The advantage of this approach, versus just taking notes, was that when reviewing them, I could do active recall instead of passive review.
The problem, which I hadn’t anticipated using this technique, was that I tended to write very difficult questions that referenced an obscure detail of the chapter. Rather than focus on what were the big ideas, I got caught up quizzing myself on some obscure facts or opinions of the authors.
This led to the questions being almost entirely unanswerable, and reviewing them again, I felt they didn’t capture the spirit of what I was trying to learn from the book.
#3. Teaching Selected Lessons and Recording Them
Later, I tried flipping the problem around. Maybe, if my main goal was to understand cognitive science well enough to write about it intelligently, then I shouldn’t be focused on practice questions but on teaching. I could teach selected lessons from each book and that would ensure I understood it.
The advantage of this approach is it does foster a deep understanding of what you’ve covered. The downside is that it is incredibly time consuming and covers far, far less than the looser book summary approach.
I still think this method could work well if the book were about arguing a single thesis. However, most of the books I’m reading are surveying large literatures, so teaching specific lessons is going to omit almost everything else.
For my first attempt with this method, I took the book Human Memory [7] by Alan Baddeley, and figured I would do a 5-minute lesson on some of the chapters (there were over a dozen). By the end, my recorded lesson was 20+ minutes and covered only briefly the first part of just one chapter.
What Should I Do Instead?
As I mentioned in the beginning, I still haven’t resolved this challenge. But here are some further experiments I’ve been thinking about to get at solving this issue of practice:
#1. Post-reading Question Book
I’m beginning to suspect my failure with writing my notes as questions came because it’s difficult to think of intelligent questions while also managing the cognitive demands of reading a book. Given more time and space, I might be able to create a list of questions after reading that capture what stood out to me as the important points.
The idea here would be that, after reading, I would create 25-50 questions for each book, as well as my own answer at the time. I could then keep two electronic files (one with just the questions, one with questions and answers) and randomly quiz myself on these later.
#2. Supplementary Classes
It may just be that books aren’t going to cut it for some topics. So I may need to actually find classes (either MOOCs, OCW, or just begged/borrowed real class materials) that will have included practice components.
I’ve already done this with Neurobiology, taking Medical Neuroscience and passing the exams, made a huge difference in how much I was able to understand and retain from that class. Perhaps I’ll just do this for all of the topics I want to explore more deeply.
Although this is a completely valid solution, it also strikes me as a bit of a cop-out. Why read the books at all if you’re just going to take classes on them later?
#3. Personal Project
Another alternative might be to read the materials and accept, at least for the moment, the insufficiency of my understanding. But, once the reading is done (or nearing completion) switch to working on an implementation project. The project would force me to go back and assemble knowledge I’d previously learned in a richer way.
Examples could include: attempting to write/publish a journal article on the topic, designing some kind of computer model to simulate some of the work or recording a set of lectures around key themes of cognitive science.
This approach appeals to me as well, but I don’t like the idea of delaying practice so far into the project.
What Would You Do?
I didn’t bring this up simply to show that I, too, suffer from learning challenges. Instead, I wanted to showcase my thinking about these difficulties. Having done big, mostly successful self-education projects, I’m acutely aware of what needs to be done to make them work.
I suspect that many people would look at my reading list and not see a problem at all. Heck, just reading all those books is going to be challenging enough, why worry about additional practice on top of it?
But I suppose that’s also what motivates me to improve my understanding of how learning works. I’m always eager to try exploring what might be the deficits of my current approach and see if there are ways they can be overcome.