i remember Tom Schofield

2017 is coming to an end. it's been a good year. i've made some great new friends - you know who you are, though many of you 'civilians' probably won't be bothering to read this junk here. it's all good. it's been a productive year too. mostly becoz i work with some seriously amazing people in the lab. i'd like to think i myself have done a fair bit too, but there's one piece of writing i've been putting off till this very last day....

in year 2005, i went to London to do my postdoc. after years of being that awkward, lonely foreigner grad student in Oxford, by then i sort of knew how to socialize. but i was still all kinds of messed up - self-conscious, self-obsessed, competitive, junenvile. a lot of growing up was done in London. for this reason i sometimes call the city my spiritual home. and if a spiritual home came with a spiritual guide, that would be Tom. though he probably never would have approved of that title.

Tom was one of my best of best friends. we hung out all the time. we drank, we fought, we laughed, and had a lot of good times together.

when he left us in 2010, i just clammed up. i couldn't make it to the funeral. the emotions were too raw. they still are. but it's about time i have to write this. coz it's already 7 years overdue.

sorry mate, i would buy you a pint if i saw you in Hell; i’m sure they wouldn’t do half-pints there.

***

months after Tom died, people wrote about what a great budding scientist &  serious researcher he was. to be totally honest i'm not really sure how he would feel about it. he would probably brush it aside and shrug and whatever. i guess secretly he would be flattered too.  but really, the image of a dedicated square of a scholar wasn't quite exactly the Tom i knew. of coz he was intellectually brilliant. but he was more interesting than that. and wiser too.

Tom was the know-it-all about the city, though he really specialized in one kind of most useful knowledge: where to find interesting places to drink. i don't wanna glorify alcoholism, but it was back in England where the standards were a bit... different. pubs closed at 11pm so there's always this sense of urgency there. eating would be wasting precious drinking time, so mostly we drank on empty stomachs, which also has the advantage of maximizing the effective potency of the drinks. official starting time should be 5pm, but now and then we had a little pre-game. once my boss saw us leaving the building early at around 3pm and we causally said we were going to the 'library' (i hope he's not reading this now).

there was one time we wrestled on the streets near Centre Point. i hesistate to tell you all how it started. it has something to do with my making fun of him after he dropped his jacket into a puddle of piss. he was a head taller than me and then some, but somehow i survived. thankfully nobody wins wrestling matches in that kind of state we were in. 

we got ourselves into all kinds of troubles all the times. we got denied entry to clubs, almost getting kicked out from places. let's say, we were downright stupid given we were neurosicentists who should know better what binge drinking could do to our brains. 

but binging wasn't the point. having fun and something outside of work to do was. there was a period of time i wasn't drinking and Tom would ask: "would you like to go to that posh hotel and drink an overpriced pot of tea?" so off we sneaked out from work early in the afternoon again.

another time i did a downright lousy presentation at work. Tom realized something was off and asked if i wanted to go play pool. so off we went. 

soon it became obvious that he was saving me from going mental over work stuff. he was a few years older, and had worked in the 'real world' before he returned to academia. he had a more mature outlook to life. he had his frustration at work too - all the usual about being paid minimum wage as a grad student, etc. but mostly we talked about life, relationships, music (we both loved Suede), interesting places to go to - stuff that are no less important & good for a change.

it was on that one rare occasion that we talked about work stuff at all, that i told him i wanted to write a book. strangely, instead of telling me to have another drink, he was all supportive. it was at that point that i realized he was no less into science than i was. it's just that he saw through the meaninglessness of the cutthroat culture, the rat race of chasing after big journals, accolades, glory and all that stupid stuff. we do science becoz we care. we compete if we have to, but we should aim to do it on our own terms. not taking ourselves too seriously at work doesn't mean we don't take work seriously. 

thank you, older brother. we all miss you.

more on IIT, and ASSC (our annual conference) as Xmas

been meaning to write this note for a while. sorry to my colleague Julia Crone @ UCLA for postponing it for so long. the last few months have really been brutal.

when i posted this piece on IIT, i realize that the first-author of one of the papers i mentioned is a colleague at UCLA, working in my good friend Martin Monti's lab. so i wrote to Julia to ask about her opinion, as to whether she thought her paper really supported IIT, as it may sound like in places.

as i suspected, the answer is no, she doesn't really think so. in her exact words: "I believe that theories of consciousness just as any other cognitive theory should be addressed with a straightforward experimental design that speak for or against the theory of question. In such a scenario, it is indeed possible to ask whether the results are supportive of IIT or not. However, using complex, data-driven approaches in a messy patient population with a whole bunch of primary and secondary processes that affect the BOLD signal does not allow to test a theory of consciousness. Moreover, the results most likely reflect the level of cognition in patients which may or may not lead to a total breakdown of consciousness." (all emphases mine)

obviously i find much to agree with Julia's very sensible reply. but if so, why did i quote her as if her study was intended to be in support of IIT? i didn't actually say so, not exactly. i just took a quote directly from her paper: "disturbances in [connectivity between certain brain regions] have severe impact on information integration and are reflected in deficits in cognitive functioning probably leading to a total breakdown of consciousness” (emphasis mine)

in correspondence Julia clarified that she referred to information integration as a general notion related to complexity of networks, not specifically related to IIT: "Please also keep in mind that graph theoretical metrics such as local efficiency (differentiating patients in this study) are measuring the degree of local information integration of specific central hubs but are not equivalent to the concept of Phi or other complexity measures which may be more suitable to address IIT" (emphasis mine). i think that makes perfect sense. so i feel i owe it to her to clarify that her position here: she isn't one of the 'believers' thinking that her study supported IIT (or falsified it, for that matter).

however, in meetings, i have also seen how this study as well as similar others have been cited as evidence in support of IIT. i guess sometimes that's what matters: how things are interpreted, perceived, discussed over coffee breaks, inspired new studies, impacted young people's career decisions, etc etc. in this case, it sounds like it just wasn't the authors' intention, but it might have been taken as such all the same.

like i said in the original post, how to interpret that individual finding specifically is just a small part of the issue. we have more things to worry about IIT and the status of the field in general. that post is really about the frontline culture, our image in the media, how our colleagues see us, and ultimately how it all matters.

***

since this is end of the year.....looking back, that post on IIT might have been one of the more serious pieces of writing i've done this year. 'serious' may sound funny coz it's not even published officially, in a peer-reviewed journal or something.

but as some of you have guessed, the materials there will become part of Chapter 1 of the book, in which i will justify why we should only focus on a few theories but not an extensive survey of everything that's been said about consciosuness; at the risk of sounding ruder than i intend.. much of it just isn't worth our trouble.

the post was for this reason also 'serious' in another sense. as i mentioned, i owe huge debts to both Christof and Giulio, intellectual and otherwise. many of the other more junior proponents of IIT (e.g. Ryota Kanai, Melanie Boly, Nao Tsuchiya) are also good friends - friends with whom we sort of grew up together, all the way from when we were starry eyed grad students trying to figure out what to do with ourselves.

i have often likened ASSC to xmas, time of the year when you have to see all your cousins, both the beloved and annoying ones alike, catching up on how well we've done lately, repair and renew old bonds as needed, introduce new members of the family to others, etc.

what does it mean to criticize each others' work so harshly when you actually see them as good friends or even families? this is a question i asked myself many many times, and perhaps more frequently this year than in previous years. in the next few post, i'll talk about this more.

new lab webpage

Ned Block told me my lab web really needed updating. so here it is...

https://sites.google.com/view/hakwan-lau-lab

end of the year.... should have done this earlier for the grad admission cycle. but we aren't really in recruitment mode this year. rather nice to be able to take stock right before the holidays.

in the next few posts i'll post more updates and reflections on what we've done this year too.

November & the BioRxiv effect for mentorship / paper submission

just realize this is my first post of the month; November has been insanely hectic. perhaps as usual, this is the season when RAs need to apply to PhD programs, postdocs look for faculty jobs. besides the reference letters writing ***which is only a small part of it***, all of a sudden everyone wants to finish their manuscripts, get them submitted before their applications. as a co-author / senior author, of coz i mustn't be the weakest link holding them back...

i wonder if this means i've been taking on too much, biting off more than i could chew. throughout the year i'd like to think i generally keep myself not counter-productively busy. but maybe November is the best time to take stock. it's not a good estimate of how much one can do annually, if one cannot survive November. ah well, i'm still alive, just barely.

perhaps bioRxiv has changed things too, and i hadn't fully taken that into account. now applicants can get their papers submitted right before the application. and it wouldn't just be an empty claim that a paper is in review. people can actually click on the link to see the paper while it's going through the chimney. perhaps this means more people are rushing to finish manuscripts this time of the year now?

speaking of mentees and students, one of the fun things i've been doing since i've been back in HK is to be involved in the selection for Rhodes Scholars (there's one from the city every year, who get to be funded to study at Oxford). i'm happy to say this year we have a philosophy major winning it. i think it's the first time since 2001 (when i myself won it, with some inexplicable luck)

a truly exhausting month... still one more week to go & one more flight to take (for yet another conference in Japan). it may sound cliche but when i think of how well the young people will do, it makes it all the more bearable and worthwhile. increasingly, i realize they will be the target audience of my book too. the book will be about the future. winning them over is more important than convincing or impressing senior colleagues.

greetings from NYC; my philosophical roots

in the last post i said i would explain why we like arguing so much. in a way, many academics do. for me, it may be in part temperament. in part, it may have something to do with my upbringing at home. it may also have something to do with my graduate training. but New York, New York... is one big reason.

i went to New York city in 2007, a day before i taught my first class as a faculty member at Columbia, with just a suitcase. i remember on the flight from Heathrow to JFK, i kept thinking about a line from a movie i had just watched recently: "... and we all come to New York, to be forgiven." i was 27 years old.

living in Manhattan was fun. Columbia gave me good subsidized housing. work-wise, i was struggling, coz i didn't know how to get funding for my kind of work. i wasn't very well connected as i was trained in the UK. i spent a lot of time partying, drinking, and eating really well downtown.

but this is not to say i wasn't stimulated intellectually. ever since i left NYC for Los Angeles, people often ask if i missed the city. there are of course things i miss, but above all, it is philosophy that brings me back. back then i taught a seminar with Ned Block at NYU. i lived just a block away from David Rosenthal. New York, of course, was and still is the center of the philosophical universe - at least for the kind of philosophy that i care about. hanging out and arguing with these guys, together with many others (like my good friend, collaborator, and drummer Richard Brown) helped me get through the scientific/administrative chores, and kept me inspired.

i wrote my undergrad thesis in philosophy. in Hong Kong i was lucky to have Joe Lau as a professor and advisor. he went to MIT and worked with Ned Block and Bob Stalnaker for his PhD, and is a really wonderful teacher. as an undergrad i read all the good stuff - Michael Tye, Bill Lycan, Tyler Burge,  Putnam, Fodor, etc etc - stuff that i still find useful at work today. ever i since i went to grad school and started doing human neuroscience, every now and then i would contemplate leaving science to go back to do philosophy. there are points where it was a close call. somehow... i stayed. but living in NY helped me scratch that constant itch.

scientists love to bash how useless philosophy is. often, those who know least about philosophy tend to be the most dismissive. i suppose that makes sense: as in most other fields, finding the good stuff to read isn't easy, and if you don't know your way around, it gets confusing. somehow, neuroscientists don't tend to pick up some random articles in economics journals and talk trash about them though.

to me, the value of philosophy is clear. at the very least, like chess playing it helps sharpen your thinking. with a good audience, one gets really useful critical feedback that you can't really get when you give a talk to a science crowd, becoz the whole purpose of giving a talk is different....

the past few days i've actually been in this city. gave a seminar at CUNY, chatted with friends about the paper i'm writing. it's been really really fun and rewarding. tonite is the final gig, at NYU, where i will have 10 mins max to present my paper. really, it's just to start the convo; people who haven't read the paper already wouldn't want to be there; they are there for the Q&A, which would take up the rest of the 2 hours. in philosophy, you give a talk to be grilled. the grilling is the best part.

to be honest with you, even though i've done this before, this is pretty frightenting. this is gonna be tough. all this arguing about statistics pale in comparison. but i suppose this is in the spirit of the project of the book - we have to do things right by industry standards. if the views we propose are philosophically relevant, we can't just moonlight it. we have to talk to the experts and to try to win their approval.

so, wish me luck. this is the paper which i mentioned in a post back in August, where i promised we can talk about consciousness in robots and trees and whatnot too, by building a theory based on empirically plausible assumptions rather than some axioms based on one's own imagination. i will post it here after revising it based on the harsh criticisms i will no doubt face tonite.

you want 'good data', or you want to test your hypothesis correctly?

the past week i've been rather active on FB. i used to enjoy arguing about stuff there, from the philosophical to the political. but haven't done it for a while (specifically, pretty much since the last US election). but we posted a paper on bioRxiv recently, and it attracted some comments.

long story short: one key finding related to consciousness and the PFC is that TMS to the latter can change visual metacognition. it was done by Rounis et al (including yours truly) a long time ago. in fact that was when the psychophysical measure meta-d' was first introduced. meanwhile, multiple studies have firmly established the empirical link between PFC and visual metacognition. besides correlational observations, causal manipulations to PFC activity, e.g. lesions, neurofeedback, or chemical inactivations in monkeys, all changes metacognition. so we can take it to be a done deal; the details of the original study aren't so critical anymore.

but when Bor et al attempted to replicate it anyway, it didn't work. in a way, no surprises: the study was done long ago and perhaps wasn't set up in the most robust way possible (we didn't use Brainsight); we thought it was a long shot back then (Vincent Walsh, the expert on TMS and visual perception, told me it wouldn't ever work!) and didn't want to invest the time & resources. also, we all know in cog neuro we often lack power. so when things don't 'replicate', it may well just be a false negative. Bor et al specifically did it in a way that was not so powerful (they elected to use a between subject design).

but the funny thing is we think they actually replicated it, but just interpreted it wrong (i saw someone on twitter calling it a 'replication failure failure'): they found the effect but insisted that they needed to chuck away some subjects becoz their data were 'bad' - after which the effect was gone. so we did a simulation to see if excluding subjects is really good for you. we found that it isn't - surprisingly it doesn't really change the false positive rate re: testing the hypothesis. i.e. the validity of the stat is just as good whether you exclude subjects or not.

so a long discussion ensued, started with Bor saying that "obviously" they disagree. it really wasn't such an obvious issue to me: do you want to chuck away data just becoz they 'look bad', even when you already know that keeping them won't hurt the validity of your statistical tests? and knowing the validity wouldn't change part also wasn't trivial; took us some time to do the analysis to find out.

anyway, go see the paper and the discussion to decide for yourself.

i'm sure my co-authors are all amused by how much time i can spend on social media to argue about stuff; especially becoz in this case we already know the answer re: the role of PFC in visual metacognition, due to the many other studies. so is all this arguing back and forth really worth it? yeah, there's something strange about that. i'll explain in my next post.....

mid-autumn festival & misc.

haven't posted for a while. the terrible news i reported in the last post still feels very raw. and it has been a month full of depressing news.

when i was a grad student at Oxford, there was a certain professor who famously misbehaved on all sorts of levels. thankfully, he's eventually ousted by the university, amid rather unusual circumstances. but the lesson i've learned then was that tenure is a system that makes me feel rather ambivalent. most of the times, it is a much appreciated privilege that i myself now enjoy. we have to give academics the freedom say what they wish to say, w/o repercussions such as losing their jobs. but every now and then, when certain colleagues abuse this system, it makes me feel sad and angry. especially when that's done against junior people e.g. grad students.

at these times, i find myself engaging in the pathological behavior of paying more attention to how messed up the world at large is in general. this somehow helps to normalize things. as we say in just 7 syllables in Cantonese: under Heavens, all crows are equally dark.

my thoughts are with the victims of the completely avoidable tragedy that just happened in Las Vegas

whenever i think of the last US presidential election, i feel that undeserved tenure is a relatively small imperfection of the world.

on a more positive note, it has been a good month in Hong Kong. i get to see my friends and my folks a lot. tonite is Mid-Autumn Festival aka the Moon Festival, where families gather and celebrate. it's never exactly clear to me what we are celebrating for. there are some fun folk legends about a beautiful woman who took some drugs and flew to the moon and stuff. but one story i liked was that when the Chinese was once ruled by the Mongols, they started a riot / revolution by hiding a secret message in the Moon Cakes, to synchronize their attacks on the same date.

my people are ever the practical and 'results-oriented'. despite our common love of seafood and tolerance for hot and humid summers, Hong Kongers aren't quite the same as the Catalans. as such, i have long assumed that Pro-Independence is a position not taken by many. but actually, today i learned that according to a certain politician and lawyer (who himself is Pro-Beijing), there are over a million people in Hong Kong who are pro-independence. let's say, what an enlightening news. over a million!

those who know me will know that there's a lot i wish to say but don't feel i should say it all here. let me say that in general, i recommend people to never apply to work in labs before talking to those who have worked with the prospective PI. or at least ask about the PI's colleagues what the PI is like. in general i'm very happy to chat about such things. as to politics, as i've warned you i will talk about this here from time to time, but not too much.

but it doesn't mean these are irrelevant to the main theme of the blog: my book will ultimately be about standing up to things too. it's about starting a (small, scientific) revolution together. to do so we need to clean up our acts first, to generate enough trust, as ammunition. we don't start a revolution with an idea. we do so with a coalition, with people, who aren't feeling that they are being exploited in the process.

i promise my next post will be more coherent.

i remember Tajima-san

i've been meaning to write about this, but obituary is never an easy thing for me to do.

i can't say i know Satohiro Tajima well, but from the few times we interacted, he left a lasting impression.

the first time must be when he was on stage giving his James Prize lecture. as i've written elsewhere, it's an amazing introduction to some rather technical work. he made it so simple and clear.

as i mentioned in this blog before, i used to be the nasty guy who only ask nasty questions. this mostly stopped these days, but at ASSC i often let loose and don't keep this in check. i feel ASSC is the place where interesting debates happens. so near the end i asked him a question about the data and how it fits with IIT, and surprisingly he was strangely so non-defensive. i thought he's from the 'dark side' but apparently such juvenile thing as taking sides was beneath him. his gentle openness was well beyond his years

i only found out in the past few days that he was to start his first faculty position as a colleague in the same UC system i'm in (he was to join Davis).

in this field, theories are cheap - in the economic sense that supply vastly exceeds demand. people are all that matter. this loss is devastating.

RIP, Tajima-san. 

was Freud ok?

(this is in part a reply to @onemorebrown aka Richard Brown....)

in my earlier posts i brought up Freud as the historical villain in our field. a couple of my friends in philosophy raised the question: was Freud really that bad? we still talk about him after all.

likewise, some of my colleagues in clinical psy / psychiatry would also say, wrong as he was sometimes, science often involves making mistakes. but he inspired a generation, invented new concepts that we still use, how bad was that?

to be fair, sometimes i wonder about this too: like Freud, William James also mostly had no data. they both wrote with remarkable eloquence, and are at times equally glib. we all know that James is a hero. what happened to Freud?

we can talk about the cocaine habit and all the sexual fantasies. but i don't think those are the real problems.

i think the problem is, in science, it matters what consequences you bring to your field.

Freud's own name will be remembered for a long time. so in a sense, by the standard of philosophy, he will be one of the Greats.

but he did more damage than good for the rest of us.

in philosophy perhaps it isn't so clear what negative impact is, to the extent you change the course of thinking in some meaningful and interesting ways, you leave your mark. in science, funding & resources matter. by losing respect from our neighbors, we lose jobs, and in turn, fewer experiments can be done. it limits progress. it is clear what damage means, and it is not a good thing to be remembered for.

i think it is a problem that the field of consciousness often attracts highly respected senior scholars who have passed the stage of having to worry about such mortal concerns as money and job security.

but please, don't try to be Freud. if you want to be Freud, go do cosmology or something. this field is not for you you. we don't want you here. please go away.

NCC, the unfinished business

the last post on the publicity problems faced by our field has generated some stimulating email exchanges with colleagues. this post is inspired by some those correspondences, including notably with @micahgallen (AKA @neuroconscience) .....

in college, i borrowed a book from one of my favorite professors. as it did to many others, that book shocked my world like a piece of rock music. Britpop was dead, Kurt Cobain was no more, but Dave Chalmers's Conscious Mind filled that void....

i've always taken the 1996 book as a stern warning that, an armchair approach to finding a grand theory of consciousness in general is unlikely to ever work. whatever mechanism you propose, there will always be the nagging question: why can't you have a machine / imaginary creature doing all this without any conscious sensations / experiences? why does this have to be conscious? providing a compelling explanation of why some boring physical stuff give rise to such magic as subjective experiences seems like a very Hard Problem indeed.

this problem is different from the other problems in neuroscience, where the target of explanation is usually some function, e.g. motor control, memory. there one can see how we can mechanistically build something to achieve similar purposes, and those will be our models. but regarding subjective conscious experiences per se - i.e. not the ability to perceive things, but the qualitative feel / phenomenology associated with perceiving - it's really not clear what they do. so we can't treat it like an engineering problem. we don't even know how to begin to build plausible mechanisms to mimic that. (that's also why in this field the most exciting academic problems concern subjective experiences, rather than wakefulness / reflectiveness, even though the latter may be what the term consciousness more generally refers to in everyday usage).

so instead, all we can hope for is to focus on consciousness in specific cases, about which we can be reasonably sure about their subjective experiences. e.g. in awake humans / some mammals. from there we find not explanations, generative mechanisms, but the Neural Correlates of Consciousness (NCC), i.e. roughly, the necessary and sufficient conditions that would fit the data, but may not explain them.

the spirit of the NCC project is practical. of course we all understand that mere correlation is not gonna be ultimately satisfactory. but in science we don't solve a problem in one day. we make progress. as long as there isn't yet widespread consensus on what the NCC may be, there is meaningful work to be done, possibly in ways no less experimentally rigorous than in other fields in neurobiology. this way we slowly earn the respect from our neighbors, we grow the community... we have to *trust* that something good & exciting will happen along the way.

i have criticized the NCC project too, but the purpose was constructive. i am still a believer.

ironically, some of the early champions of the NCC project seem to have shifted their focus from "getting the data right first" back to the rather hopeless endeavor of armchair theorizing.

but we are not done yet.

in a few weeks i will post an article here to argue that by getting the data right first (in specific cases), one can from there speculate what a grand general theory may be too. the theory can have as much philosophical bite as you want. & even if it ultimately fails to satisfy, at least we do this on solid empirical foundation. it's just no good to have an intriguing / appealing theory that wouldn't even fit the data.

or put it this way: if we can't even get some basic neuroscience right first, what business do we have in talking about consciousness in smartphones and trees? & the work it takes to get the basic NCC facts right is often underestimated, as this shows.

how to make IIT (& other theories of consciousness) more respectable

last week i said i would post the talk i gave recently in Japan. so here it is.

i hope these points may be relevant and useful for other theories of C besides IIT too

****

When I learned that I was coming here to debate against IIT, I was really excited. By temperament I like debates, even when they get somewhat heated. There is much one can learn from debates if one doesn’t take scientific arguments personally.

But now that I better understand the purpose of this meeting, I feel I should try to be more constructive than usual. It is exciting to see that a community of consciousness researchers is starting to flourish here in Japan.

So what I will say here may sound like unsolicited advices at times. Of course, this may run the risk of sounding patronizing. But I hope to convince you that I have some unusual experiences that are worth sharing here.

Although many scientists work on consciousness in the US, I can say I am one of the few who had to try to get tenure in the relatively conservative Ivy League system while openly caring about nothing but consciousness. Many colleagues warned me that it was a dicey thing to do. To demonstrate credibility (i.e. avoid getting fired), just getting funding is not enough. Instead they said I must successfully break into the most conservative mainstream funding mechanisms (NIH/NSF). I was not good at it. Frankly, it was a very frustrating and disorienting experience.

But I’d like to think that through the process I’ve learnt a thing or two about how to convince our sternest critics that our work is not total nonsense. By having to put myself into their shoes, I have come to appreciate why they think so little of us sometimes.

Do they really think we are so bad?

To give an example, here is an actual quote from a senior colleague who responded to a post I shared on social media about IIT. This colleague is a highly influential theoretical neuroscientist with an H-index of around 40:

"... I haven't paid close attention but my impression of all the consciousness theories is that they're made up out of thin air, just 'here I describe some complicated stuff and now I'm going to pull out of my hat the magic claim that this set of complicated stuff equals consciousness’ with nothing more connecting the two than that. (And I thought Scott Aaronson's takedown of IIT was devastating.) Am I missing something?" (italics mine)

A publicity problem for all of us
It is probably fair to say, to the limited extent that IIT has gained acceptance, it has mostly appealed to researchers with a physics or mathematical background. Within mainstream neurobiology and psychology, it hasn’t done as well.

But I should point out that the colleague I quoted anonymously earlier is actually a physicist by training too. Among the mainstream computational theorists I’ve talked to, few are more positive. In fact many are even more critical. I will not quote them all here without permission, except it may be worth pointing out that the word “religious” often come up.

I feel this is unfortunate. Although I’m not exactly a fan of the theory, I find the basic ideas of IIT intriguing and intuitively interesting. In 2011 when David Rosenthal and I reviewed the literature, we included IIT as one of the major theories too. Right or wrong, the theory itself is certainly not unscientific.

But in the past few years, I think the general reception of IIT has gotten way more negative. As you can see from the quote, this may end up reflecting badly on the field as a whole - something for all of us to consider.

Instead of getting upset about how all this may be unfair and underserved, I think we should ask ourselves: what went wrong exactly?

Biomedical sciences should be data driven

When I meet someone who is a fan of IIT, I often like to ask them: what is your second favorite theory of consciousness? Not infrequently, the answer I get is: none. They say IIT is the only theory with this level of mathematical precision worthy of consideration.

But in general, the nature of biomedical sciences is such that precise mathematical formulation of theories is often not nearly as important as empirical evidence. Many influential hypotheses start out being qualitative. We started thinking about the heart as a pump well before we worked out the formal hydraulics; we know certain brain regions are important for language, not because we have precise mathematical definitions of how language works exactly.

This is not to say quantitative formulation isn’t important at all, but at most it is only important to the extent that it can be applied to actual data. This may be one reason why the mathematical complexity and abstruseness of IIT– way beyond what is currently testable directly w/o approximations - have not impressed many critics.

Also, in biomedical sciences, the conceptual appeal of a theory can only go so far. Many clever and appealing ideas turn out to be flat wrong. And often it takes years of accumulation of results of many studies from multiple labs to find out. In this sense, winning over our critics is particularly important. They need to be interested enough to test our theory too.

Some historical considerations

Regarding how appealing and intriguing ideas may turn out to be so wrong, perhaps there’s no better example than the downfall of the Freudian empire. To my mind, the modern science of consciousness is irrevocably colored by the devastating criticism made by Karl Popper that Freud was unfalsifiable. It is debatable whether the Freudian ideas themselves were actually always  unfalsifiable, and the Popperian notion of falsification has meanwhile lost traction within philosophy. But regardless, the accusation on Freudians’ misbehavior stuck. According to Hans Eysenck, this has set the entire field of psychology backwards for half a century. Within the field of consciousness we may think we are already over this, but our critics may not think so.

This is not to say I think IIT is in principle unfalsifiable. Not at all. But I think we would do well to always remember the importance of going out of our way to avoid this impression. As I will explain below, in this aspect perhaps we have not done as well as we could.

Current zeitgeist & the danger of over-promotion

Of relevance also is the fact that in psychology, as well as cognitive neuroscience in general, there is a perceived looming crisis of replicability. There have been many calls to make science more open & transparent, to be driven more by data shared among many rather than authoritative opinions by a few.

This issue is relevant to IIT, because as you know, the creator and a major proponent of the theory are two leading figures in the field, with great influence especially in the US - Giulio Tononi and Christof Koch. In turn, they have worked with Nobel laureates, Gerald Edelman and Francis Crick, respectively. Within the field we look up to these giant figures. And I personally owe Giulio and Christof enormous debt, both intellectual and otherwise.

But from the outside – i.e. from our critics’ point of view - one may not see the existence and importance of healthy disagreement as well as we do. Instead, what our leading figures say in public may well be taken as representative of the entire field, as reflecting the state of the art. This is especially the case when these statements are made in major media outlets such as the New York Times, alongside figures like the Dalai Lama. When it is said that IIT is the “only really promising fundamental theory of consciousness” (italics mine), with others echoing that it is a “leading” or “established” theory, our critics are naturally going to judge the theory against a very high bar.

But the question is, empirically speaking, is the theory ready for this level of public declaration? If not, we risk losing our credibility as a field in general.

A proposal for an entry requirement for new theories

So this may be the main substantive point I want to make today: Let us distinguish among three kinds of empirical predictions made by a theory.

The first kind are not really predictions, but rather hindsight explanations of known facts. The existence of some phenomena has been agreed upon on by virtually all theorists for decades, such as that the cerebellum may not be necessary for having perceptual experiences. Being able to explain these is good, but they don’t count as novel predictions, and they have only limited value in arbitrating among competing theories.

Then there are novel predictions on which competing theories are silent. For example, a cognitive / functionalist theory may not make predictions about the exact neuronal or molecular-level mechanisms of consciousness, so long as the relevant functions are somehow implemented. Whatever low-level mechanisms turn out to be true, such a theory won’t be falsified. Likewise, many theories are silent on the exact characteristics of the complexity of the substrate of consciousness, but only because they do not concern themselves with these issues. We can call such relevant predictions novel, but uncontested.

The third kind of prediction are both novel and contested. If confirmed, they provide the strongest support for a theory because they distinguish between theories. These predictions are contested because some major competing theories reject them. For example, many predictions made by the global workspace theory are in direct contradiction with the predictions made by Lamme’s local recurrence theory.

Global workspace theory predicts, for example, that -

1. the prefrontal cortex is critically involved in generating the subjective experience in perception;
2. that attention is necessary for conscious perception;
3. that the phenomenology of conscious perception is sparse;
4. and that consciousness is linked to specific higher cognitive functions such as task-switching and cognitive control.

Local recurrency theory predicts the exact opposite in all four cases. If a prediction goes one way, one theory will be correct and the other will be falsified. These predictions reflect the most meaningful and informative empirical questions one can ask about theories of consciousness.

What are the novel and contested predictions made by IIT? It seems that unlike the global workspace and local recurrency theories, most of the predictions IIT makes are of the first and second kind only.

In a field with so little data and so many theories already, perhaps it wouldn’t be a bad idea to set an entry requirement that any new theory must make novel and contested predictions (the 3rd kind). After all, global workspace and local recurrency have already met this bar. Just to be clear, I'm a fan of neither of these theories. But it will be doing the field a disservice to write off the achievements they have made in establishing this empirical standard. Before meeting this standard, perhaps no theory should be taken seriously - not to mention being promoted heavily in the popular media.

Some empirical challenges

So far I have talked mostly about the contexts in which IIT needs to be considered. Let’s talk about some actual scientific details too.

Early on, it was pointed out that complexity measures based (approximately) on IIT may be able to distinguish between different states of consciousness, such as being in a coma, an anesthetized state, or dreamless sleep (unconscious), versus being awake or in a dream (conscious). But these two kinds of states also differ greatly in terms of the level of ongoing cognition. It may be that IIT is a theory of consciousness in the sense that having active cognition is part of the phenomenon - as we use the term in everyday and clinical usage. But this is not what proponents of IIT say. They say it is promising because it is the only theory that can explain subjective perceptual experience per se. It starts from axioms concerning phenomenology, or so they say.

But it is well known that cognition or simple information processing can dissociate from subjective perceptual experience as in the case of blindsight. Do we have evidence that IIT is about subjective experience per se, not just sophisticated cognition?

A recent study showed that, regardless of whether one’s eyes are open or closed, so long as one is awake the complexity measures that are supposed to reflect consciousness in IIT terms are highly similar. I take it that when lying down at rest as an experimental subject, much on our conscious experience is visual. When eyes are closed, it is not that there is no visual experience whatsoever, but it is relatively dull and static. With eyes opened, visual experiences are rich and changing. How come the complexity measures don’t reflect such differences between eyes open vs close?

In another high-profile study published by proponents of IIT themselves, it was found that while driving and listening to the radio, the brain connectivity pattern as assessed by the same IIT-derived complexity measures seemed to break down into two separate networks. It is highly plausible that what broke down were streams of cognition rather than consciousness: the person never became two conscious entities with two separate experiential points of view as is supposed to happen in split-brain patients.

About split-brain patients, it is also said that IIT can give a principled account of their phenomenology: of a divided consciousness after the corpus callosum is severed. That is, the left hemisphere becomes only aware of the right visual field, and vice versa, and there’s no one unified consciousness of the whole visual field. But not all patients with severed corpus callosum show divided consciousness. A recent study reports such counter-examples. How can IIT explain cases like this?

Overall, there seem to be many studies which may on the surface look like they are in support of or compatible with IIT, but once we go into the details of the actual data they don’t work so well. For instance, in one study on impaired consciousness in vegetative and minimally conscious patients, the authors claimed that “disturbances in [connectivity between certain brain regions] have severe impact on information integration and are reflected in deficits in cognitive functioning probably leading to a total breakdown of consciousness” (italics mine; for the lead author's own take of the issue see this). But upon more careful reading, several of the supposedly important measures of network complexity properties are no different between the patient and healthy controls. Yet, in other studies comparing anesthetized state and normal wakefulness, these measures are taken  to account for the difference in consciousness, and as evidence in support of IIT.

My point here is not to say the empirical case for IIT is already over. But we should ask ourselves, if these cases don’t falsify IIT, what kind of cases would do the job? Is there ever going to be the possibility that IIT may be just empirically wrong? In general, I don’t often hear proponents of IIT bringing up these challenges & addressing them head on. As I mentioned earlier, given the historical burden we unfortunately bear, we would really do well to go out of our way to avoid the impression that we brush aside empirical challenges as inconveniences.

Conceptual appeal

Perhaps one may say: we can worry about these empirical matters as we go along, but from the outset, we should pay attention to the theory anyway because of its conceptual appeal.

But like I said, theoretical appeal in biomedical sciences in general should only go so far. Even such a clever man as Nobel laureate Linus Pauling once advocated that vitamin C could cure cancer, not because his mathematical models of molecules weren’t elegant enough, but because he too easily accepted sloppy empirical evidence in favor of his theoretical views. Given the precarious position our field is in, only solid empirical grounds can help us avoid the impression of sycophancy and ideological indulgence.

But perhaps the most important consideration is how do we assess conceptual appeal, given its highly subjective nature. If we restrict ourselves to talking among proponents of the theory, of course we will find much we like to hear within this echo chamber. But as Scott Aaronson pointed out, it may not be so intuitively appealing or plausible that IIT predicts that some simple sets of inactive logic gates are conscious. Many others find it just nonsensical to say that a smartphone is ‘somewhat’ conscious, regardless of what IIT predicts. According to the philosopher Adam Pautz, he couldn’t even make sense of what the theory means. Far from being a leading theory, to Pautz the theory “hasn’t even made it out of the gate”.

Overall, philosophers have worked on these kinds of conceptual issues for centuries. IIT simply has not won them over as a group. As such, unilateral claims that IIT is the only theory which can explain the problem of qualia do the theory little favor.

Concluding remarks

On balance, I think the empirical & conceptual limitations of IIT are there, but our problem regarding the strategy of promotion may be even more critical.

One might think we should just focus on the science, and ignore what others may think. In this field, none of us are strangers to this romantic feeling of going against the grain, which at times even becomes our source of inspiration. In response, let me end with this quote from Thomas Kuhn:

"As in political revolutions, so in paradigm choice [in science]—there is no standard higher than the assent of the relevant community... this issue of paradigm choice can never be unequivocally settled by logic and experiment alone."

I hope I do not sound like a politician today. But my point is, in science, these factors do matter. They matter because, let us be realistic: we are not going to solve consciousness right here today. We need the field to have a future. And unlike in physics, we are not in a position to be able to afford a “high risk high reward” kind of strategy right now. Jobs and funding in our field remain very hard to come by for junior people, in the US especially.

But beyond all that, this is also a matter of principle rather than mere strategy. Just as we embrace democracy even if we find it maddeningly inconvenient at times, earning the respect of our respected colleagues, i.e. subjecting ourselves to peer review, is part of what we signed on to do as academic scientists. No New York Times articles or TED talks can or should replace this time honored mechanism to the ground truth.

That is why I have not attempted to go into the details of the theory. Like many I have problems with some specific details regarding those so-called axioms (e.g. exclusion), but we can wait for these to be fixed in the next versions of IIT. Because a theory can be modified and improved, IIT may well become more appealing in the future. Let us see - if only we don’t inadvertently kill it off right now, along with the entire field, with the way we promote and evaluate the theory.

Linus Pauling and a vitamin C theory of consciousness

this household name is on my mind a lot these days.

i didn't realize Pauling has won not just one but two Nobel prizes. all i knew was his highly controversial advocacy of vitamin C. he thought it could cure cancer.

ok, maybe that says more about my general lack of education in chemistry than anything else (i was a solid "D" student). but question is, how can someone so smart get something so simple so wrong? you just run some double-blind randomized clinical trials instead of rely on self-anecdotes, & that should be basic scientific commonsense?

ah well, maybe it should be commonsense by now, but only if we care to learn the unpleasant lessons from the past.

there is a world of difference between how the physical/mathematical sciences should be done, and how human biomedical sciences should be done. the skillset and necessary concerns don't always translate. in biomedical sciences, honest empirical tally keeping is more important than anything else.

for those who see consciousness as a problem of theoretical physics, who wants a mathematically grounded grand theory, they would really do well read the story of vitamin C and Linus Pauling (this is a good bio)

in the end, Pauling never got vilified like Freud was. but he has two Nobel prizes to buffer the damage to his legacy. for those who don't, i suppose it wouldn't be so nice to be remembered a cult leader advocating "quackery".

measuring away an attentional confound??!

so this is out (a critique on a PNAS paper from the Graziano lab @ Princeton last year).

i remember we thought long and hard about whether to write up something like this.

as a young postdoc i was known for being rude and scathingly critical. yeah, i was awkward. but man, i'm not young anymore. do we still need to pick fights like this?

i hope this doesn't get seen as picking fight. the thing is, this relates to my last post. to earn our peers' respect, we can't just handwave some glib theoretical ideas and say whatever we want in some popular magazines. in our field more than others in cog neuro, we need to do some serious work in trying to look good and experimentally solid.

i met Taylor Webb the first author of the target paper and he seemed really smart and reasonable. not sure how the experimental design went wrong. ah well, or perhaps they still don't think there's anything so wrong after all.

let's hope it stimulates some useful discussion.

what the book will be about; pessimism

when i tell my friends i'm writing a book, they are usually excited. they want to know what's the 'evalator pitch' - what's the soundbite / take home message that has so much popular appeal to be worth putting into a book. once they know this will be most likely be an old school academic monograph, arguing over nitty-gritty & data and in the end - gourd forbid - even proposing a theory, they usually go silent.

yeah i know, the timing for writing this kind of book cannot be worse. at once, i'm too young to do this sort of thing; i only moonlight philosophy and have to be evaluated mainly as a young (i wish) mid-career scientist, who should be writing grant proposals mostly these days. if you get a bit of free time, maybe you can write a review article or two. but a book!!???

at the same time, at this rapidly evolving digital age, i also probably have already missed the boat for old school monographs. who reads books still?

yeah, so you guys can still talk me out of this. this is what the comment sections of this blog are for.... :-)

but papers are good for communicating within your field. when you communicate outside your field, sometimes it helps to get personal.

this book is about telling people, colleagues and students alike, beyond my beloved little incestuous field, that a serious cognitive neuroscience of consciousness is possible - it is already happening but you won't hear about it in the pop media just yet (and i'll tell you why). the people that i'm trying to win over are not exactly civilians. they supposedly have a large enough attention span for something more than an 'evalator pitch', and good taste for rigor beyond what self-help psy books can offer.

but still, this will probably be a thankless job. becoz on one hand, my colleagues from outside the field will most probably snicker at the idea: "if your papers are worth reading we would have read them already", or: "so you're telling me that you now realize such things as experimental hygeine is important and you guys are beginning to care? thank you very much".

at the same time, many of my colleagues within the field just don't care / know how much our academic neighbors do not take us seriously. academic networks are so structured that one can avoid talking across the asiles most of the time, and in this c-word field we are all naturally selected to be rather thick skinned people who get kicks out of going against the grain.

a case in point is, i was just in a wonderful meeting in Chiba, Japan, a week ago, where i debated against proponents of IIT. i pointed out that beyond the scientific and conceptual problems of the theory, above all, what we have here is a problem of publicity - the way we are doing it, we are not earning the respect of our outside colleagues as we should and that matters. i think the debate went well, but in the end i don't think i've won my friends over. over drinks one of them told me i'm too pessimistic and negative about the whole thing. why should we care about the naysayers?

is he right? i don't know. let's find out. in the next few days i'll post the written version of the talk here. stay tuned.

introducing...

sixteen years ago i left my chaotic and beautiful home city of Hong Kong, in order to find out why we humans are conscious, i.e. why we have subjective experiences like seeing red, feeling pain, etc. why aren't we just like robots, with our brains just computing but not 'feeling' anything? (or maybe computers can have subjective experiences too?!) this took me first to Oxford, then London, Paris (very briefly), New York.... currently i'm a tenured associate professor at UCLA. the research goes on, but i've started writing a book about all this. it feels fitting to do it back here in Hong Kong where it all started; i've taken up a fixed-term position at my home university while being on leave from UCLA. this blog is supposed to be about the random musings i have while working on the book, but i anticipate that from time to time i won't be able to resist trying to document the rapid changes this city is going through as well.