Posts

Could AI become conscious? Well, maybe…

A recent article in Nature laid out three arguments for why current Artificial Intelligence systems are not conscious and why future AI systems are unlikely to ever become conscious (1). The first claim seems right to me, based on the current technology, but the second one, arguing for impossibility in principle, feels like a stretch. The authors of this piece were Anil Seth, Ned Block, and Giulio Tononi – three heavyweights from cognitive science and philosophy. (Seth and Block have both published much longer pieces making similar arguments in Behavioral and Brain Sciences ( 2 ) and Trends in Cognitive Sciences( 3 )). The authors were motivated to address this issue by claims that current AI systems either have already attained consciousness or soon could. This has prompted concerns about “AI rights” or “AI welfare”, personhood, autonomy, responsibility, and a host of other issues – practical, legal, and even existential.   I think the authors are right to be skeptical of the...

Can we override our programming?

Image
I’ve been watching a couple of TV series recently – East of Eden and Lanterns – and a strange juxtaposition happened yesterday as I switched from an episode of one to an episode of the other. Both shows have a running theme exploring how we become the people we eventually are and how much choice and agency we can exercise in the process. But the episodes I watched last night had an even closer parallel: both had characters expressing the desire to “override their own programming” (one of them explicitly using that wording). In both cases, the character expresses a conscious wish to be kind and good, while recognising that their own nature is neither of those things. This is, more generally, a perennial theme in literature and also a constant in our personal lives. Most of us recognise that we have some set of deep-rooted dispositions, tendencies, proclivities, and motivations from which our inclinations and impulses issue. There may be arguments about where these dispositions come ...

What is cognition?

“Cognition” is one of those terms that we use a lot, but which is actually rather hard to define. The question of what constitutes cognition looms large in debates about whether other organisms, besides humans, do it or have it. Most people are willing to grant that many animals are in some way cognitive, but what about simpler critters, like nematodes or jellyfish? Are they capable of cognition? For that matter, what about bacteria or plants? Can they cognize? How about artificial systems, like large language models? Does cognition require a nervous system? Does it necessarily involve “thinking”? Or some kind of “mental” activity? Once you start defining it in that rather circular fashion, you quickly realise we don’t have good definitions of “thinking” or “mental” either!   Is cognition just “what cognitive scientists study”? Or are they only studying a particular version of it – the kind of cognition we see in humans? Maybe there is a less anthropocentric way to define i...

Eugenics, statistical hubris, and unknowable unknowns in human genetics

Image
A new paper just out in Nature , by Peter Visscher and colleagues (including bio-ethicist Julian Salvulescu) explores the idea of polygenic genome editing of human embryos to reduce the risk of common diseases. This is, to say the least, a controversial idea, and a decidedly fantastical one. The authors present the results of statistical modelling which suggests that editing a small number of risk variants in each embryo’s genome could dramatically reduce the risk of a number of common disorders. But there are good reasons (lots of them) to doubt the assumptions on which this modelling is based and to have serious concerns about possibly deleterious unintended consequences of such interventions. I co-wrote a commentary on the article with geneticist Shai Carmi and law professor and bio-ethicist Hank Greely, outlining some of the limitations of the modelling and our concerns over the dangers of the proposed approach. I’ll expand on those points here.   First, the development...