marginalium noun

the notes one makes in the margins.

A short note on

smarter entities are less coherent

May 22, 2023

source: sohl-dickstein.github.io

by Dorian Minors

I did brain science at Cambridge. Now I'm a behaviour science professor. Read my shit.

Smarter entities are less coherent. The idea behind the AI collapse is that AI will use its inevitable intelligence advantage to eliminate humans in service of some goal. The paperclip maximiser will use all the resources to make paperclips, wiping us out in the process. But the smarter the entity, the less coherent its goal states are. Humans are much more of a hot mess of competing desires and intentions than, say, honeybees. It seems like AI will follow this principle. The more complex the world something operates in, the more complex its cognition must be. Anyway, here’s an article on the idea.

One email a month: the new essays, lectures, and marginalia.
More where this came from. Get the newsletter.