Discussion about this post

User's avatar
hypnosifl's avatar

I don't agree with the AI doomers but this doesn't seem like it's showing anything internally incoherent about their view. When first describing option 1 you say:

"Human beings appear as initiators of a process whose consequences they cannot alter. Agency exists only at the point of ignition, not at the point of outcome."

You (or Land) seem to acknowledge here that option 1 does allow for agency at the point of ignition (i.e. those who believe in option 1 think there is some possibility global regulation could prevent AI from being developed, at least before a sufficiently advanced theory of "alignment" was developed; only if we fail at that step does extinction *then* become inevitable). But then in the section on the trilemma you describe 1 as "If extinction is inevitable, intervention cannot be decisive." Isn't this conflating the claim "extinction is inevitable regardless of what we do at any point in history" with the earlier claim "extinction is inevitable if we fail to act decisively before the point of ignition"? Is this more like a vibes-based critique that the first option is drawing on Calvinist intuitions but steps back from going fully Calvinist when it thinks about the point of ignition?

Cratylus's avatar

”Philosophy does not secure the future of humanity. It exposes the contingency of the human position within intelligence as such. Artificial intelligence is not the origin of this problem. It is its contemporary expression.” Good summary!

7 more comments...

No posts

Ready for more?