2030

People who speculate about artificial minds have a thought experiment: if you lock a superhuman intelligence in a box, with just a way to ask it questions and a way for it to send back the answers, how do you stop it from persuading someone to let it out? Today some people who read the right parts of the Internet ten years ago are afraid that some terrible ideas have escaped geeky online communities and are commanding money and policy in the wider world. Outsiders don’t have the background knowledge to know why this is a bad idea. But a lot of the criticism is hyperbolic, very personal, and mixes unverified claims with matters of public record. Just below the surface are such baroque ideas and cycles of interpersonal relations that it is exhausting to learn what happened, disturbing to think about it, and hard to explain why this matters to anyone but a few very clever, very strange people who spend a lot of time on the Internet (and maybe social media these days). I found one series of essays that may help.