I disagree on the AI 2027 thing, I don't think that we've seen any evidence of self-improvement or a rate of increase in abilities that it suggests. If anything I think that the rate of improvement has slowed since GPT3, without some entirely new architecture I don't see any takeoff scenario. The only way I can imagine AI killing everyone is if somebody decided, for some inscrutable reason, to put an LLM in charge of nuclear missile launches.
The psychosis is worrying but I think an artefact of a new technology that people don't have an accurate mental model around (similar to but worse than the supernatural powers attributed to radio, television etc). Hopefully AI companies will provide more safeguards against it but even without them I think that people will eventually understand the limitations and realise that it's not in love with them, doesn't have a genius new theory of physics and makes things up.
The psychosis is worrying but I think an artefact of a new technology that people don't have an accurate mental model around (similar to but worse than the supernatural powers attributed to radio, television etc). Hopefully AI companies will provide more safeguards against it but even without them I think that people will eventually understand the limitations and realise that it's not in love with them, doesn't have a genius new theory of physics and makes things up.