When it comes to the dangers of artificial intelligence (AI) and now artificial superintelligence (ASI) (sometimes called artificial general intelligence), I feel as if we've been transported onto the set of the 1983 film "WarGames."
In the film teenage hacker David Lightman stumbles onto the military's most sensitive war scenario planning computer while believing he has simply found a soon-to-be-released game called "Global Thermonuclear War" on the server of a computer game company. Lightman activates the game which ultimately makes personnel at the North American Air Defense Command (NORAD) mistakenly believe that the Soviet Union is preparing for an attack. On big screens throughout the war room, Soviet movements and preparations become ever more threatening by the hour. As we are told later, the object of the game is to win and so the computer sets out to win a thermonuclear war.
When Lightman realizes what he's done, he seeks out the one person he believes can stop the madness. (I'm skipping a lot of steps here.) He catches up with the architect of that war planning computer system, Stephen Falken. Falken is living a solitary, anonymous existence (under a different name) in a home that Falken says is near a primary nuclear target. He explains to the young hacker: "A millisecond of brilliant light and we're vaporized. Much more fortunate than the millions who'll wander sightless through the smouldering aftermath. We'll be spared the horror of survival."
