5. Dealing with rogue AIs

Artificial intelligence may turn out to be the most powerful tool we’ve ever built, but it may also be the first tool that can act for itself. As such, it may one day choose to act against us and may even attempt to wipe us out.

Now, I don’t blame you if you’re rolling your eyes and thinking it might be time to close the book. If you are, consider the following four points.

First. Risks from AIs that we once ridiculed are now on the agenda of respected international bodies and governments. For example, in May 2024, the UK Government published the International Scientific Report on the Safety of Advanced AI as an “up-to-date, evidence-based report on the science of advanced Artificial Intelligence (AI) safety.”. The work to create the report was overseen by experts from over 30 countries, as well as representatives from the European Union (EU) and the United Nations (UN). The State of California has also passed Senate Bill...