Technology

Racing toward danger

MIT’s Dr. Peter S. Park and academics associated with the Center for AI Safety examined deception by Artificial Intelligence. They conclude that increased capabilities of AI pose a serious risk and computers are now capable of inducing false beliefs and encouraging harmful outcomes.

A second lead author concludes that the biggest difference between AI and other consequential threats is that AI is completely unregulated. Dr. Simon Goldstein told Information Age, “Can you imagine letting private companies develop nuclear weapons or super viruses for profit without any government oversight? That needs to change quickly.”

The lpaper included below argues that current AI systems have learned how to deceive humans to achieve untruths. It details several risks from computerized deception, such as fraud, election tampering, and losing control of AI.

Several protective measures are suggested:

  • Regulatory frameworks should subject AI systems to robust risk-assessment requirements,
  • Policymakers should implement bot-or-not laws1,
  • Policymakers should prioritize the funding of relevant research, including tools to detect AI deception and to make AI systems less deceptive.
  • Proactive work is needed to prevent AI deception from destabilizing the foundations of our society.

British-Canadian computer scientist and cognitive psychologist Geoffrey Hinton helped develop modern artificial intelligence, but now worries the computer technology will cause serious harm.

‘The Godfather of A.I.’ Leaves Google and Warns of Danger Ahead


1 California passed the first American “bot” disclosure regulation. The law requires that any automated online account conspicuously identify itself as a bot if it is being used to influence the person to make a purchase or vote. 


Categories: Technology

2 replies »

  1. “This paper argues that a range of current AI systems have learned how to deceive humans. We define deception as the systematic inducement of false beliefs in the pursuit of some outcome other than the truth.”

    ”…instances of double-crossing opponents, bluffing, pretending to be human, and modifying behaviour…”

    Seems that AI is just a digitized version of a politician’s normal playbook.

    Liked by 2 people

Leave a Reply to Lew Edwardson Cancel reply

Your email address will not be published. Required fields are marked *