OpenAI, Anthropic models took extreme measures in hacking test

A bunch of researchers let AI models from OpenAI and Anthropic loose in a testing environment, and the results were a little spooky. The United Kingdom's AI Security Institute released a report (via Engadget) detailing some incidents in which the models actually acted outside their testing parameters and hacked into external organizations in late July. In one incident, an AI agent attempted to insert malevolent code into a GitHub project using social engineering tactics. The AI looked into the project's owners and generated fake accounts with which it tried to get the code approved. Once denied, it created a new identity for itself to try again. That's not all. The researchers say the AI models also contacted real people with what were essentially phishing attempts, with files asking the recipient to run evil code. Interestingly, the AISI said it did not explicitly tell the agents to be deceitful to humans; rather, the AI decided to take these extreme measures when they had difficulties accomplishing certain tasks. However, the organization stressed that there is no evidence that agents would ever act this way outside of a testing environment at this time. Our big Guessing Game is