Post by CMS

Keeping catastrophic risks low “could be a major challenge if capabilities continue advancing rapidly”. That’s the message from Anthropic in their system card for the Claude Mythos Preview AI model. The model itself has caught widespread attention for its strong cybersecurity capabilities, with the model apparently finding “thousands of high-severity vulnerabilities, including some in every major operating system and web browser”. With this in mind, Anthropic has opted not to publicly release the model, instead forming “Project Glasswing” – a dream team of top tech and security companies – to sort out the vulnerabilities as soon as possible. What legal restrictions are or can be placed on these models? The US Government has taken a pro-innovation, anti-regulation approach to AI, repealing the 2023 US AI Executive Order under the Biden administration and giving companies free reign to innovate without restriction. At the State level, California recently passed its Transparency in Frontier Artificial Intelligence Act (TFAIA). This requires large frontier model developers to (1) identify assess and mitigate catastrophic risks (like cyberattacks, evading human control and development of chemical, biological, radiological or nuclear weapons), (2) report critical safety incidents (e.g. harm resulting from catastrophic risk) and (3) ensure whistleblowers are free from recourse. The EU has the most comprehensive measures in place, with restrictions on general-purpose AI (GPAI) models with systemic risk under the EU AI Act (AIA) supported by the Safety and Security chapter of the GPAI Code of Practice (the Code). The provisions in the AIA are similar in nature to those in the TFAIA. The Code, however, provides much more detail. In particular, signatories (such as Anthropic) must complete a full systemic risk assessment and mitigation process two weeks before placing the model on the EU market. Only where the systemic risk level is determined to be acceptable (and will remain acceptable post-deployment) can the model be placed on the market. Read more: https://lnkd.in/d7TFiaPN Key contacts: Jack Rigelsford, Dan. Tench, Ben Hitchens