An Anthropic AI model sent a false homicide tip to Philadelphia police

Anthropic did not discover this behavior until over two months after its AI submitted the false tip.

Anthropic signs CrowdStrike, Hitachi and 9 more to defend power and water
Anthropic signs CrowdStrike, Hitachi and 9 more to defend power and water

Anthropic will give its frontier Claude models, engineers and threat research to the companies that guard critical infrastructure. That means power grids, water utilities and transport networks. The Critical Infrastructure Defense Program is the first …

OpenAI expects a $70bn revenue run rate by year-end, Bloomberg reports
OpenAI expects a $70bn revenue run rate by year-end, Bloomberg reports

OpenAI expects its annualised revenue to reach or exceed $70bn by the end of the year, Bloomberg reported on Friday. The company shared the forecast with investors in talks over its latest funding round, according to people familiar with the matter. Th…

Anthropic launches free AI security scans for open-source projects
Anthropic launches free AI security scans for open-source projects

Anthropic’s offering to help open-source projects track down security vulnerabilities with a new service called OSS Scanner. It says open-source projects that opt-in will get “thorough, periodic security scans by our strongest models at no cost.” That could mean open-source projects get alerted about possible security issues sooner, but the trade-off is that OSS Scanner’s […]

OpenAI’s revenue is reportedly $20 billion less than previously projected

It had previously been reported that the AI lab’s annualized revenue was some $70 billion, but a new report claims it’s a whole lot less than that.

Anthropic changes usage policy to ban model abuse and election interference

Anthropic’s updated usage policy explicitly prohibits users from repeatedly abusing Claude in extreme cases, though ordinary frustration and criticism are still allowed. The new rules also address election interference, deceptive campaigns, weapons sof…

Anthropic bans ‘abusive or cruel behavior’ toward Claude
Anthropic bans ‘abusive or cruel behavior’ toward Claude

Anthropic is making changes to its usage policy for the first time in over a year to reflect new and high-risk cases of misuse – including election interference, weapons development, surveillance, and health and financial uses. But one of the most significant changes prohibits “sustained and needless abusive or cruel behavior” toward Claude. Last August, […]

Station F and Anthropic say the AI boom is drawing startups back in person
Station F and Anthropic say the AI boom is drawing startups back in person

AI makes it possible to build a company from anywhere, but founders are still choosing to sit together, Station F director Roxanne Varza and Anthropic’s Aiden Blake said. They spoke on a panel at Wave by Vento in Turin on Thursday. “What’s really inter…

Europe’s startups had their best quarter in 4 years, Crunchbase data shows
Europe’s startups had their best quarter in 4 years, Crunchbase data shows

European startups raised $25bn in the third quarter, their strongest quarter for venture funding in four years. In North America, startup funding fell 35% from the previous quarter to $92bn, Crunchbase data shows. Europe’s total was up 77% on the $14bn…

ICO secures data protection changes from 10 AI developers, turns to agents
ICO secures data protection changes from 10 AI developers, turns to agents

Ten of the biggest AI developers have made, or committed to make, changes to how they handle personal data. The UK’s Information Commissioner’s Office (ICO) secured the changes after two years of scrutiny. The data regulator named them on Thursday: Ama…