Archive - AI Snake Oil

AI existential risk probabilities are too unreliable to inform policy

How speculation gets laundered through pseudo-quantification

24 hrs ago •

Arvind Narayanan

and

New paper: AI agents that matter

Rethinking AI agent benchmarking and evaluation

Jul 3 •

and

Arvind Narayanan

June 2024

AI scaling myths

Scaling will run out. The question is when.

Jun 27 •

Arvind Narayanan

and

Scientists should use AI as a tool, not an oracle

How AI hype leads to flawed research that fuels more hype

Jun 3 •

Arvind Narayanan

and

April 2024

AI leaderboards are no longer useful. It's time to switch to Pareto curves.

What spending $2,000 can tell us about evaluating AI agents

Apr 30 •

and

Arvind Narayanan

AI Snake Oil is now available to preorder

What artificial intelligence can do, what it can't, and how to tell the difference

Apr 10 •

Arvind Narayanan

and

Tech policy is only frustrating 90% of the time

That’s what makes it worthwhile

Apr 3 •

Arvind Narayanan

and

March 2024

AI safety is not a model property

Trying to make an AI model that can’t be misused is like trying to make a computer that can’t be used for bad things

Mar 12 •

Arvind Narayanan

and

A safe harbor for AI evaluation and red teaming

An argument for legal and technical safe harbors for AI safety and trustworthiness research

Mar 5 •

and

Arvind Narayanan

February 2024

On the Societal Impact of Open Foundation Models

Adding precision to the debate on openness in AI

Feb 27 •

and

Arvind Narayanan

January 2024

Will AI transform law?

The hype is not supported by current evidence

Jan 24 •

Arvind Narayanan

and

Generative AI’s end-run around copyright won’t be resolved by the courts

Output similarity is a distraction

Jan 22 •

Arvind Narayanan

and

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts