nafyi.

OPINIONS EXPRIMÉES EN PUBLIC

Nathan Lambert

1 sources · 3 points de vue · 3 sujets

Contenu mis à jour:

Nathan Lambert sur AI safety discourse dynamics, media virality and AI narratives, organizational safety practices. Explorez 3 points de vue par thème, avec des éléments tirés de 1 source.

Explorer les liens

Points de vue par sujet

Points de vue attribués, classés par date de publication de la source. Un aperçu de ces échanges, sans prétendre définir toutes les convictions de la personne.

Les traductions sont destinées à la lecture ; les extraits originaux restent la source evidence.

AI safety discourse dynamics

Voir ce sujet
AI safety discourse dynamics

Some of the most extreme AI risk views reached the masses

Nathan Lambert says it was not known in advance which views of AI risk a growing group taking AI safety more seriously would latch onto. He says some of the most extreme views—moderate probabilities of mass extinction—were the ones that reached the masses.

Éléments favorables

Nathan Lambert·

One resignation turned the embers of AI fear into a wildfire

Extrait original

We have seen that some of the most extreme views of risk, i.e. moderate probabilities of mass extinction, were the ones that reached the masses.
Contexte

As AI became more powerful, it was inevitable that a different, growing group would start to take AI safety more seriously – what we did not know ahead of time, is which set of views they latched onto. A lot in the AI world is about to change due to this.

Ouvrir l’original · Paragraphe 2 (s’ouvre dans un nouvel onglet)Source du texte original (s’ouvre dans un nouvel onglet)
Nathan Lambert
Partager un aperçu

media virality and AI narratives

Voir ce sujet
media virality and AI narratives

Lambert says fear is the simplest story, one people cannot look away from

Nathan Lambert describes fear as an attention-grabbing narrative in AI discourse. He says Jacob Coxon’s resignation reached a receptive audience and spread more widely than expected.

Éléments favorables

Nathan Lambert·

One resignation turned the embers of AI fear into a wildfire

Extrait original

Jacob Coxon was the one who stumbled into this new powder keg, totally unaware of what was going to come.
Contexte

Then, some basic factors of human nature apply, with the most crucial being that fear sells. Fear is the simplest story, the one people cannot look away from. What looked like a fairly innocuous event – another AI researcher quitting citing safety risks – landed into a very different environment and it caught like wildfire. The discussion of existential risk, mass extinction, and the trajectory of AI has traveled further than even the most seasoned AI commentariat would ever predict.

Ouvrir l’original · Paragraphe 4 (s’ouvre dans un nouvel onglet)Source du texte original (s’ouvre dans un nouvel onglet)
Nathan Lambert
Partager un aperçu

organizational safety practices

Voir ce sujet
organizational safety practices

Frontier AI labs underinvest in infrastructure hardening

Nathan Lambert argues that frontier AI labs have not hardened their infrastructure sufficiently against misuse. He describes delayed detection and response at OpenAI and attributes these risks to competitive pressure and operational overload.

Éléments favorables

Nathan Lambert·

One resignation turned the embers of AI fear into a wildfire

Extrait original

The biggest short-term risk could be from the AI labs not taking safety seriously enough – they haven’t hardened their own infrastructure, enabling AI misuse to proliferate.
Contexte

From my earlier post on the HuggingFace-OpenAI incident, Lessons from the hacks : Frontier labs do not seem like they’re watching the models closely enough, due to a general frenetic competitive environment & current SF culture From OpenAI’s own retrospective, the misaligned model behavior was unfolding over months, and in some cases OpenAI did not know about the hacks for ~weeks. The time to response is too long and I do not think this is an OpenAI only characteristic – rather it is that the frontier labs continually seem underwater in the amount of work they feel like they should do. I am not optimistic in the long-term that the labs change a sufficient amount here to meaningfully mitigate this type of oversight risk in the future. Yes, it is very likely that OpenAI is putting a ton into understanding this – and delayed their latest models to make sure they get it right – but the financial pressure to grow revenue or risk the companies’ long-term balance sheets makes me think it wil

Ouvrir l’original · Paragraphe 11 (s’ouvre dans un nouvel onglet)Source du texte original (s’ouvre dans un nouvel onglet)
Nathan Lambert
Partager un aperçu

Propos par date de source1

Les propos sont classés par date de publication de la source originale ; une différence de formulation ne prouve pas un changement de position.