{"id":79343,"date":"2026-06-19T10:20:13","date_gmt":"2026-06-19T10:20:13","guid":{"rendered":"https:\/\/www.europesays.com\/ai\/79343\/"},"modified":"2026-06-19T10:20:13","modified_gmt":"2026-06-19T10:20:13","slug":"openai-researchers-show-small-doses-of-beneficial-trait-training-make-ai-models-broadly-safer-and-harder-to-manipulate","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/ai\/79343\/","title":{"rendered":"OpenAI researchers show small doses of “beneficial trait” training make AI models broadly safer and harder to manipulate"},"content":{"rendered":"

According to a blog post on OpenAI’s alignment page<\/a>, the answer is yes. The research team trained a model using reinforcement learning on realistic conversations designed to test specific desired traits: truthfulness, epistemic humility, corrigibility, transparency in reasoning, fairness, and concern for human well-being. The scenarios covered domains like healthcare, education, science, law, and engineering.<\/p>\n

Good behavior transfers to unfamiliar domains<\/p>\n

Only a small share of this “beneficial trait” data was mixed into the regular RL post-training pipeline. Still, the model improved on 44 out of 53 independent benchmarks measuring deception, honesty, sycophancy, reward hacking, and health and mental health scenarios, according to the paper<\/a>.<\/p>\n

Training on health data alone also improved non-health evaluations like reward hacking and deception detection. The reverse held true, too: training without any health or science data still boosted performance on health benchmarks. The researchers conclude that RL training reinforces basic behavioral patterns that work across domains.<\/p>\n

Models become resistant to harmful steering<\/p>\n

The team also tested whether the improvements hold up under pressure. Adversarial prompts that badly destabilized the baseline model had far less effect on the beneficial-trait model. Harmful fine-tuning was also less able to erode the trained traits.<\/p>\n

The model stayed just as steerable for helpful instructions as before. The researchers call this “selective persistence” – the model resists harmful steering without losing useful flexibility.<\/p>\n

A different path than Anthropic<\/p>\n

OpenAI’s method differs sharply from Anthropic’s alignment approach. First, OpenAI relies on empirically measurable behavioral traits reinforced through RL in realistic scenarios. Anthropic, by contrast, works with an explicit “Claude constitution<\/a>,” a written values document that serves as the top-level guide for training and behavior.<\/p>\n

Second, OpenAI leans heavily on benchmarks: 44 out of 53 evaluations show improvements that generalize across domains and evaluation methods. Anthropic takes a more principles-based approach where the model is supposed to understand why certain behaviors are desired, grounded in constitutional texts and high-quality training examples<\/a>. The company says this makes its models more resistant to attacks. A direct comparison of the two approaches doesn’t exist yet.<\/p>\n","protected":false},"excerpt":{"rendered":"According to a blog post on OpenAI’s alignment page, the answer is yes. The research team trained a…\n","protected":false},"author":2,"featured_media":19796,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[17955,53,157],"class_list":["post-79343","post","type-post","status-publish","format-standard","has-post-thumbnail","category-openai","tag-alignment","tag-anthropic","tag-openai"],"_links":{"self":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/79343","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/comments?post=79343"}],"version-history":[{"count":0,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/posts\/79343\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media\/19796"}],"wp:attachment":[{"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/media?parent=79343"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/categories?post=79343"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.europesays.com\/ai\/wp-json\/wp\/v2\/tags?post=79343"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}