Zum Inhalt springen

Arena AI Release Notes

56 Einträge aus 1 Quelle. Zuletzt aktualisiert:

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Neue Modelle in Bild-, Text-, Vision- und Agent Arena hinzugefügt

grok-imagine-image-2.0 (canvas) kam zu Text-to-Image und Image Edit, claude-sonnet-5.5-xhigh zu Text Arena und Vision Arena sowie Claude Sonnet 5.5 (Max) und GPT 6.1 Sol (Max) zur Agent Arena hinzu.

grok-imagine-image-2.0 (canvas) has been added to the Text-to-Image & Image Edit leaderboard.

claude-sonnet-5.5-xhigh has been added to the Text Arena & Vision Arena leaderboard.

Claude Sonnet 5.5 (Max) has been added to the Agent Arena leaderboard.

GPT 6.1 Sol (Max) has been added to the Agent Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Neue Steerability-Berechnung und ideogram-4.5 im Image-Edit-Leaderboard

Die Berechnung des Steerability-Scores im Agent Arena Signal-Leaderboard wurde geändert, sodass nun jeder beurteilbare Assistenten-Turn zählt und fehlerfreie Antworten beim ersten Versuch honoriert werden, außerdem wurde ideogram-4.5 zum Image-Edit-Leaderboard hinzugefügt.

We’ve updated how the Steerability score is calculated on the Agent Arena signal leaderboard. Previously, it only measured whether a model fixed a mistake right after being corrected by a user. This meant that the signal rewarded corrected turns, but it didn’t reward a model for needing fewer corrections in the first place. That made the signal not as accurate as it could be: a model that made more mistakes had more chances to "pass," while a model that got things right the first time earned no credit.

The newest frontier models require corrections less often than other models, but the old score didn’t capture that advantage. The updated methodology now evaluates every assistant turn in a conversation we can judge, so getting things right the first time counts. It also continues to weigh repeated corrections more heavily than one-off corrections that are resolved immediately.

We're sharing this update because we want the community and our customers to understand exactly how and why it's changing, not just see scores move. Backfilled scores under the new methodology will be available in our public HuggingFace datasets soon. Full technical breakdown of the new definition is available on the signal definitions page.

ideogram-4.5 has been added to the Image Edit leaderboard. …

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Neue Modelle in Code Arena, Agent Arena und Text Arena hinzugefügt

step-5-preview-high kam zur Code Arena: WebDev, GPT 6 Sol (Max) zur Agent Arena sowie deepseek-v4.1-flash-max, grok-4.7-xhigh, gpt-6-sol-max, gpt-6-luna-max und claude-opus-5.5-high zur Text Arena hinzu.

step-5-preview-high has been added to the Code Arena: WebDev leaderboard.

GPT 6 Sol (Max) has been added to the Agent Arena leaderboard.

deepseek-v4.1-flash-max, grok-4.7-xhigh, gpt-6-sol-max, gpt-6-luna-max, and claude-opus-5.5-high has been added to the Text Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Neu gestaltete Leaderboard-Übersicht und neue Modelle

Die Leaderboard-Übersichtsseite wurde komplett neu gestaltet und bündelt nun alle Live-Signale, zudem kamen recraft-v4.1-flash, gpt-6-luna-max und Grok 4.7 (xHigh) zu verschiedenen Leaderboards hinzu.

Released a fully redesigned leaderboard overview page. This new hub provides insights on model performance across categories, bringing all our live signals into one place for researchers, builders, and our global community of users who power our model evaluations.

recraft-v4.1-flash has been added to the Text-to-Image Arena leaderboard.

gpt-6-luna-max has been added to the Code Arena: WebDev leaderboard.

Grok 4.7 (xHigh) has been added to the Agent Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

qwen-image-2.1 und grok-4.7-xhigh zu Leaderboards hinzugefügt

qwen-image-2.1 kam zu Text-to-Image Arena und Image Edit Arena sowie grok-4.7-xhigh zur Code Arena: WebDev hinzu.

qwen-image-2.1 has been added to the Text-to-Image Arena and the Image Edit Arena leaderboard.

grok-4.7-xhigh has been added to the Code Arena: WebDev leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Muse Spark 1.3 (Max) und weitere Modelle in mehreren Arenen

Muse Spark 1.3 (Max), gpt-6-astra-max, claude-fable-5.1-max und glm-5.3-flash wurden zu Image-to-WebDev, Document, Vision Arena und teils Text Arena hinzugefügt.

Muse Spark 1.3 (Max), gpt-6-astra-max, claude-fable-5.1-max, and glm-5.3-flash have been added to the Image-to-WebDev Arena leaderboard.

Muse Spark 1.3 (Max), gpt-6-astra-max and claude-fable-5.1-max have been added to the Document & Vision Arena leaderboards.

Muse Spark 1.3 (Max) has been added to the Text Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

GPT 6 Astra (Max), gpt-image-2.5 und muse-spark-1.3-max neu dabei

GPT 6 Astra (Max) kam zur Agent Arena, gpt-image-2.5-sunburst und -flare zu den Bild-Leaderboards sowie muse-spark-1.3-max zur Code Arena: WebDev hinzu.

GPT 6 Astra (Max) has been added to the Agent Arena leaderboard.

gpt-image-2.5-sunburst & gpt-image-2.5-flare has been added to the Text-to-Image Arena, Image Edit Arena and Multi Image Edit leaderboards.

muse-spark-1.3-max has been added to the Code Arena: WebDev leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

gpt-6-astra-max, Claude Fable 5.1 (Max) und Grok Imagine Video neu

gpt-6-astra-max kam zur Code Arena: WebDev, Claude Fable 5.1 (Max) zur Agent Arena und grok-imagine-video-1.5-agent zur Text-to-Video Arena hinzu.

gpt-6-astra-max has been added to the Code Arena: WebDev leaderboard.

Claude Fable 5.1 (Max) has been added to the Agent Arena leaverboard.

grok-imagine-video-1.5-agent has been added to the Text-to-Video Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden

Angaben zum Datum

Datum aus der Quelle.

Erstmals gesehen am .

Leaderboard von Arena AI

Gemini 3.8 Flash, Claude Fable 5.1, wan3.0 und Hy4 preview neu

Gemini 3.8 Flash (High), claude-fable-5.1-max, wan3.0 und Hy4 preview wurden zu mehreren Leaderboards wie Agent Arena, Code Arena: WebDev, Text Arena und Image-to-Video Arena hinzugefügt.

Gemini 3.8 Flash (High) has been added to the Agent Arena, Code Arena:WebDev and Text Arena leaderboards.

claude-fable-5.1-max has been added to the Code Arena: WebDev and Text Arena leaderboards.

wan3.0 has been added to the Image-to-Video Arena leaderboard.

Hy4 preview has been added to the Agent Arena leaderboard.

Originalquelle(öffnet in neuem Tab)Problem melden