Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Anyone else confused by inconsistency in performance numbers between this announcement and the concurrent system card? https://cdn.openai.com/o3-mini-system-card.pdf

For example-

GPQA diamond system card: o1-preview 0.68

GPQA diamond PR release: o1-preview 0.78

Also, how should we interpret the 3 different shading colors in the barplots (white, dotted, heavy dotted on top of white)...



Actually sounds like benchslop to me.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: