That seems like entirely reasonable variance to me for AI models. For my purpose... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

nerdsniper 52 days ago | parent | context | favorite | on: Claude Opus 5

That seems like entirely reasonable variance to me for AI models. For my purposes, that absolutely counts as a solid "replication". I'd probably accept +/- 5 percentage points even.

tadfisher 52 days ago [–]

D'oh, they are running the benchmark themselves. Reasonable.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact