shared learnings

Research & Blog

Plot Twist Bench Do frontier models actually understand video? Plot Twist Bench is a video perception benchmark of 48 curated multiple-choice questions, made by Vetto. ProgramBench Vetted Reverse engineering from a runnable binary, rebuilt with explicit verification controls GulliBench GulliBench: Intelligence Isn't Enough. Measuring Skepticism in Frontier Models. Terminal Tasks v1.0 Introducing Computer Anthology
coming soon

We'll soon release notes and learnings here. Stay tuned.