Mercor | Multi-Domain | SF · Santa Clara | Thiel Fellowship, Harvard, Georgetown | Brendan Foody, Adarsh Hiremath, Surya Midha | 250+ | APEX |
Handshake | Multi-Domain | SF · NYC, Bangalore, Berlin | Palantir, Meta, Scale AI | Garrett LordRL/SFT Data Vendors: Paco Guzmán, Sahil Bhaiwala, Jack Bratches, Nishant Ranka, Yang Zhao | 250+ | Gandalf the Grader |
Scale | Multi-DomainCode | SF · NYC, DC, London | Stanford, Coinbase, YC | RL/SFT Data Vendors: Chetan Rane | 250+ | SWE-bench Pro |
Turing | Code | SF · Palo Alto, Gurugram | Stanford, Rover, Yahoo | Jonathan Siddharth, Vijay Krishnan | 250+ | VLMBench |
Surge | Multi-Domain | SF · NYC, Seattle | Google, Meta, Twitter | Edwin ChenRL/SFT Data Vendors: Nick Heiner | 101-250 | CoreCraft |
Snorkel | Multi-DomainCode | SF · Redwood City, NYC | Stanford, UW, Meta | Alex Ratner, Christopher Ré, Paroma Varma, Henry EhrenbergRL/SFT Data Vendors: Vincent Sunn Chen, Frederic Sala | 101-250 | Senior SWE-Bench |
micro1 | Multi-Domain | SF | Stanford, Berkeley | Ali Ansari | 101-250 | Realm |
AfterQuery | Multi-Domain | SF · NYC, Seattle | Wharton, Penn, UBC | Carlos Georgescu, Spencer Mateega | 51-100 | AppBench |
Latch | Science | SF | Berkeley, Google, Asimov | Alfredo Andere, Kenny Workman, Kyle Giffin | 51-100 | benchmarks.bio |
Mechanize | Code | SF | Epoch AI | Tamay Besiroglu, Ege Erdil, Matthew Barnett | 51-100 | GBA Eval |
Patronus AI | Multi-DomainCode | SF | Meta AI, Google, Amazon | Anand Kannappan, Rebecca Qian | 51-100 | FinanceBench, TRAIL |
Datacurve | Code | SF | Waterloo | Serena Ge, Charley Lee | 26-50 | DeepSWE |
Halluminate | FinanceEnterprise | SF | Capital One, Meta, Cornell | Jerry Wu, Wyatt Marshall | 26-50 | WebBench |
Pareto | Multi-DomainTool Use | SF | Stanford, Scale, Turing | Phoebe YaoRL/SFT Data Vendors: Mark Whiting, Youssef Elhady, Joe Crawley | 26-50 | Leap, Attune |
Proximal | Code | SF · Bangalore | Prime Intellect, Cursor | Justus Mattern, Navid Pour, Calvin Chen | 26-50 | FrontierSWE |
Aptura | FinanceEnterprise | London · SF | Lazard, McKinsey, EF | Chirag Modi | 11-25 | SpreadsheetBench 2 |
Bespoke Labs | Code | Mountain View · Menlo Park, Bangalore, SF | Google DeepMind, UC Berkeley | Mahesh Sathiamoorthy, Alex Dimakis | 11-25 | OpenThoughts |
Collinear | EnterpriseLong Horizon | Mountain View · Sunnyvale | Hugging Face, Salesforce, Stanford | Nazneen Rajani, Soumyadeep Bakshi | 11-25 | Curator Evals |
Quesma | Security | Warsaw | Elastic, Sumo Logic, Dynatrace | Jacek Migdal | 11-25 | BinaryAudit |
ReasonCore | ScienceCode | SF | Turing, Aera Technology, Oracle | Geoff Wolfe, Anshuman Lall, Satish Vutukuru | 11-25 | Benchmarks |
Abundant | Code | SF | Waymo, Google, Mercor | Jesse Hu, Ke Huang, Meji Abidoye | 1-10 | SWE-Marathon |
BenchFlow | EnterpriseBrowser | SF | Terminal, Red Hat | Xiangyi Li | 1-10 | SkillsBench |
Cua | CodeComputer Use | SF | Microsoft, Twitter | Francesco Bonacci, Dillon DuPont | 1-10 | Cua-Bench |
EdotEnv | Long HorizonML | SF | G-Research, Etched, ETH Zurich | Rui Wang, Michael Zhang | 1-10 | Long-Horizon Planning |
Emulated | CodeML | SF | AWS, DeepMind, Prime Intellect | Joseph Wang, Sid Patllollu | 1-10 | SDAB |
General Reasoning | Finance | London · SF | Meta, Conjecture, Aleph Alpha | Ross Taylor, Chengxi Taylor, Kip Parker, Thomas Grady | 1-10 | OpenReward |
Markov | Computer UseTool Use | SF | YC, IIT Madras | Dev Mandal, Harish Ashok | 1-10 | CUA data, AutoCAD-Bench |
Metaphi | CodeEnterprise | SF · NYC | Waymo, Nuro, Netflix | Abhishek Chandwani, Ishan Gupta | 1-10 | CREW |
pre.dev | CodeLong Horizon | Delaware | Penn M&T, Wharton | Arjun Raj Jain, Adam Elkassas | 1-10 | TB2 results |
Tacit Labs | ScienceLong Horizon | SF | MosaicML, MSR, EF | Nicole Fitzgerald, Anne Marie Droste | 1-10 | LifeSciBench |
Ulam | Math | Warsaw · London | Oxford | Przemek Chojecki | 1-10 | RLVR Trajectories |
Vmax | ML | SF · NYC | UCL | Matthew Sargent, Augustine Mavor-Parker | 1-10 | unix-ctf |
Fleet | Multi-DomainEnterprise | SF · NYC | Mercor, Anthropic, MSL | Nicolai Ouporov, Andrew Zhou | 51-100 | |
DeeptuneAcquired | CodeComputer Use | NYC | Hebbia | Tim Lupo | 26-50 | |
Huzzle Labs | Long HorizonCode | London · Berlin, SF | Turing | Ingmar Klein, Amit Choudhary | 26-50 | |
Taste Labs | Design | NYC | Exa, Palantir, Mercado Libre | Thais Castello Branco | 26-50 | |
Verita AI | Design | SF · Vancouver | HRT, Jane Street, Mercor | Rithika Kacham, Rishi Kalakuntla | 26-50 | |
ARIMLABS | SecurityLong Horizon | Warsaw | Akamai | Mykyta Mudryi, Markiian Chaklosh | 11-25 | |
Chakra Labs | Computer UseTool Use | Brooklyn | Microsoft, L/S, Snap | Nirmal Krishnan, Alex Fung | 11-25 | |
dmodel | MLAlignment | SF | OpenAI, Google Brain, EleutherAI | Anish Tondwalkar, Daniel Moon | 11-25 | |
HUD | Long HorizonCode | SF · Singapore | METR, AWS, Hume | Lorenss Martinsons, Jay Ram | 11-25 | |
Idler | Code | SF | Meta, Microsoft, Cornell | Ivan Chub, Nalu Concepcion, Tony Goss | 11-25 | |
Incalmo | Security | San Mateo | CMU, MSR, RSAC Labs | Brian Singer, Mark DongRL/SFT Data Vendors: Omer Akgul, Ao Li | 11-25 | |
Preference Model | MLCode | SF · Toronto, Seattle | Anthropic, Stripe, Datology | Jennifer Zhou, Ning Cao | 11-25 | |
Akhara | EnterpriseCode | SF | Meta, MIT, Cornell | Spandana Govindgari, Navi Singh, Girish Kumar | 1-10 | |
Andromede | Long Horizon | Lausanne | MIT, EPFL | Alexandre Sallinen, Guillaume Allegre | 1-10 | |
Anthromind | MedicalLong Horizon | SF | Google, Forward Health | Pratik Karki, Mannat Sandhu | 1-10 | |
Diffuse Labs | MLLong Horizon | Palo Alto · SF | a16z, CMU | Daljeet Virdi, Tejpal Singh | 1-10 | |
Dissei | Finance | London | Warwick, Goldman Sachs, HBS | Tudor Popescu, Jai Trivedi, Eddy B | 1-10 | |
Exabite | Code | Remote | Stanford, MIT, Magic | Alana Xiang | 1-10 | |
Good Start Labs | GamesLong Horizon | Brooklyn · NYC, Toronto | Waterloo, Every, Amazon Robotics | Alex Duffy, Tyler Marques | 1-10 | |
Hillclimb | Math | SF | DeepMind, Base | Jun Park, Ibrakhim Ustelbay | 1-10 | |
Normal | Hardware Engineering | SF | Cohere, Notion, Fuse | Hudzah, Anson Yu | 1-10 | |
Originator | Computer UseCode | London · Paris | Google, Dataform, Pareto Holdings | Ben Cambier, Lewis Hemens | 1-10 | |
Phinity | Chip Design | SF · Palo Alto | NVIDIA, AWS, Stanford | Sonya Jin, Aadi Nashikkar | 1-10 | |
Plato | BrowserEnterprise | SF | MultiOn, Waterloo, Georgia Tech | Rob Farlow, Pranav Putta | 1-10 | |
Refresh | CodeComputer Use | SF | Uber, Amazon | Christopher Settles, Erik Quintanilla | 1-10 | |
| Sepal AIAcquired | Science | SF | Turing, Bain, McKinsey | Robi Lin, Kat Hu | 1-10 | |
Theta | Enterprise | SF | DeepSilicon, Cornell, MultiOn | Rayan Garg, Tanmay Sharma, Gurvir Singh | 1-10 | |
Trajectory Labs | Alignment | Berkeley · Toronto | METR, GovAI, 80000 Hours | Peter McIntyre, Ben West | 1-10 | |
Vetto AI | CodeComputer Use | SF · São Paulo, London | DeepMind, Meta, ITA | José André Nunes, Rodrigo Schmidt, Lucas Smaira, Gabriel Albuquerque, Roberta Antunes | 1-10 | |