Has senior engineers and vetted specialists hand-write custom datasets, reasoning traces and expert evals pitched at the limits of frontier models.
Not yet verified. Know a source? Corrections welcome.
Similar vendors
Builds RL environments and datasets for AI labs.
AfterQueryRecords how working professionals reason through real tasks and packages it as training data for frontier model developers.
AnthromindHuman evaluation, RLHF preference data and post-training datasets with a scalable-oversight focus.
AppenPublicly listed veteran of the data industry offering training data, annotation and model evaluation with a large global crowd.
Arena (LMArena)Crowd-voted public leaderboard for language, image and code models, with commercial evaluation services.
Bespoke LabsData-curation research shop that builds environments and optimizes agents for enterprises and labs.