Evaluations & benchmarks
Evaluation reports. The evaluation type is always explicit so a result is never mistaken for a public leaderboard. Metric definitions, versions, sample sizes and limitations accompany every result.
- Status: Internal evaluationEvaluation type: Private evaluationLocal vs Hosted Inference on the Local Inference Task Suite
A small internal comparison of local and hosted inference across summarisation, extraction and classification tasks on fixed hardware.