Supported Models

20+ models across 9 providers. Click any model to see what it's capable of.

Understanding These Numbers

SWE-Bench

Tests whether the model can solve real bugs from GitHub repositories — reading code, understanding the issue, and writing a working fix.

Higher score = Better at fixing real-world code problems autonomously

HumanEval

Given a function description, can the model write correct code that passes all test cases? Measures raw coding ability.

Higher score = More reliable at writing correct code from descriptions

MMLU

A massive exam covering 57 subjects — science, history, law, medicine, maths. Tests general knowledge and reasoning breadth.

Higher score = Broader general knowledge across many domains

MATH

Competition-level maths problems — algebra, calculus, geometry, number theory. Tests deep mathematical reasoning.

Higher score = Stronger at solving complex mathematical problems

GPQA

Graduate-level science questions written by PhD researchers. Even experts struggle with these — tests frontier reasoning.

Higher score = Better at expert-level scientific reasoning

Tool Use

Can the model correctly call functions, pass the right arguments, and chain multiple tools together? Critical for an AI agent.

Higher score = More reliable at using tools like file editing, search, and git

Vision

Can the model understand images — screenshots, diagrams, charts, photos? Tests visual comprehension and reasoning.

Higher score = Better at understanding what it sees on screen

How to Access These Models

Platform

Available through your Ava account. Free tier gets 3M tokens/month on Qwen models. Paid plans unlock more tokens and additional models. No API key needed.

BYOK

Bring Your Own Key. Get an API key directly from the provider, paste it into Ava's settings, and pay the provider directly. No account needed. Runs 100% locally.

Platform+BYOK

Available both ways. Use your Ava account for convenience, or bring your own key for direct access and maximum savings.

IDE OnlyHolo3 models, Computer Use (desktop automation), and screenshot tools are available exclusively in the Desktop IDE. These features are not available in the VS Code extension due to marketplace policy restrictions.