Grok 3 mini Reasoning (high) vs Mistral Large 2 (Nov '24)

Intelligence Index

MMLU-Pro

GPQA

AIME

Which is cheaper, Grok 3 mini Reasoning (high) or Mistral Large 2 (Nov '24)?

Grok 3 mini Reasoning (high) is cheaper on list price. Grok 3 mini Reasoning (high) costs $0.3/M input and $0.5/M output tokens. Mistral Large 2 (Nov '24) costs $2.0/M input and $6.0/M output tokens. On combined list price, Grok 3 mini Reasoning (high) is 10.0x cheaper than Mistral Large 2 (Nov '24). However, list prices alone can be misleading because different models use different numbers of tokens for the same task. Check the effective cost comparison above, which adjusts for token efficiency using benchmark data.

Which scores higher on benchmarks, Grok 3 mini Reasoning (high) or Mistral Large 2 (Nov '24)?

Grok 3 mini Reasoning (high) has a higher Intelligence Index (32.0) compared to Mistral Large 2 (Nov '24) (15.1). The Intelligence Index is a composite score from three industry-standard benchmarks: MMLU-Pro (general knowledge and reasoning), GPQA (graduate-level science), and AIME (mathematical problem solving). A higher score means the model produces more accurate and capable responses across a broad range of tasks. This composite approach is more reliable than any single benchmark because it measures different types of capability.

Which model is better value for money, Grok 3 mini Reasoning (high) or Mistral Large 2 (Nov '24)?

Mistral Large 2 (Nov '24) offers better value at $0.10 per intelligence point compared to Grok 3 mini Reasoning (high) at $0.58 per intelligence point. Cost per intelligence point measures how much you pay for each unit of benchmark performance, calculated as the combined token cost divided by the Intelligence Index score. When token efficiency data is available, this calculation uses effective prices (adjusted for the fact that different models consume different numbers of tokens for the same task) rather than raw list prices. A lower cost per intelligence point means you get more capability per dollar.

Which has a larger context window, Grok 3 mini Reasoning (high) or Mistral Large 2 (Nov '24)?

Grok 3 mini Reasoning (high) supports 2,000,000 tokens compared to Mistral Large 2 (Nov '24) with 128,000 tokens. The context window determines how much text (including your prompt, conversation history, and documents) the model can process in a single request. A larger context window is important for tasks like document summarization, long-form analysis, and multi-turn conversations with extensive history. If your use case involves processing large inputs, the context window may be a deciding factor.