Mistral 7B & Mixtral ☆

Mistral 7B (September 2023) beat much larger models at a fraction of the cost; Mixtral 8x7B (December 2023) was the first widely used open mixture-of-experts, prefiguring the architecture DeepSeek and Qwen scaled up. Together they made 'small but smart' a strategy and put Europe on the map.