Mixtral 8x22B Original release weights
officialApache-2.0
5f96d43576e3d386c9ba65b883210a393b68210e
xAI's 314-billion-parameter mixture-of-experts model, open-released in March 2024 under Apache-2.0 with the magnet link published in the official GitHub README. ~25% of weights are active per token. This is the raw JAX checkpoint (int8-quantized); you'll want the repository code to load it.
One of the largest open-weight releases ever made, distributed by its creator via BitTorrent from day one.
Swarm verified via DHT metadata fetch on 2026-07-23; size and file count are taken from the torrent metadata itself.