Skip to main content

Model

Llama 4 Scout

Start with a supported compressed build and short context. 128GB RAM estimate. Best use: Long documents, image questions, and advanced local experiments on H100-class or high-memory workstation hardware setups.

109B total / 17B activeMultimodal

Best use

Long documents, image questions, and advanced local experiments on H100-class or high-memory workstation hardware setups.

Memory planning

128GB RAM estimate

Expected pace

Depends on your hardware, app, and conversation length

License

Llama 4 Community License; read the model’s terms before use

Who should use this model?

  • Long documents, image questions, and advanced local experiments on H100-class or high-memory workstation hardware setups.

Choose something else when

  • Avoid for ordinary laptops, low-RAM PCs, EU users, or anyone needing easy setup today locally.

What hardware makes sense?

The download is only part of the memory needed. Leave room for the app, the input it processes, and other open programs. For chat models, context includes the instructions, conversation, and answer. Longer context needs more memory.

CPU only
Use a smaller model for this memory limit.
8GB system memory
Use a smaller model for this memory limit.
16GB system memory
Use a smaller model for this memory limit.
32GB system memory
Use a smaller model for this memory limit.
8GB GPU memory
Use a smaller model for this memory limit.
12GB GPU memory
Use a smaller model for this memory limit.
24GB GPU memory
Use a smaller model for this memory limit.
Apple unified memory
Use a smaller model for this memory limit.

Model facts that change the decision

Parameters
109B total / 17B active
Input
Multilingual text input · Image input · Text output · Code output
Published context limit
10,000,000 tokens
Model format
safetensors · GGUF · Ollama · MLX
Suggested compression
Q4_K_M for first local attempts unless a cited runtime recommends a different default.
Typical Q4 file
67.5GB before runtime and context overhead
Languages
Unknown

Using image input

This model needs an app or library that supports its image-processing components. Follow the exact model’s instructions for preparing image inputs. Some GGUF downloads also need a matching projector file; loading the text model alone does not establish image support.

First setup

Ollama

ollama run llama4:scout

LM Studio: Check that your installed app supports the exact model format and task before downloading it.

llama.cpp

Use the cited GGUF repository (lmstudio-community/Llama-4-Scout-17B-16E-Instruct-GGUF) with current llama.cpp-compatible tooling.

Conditions that change the answer

  • The 10M-token context is an official maximum, but Meta says context lengths were evaluated across 512 GPUs.
  • MoE lowers active compute but not stored-weight memory; the full 109B parameters still matter for RAM/VRAM.
  • Official Scout release is BF16; on-the-fly INT4 can fit an H100, but beginner local users will usually need community GGUF/MLX quants.
  • LM Studio Scout GGUF page notes text-only support for now, despite the official model being multimodal.
  • Llama 4 uses a custom Meta license, not Apache 2.0.
  • Commercial use: Permitted for commercial and research use subject to Meta's custom Llama 4 Community License, Acceptable Use Policy, attribution requirements, 700M MAU threshold, and EU multimodal restriction.
  • Llama 4 Scout is a huge, open-weight multimodal MoE model for long documents and image understanding. It is technically local only on serious hardware, with tiny quants trading quality for fit, especially at full context.

Read the controlling license text →