v2.2 · 2026-06-12
StarCoder2 3B
starcoder2-3b
StarCoder2 3B is a 3B code model profile for local AI planning. This page records provider, license, context, quantization, hardware-fit estimates, setup hints, source links, and caveats so readers do not choose a model by name alone.
PROVIDER
BigCode / ServiceNow
FAMILY
StarCoder2
MODEL TYPE
code
PARAMETERS
3B
MODALITIES
text
ARCHITECTURE
Transformer decoder with grouped-query attention, sliding-window attention, and Fill-in-the-Middle objective
CONTEXT WINDOW
16,384 tokens
TRAINING TOKENS
3.0T
RELEASE DATE
2024-02-28
GGUF REPOSITORIES
second-state/StarCoder2-3B-GGUF community conversion
Community GGUF conversion/quantization; file table used for Q4_K_M, Q5_K_M, and Q8_0 sizes.
SETUP HINTS
OLLAMA
Use `ollama run starcoder2:3b` for local completion-style use.LM STUDIO
Search for `second-state/StarCoder2-3B-GGUF` and choose Q4_K_M for the first local run.
LLAMA.CPP
Use `llama-cli -hf second-state/StarCoder2-3B-GGUF:Q4_K_M -p '<code prefix>'`QUANTIZATION FILE SIZES (GGUF)
Q4_K_M
1.85 GB
Q5_K_M
2.16 GB
Q8_0
3.22 GB
Quantization note: Q4_K_M
RAM / VRAM ESTIMATES
MIN RAM
4 GB
COMFORTABLE RAM
8 GB
MIN VRAM
3 GB
COMFORTABLE VRAM
6 GB
These are conservative local-inference estimates, not official hardware requirements.
HARDWARE FIT
CPU only (no GPU)
good
8 GB RAM
good
16 GB RAM
good
32 GB RAM
good
8 GB VRAM
good
12 GB VRAM
good
24 GB VRAM
good
Apple Silicon (unified memory)
good
Hardware fit values are conservative local-inference estimates based on GGUF size plus runtime and KV-cache overhead. Actual requirements depend on context length, quantization, runtime, GPU offload, and other running apps.
BEST FOR
·Local code completion and fill-in-the-middle workflows
AVOID IF
·You need an instruction/chat model; the official model card says the base model is not an instruction model.
CAVEATS
·The official StarCoder2 base checkpoints are code-focused but not instruction-tuned; use a separate instruct checkpoint only if your catalog adds it as a separate model.
·RAM and VRAM estimates are conservative estimates from GGUF file sizes plus local runtime and KV-cache overhead.
SOURCE URLS
FIELD EVIDENCE
parameterSizeBhuggingface.co/bigcode/starcoder2-3b
contextWindowTokenshuggingface.co/bigcode/starcoder2-3b
trainingTokenshuggingface.co/bigcode/starcoder2-3b
languageshuggingface.co/bigcode/starcoder2-3b
codeTunedhuggingface.co/bigcode/starcoder2-3b
q4FileSizeGbhuggingface.co/second-state/StarCoder2-3B-GGUF
q5FileSizeGbhuggingface.co/second-state/StarCoder2-3B-GGUF
q8FileSizeGbhuggingface.co/second-state/StarCoder2-3B-GGUF
LANGUAGES
17 programming languages
CAPABILITIES
code tuned