# Foundation-Sec-8B-Instruct-GGUF

static quants of https://huggingface.co/fdtn-ai/Foundation-Sec-8B-Instruct

- **Kind:** model (Hugging Face)
- **Hugging Face:** https://huggingface.co/mradermacher/Foundation-Sec-8B-Instruct-GGUF
- **Owner:** mradermacher (https://forefy.com/u/hf/mradermacher)
- **Parameters:** 8.0B
- **Context:** 131072 tokens
- **License:** other
- **Focus:** defensive
- **Architecture:** LlamaForCausalLM
- **Pinned revision:** `5ffb5ce8b3274709f82cf141f84c628b4e038986`
- **Page:** https://forefy.com/models/8e714cdc-9474-5597-84d1-0df7327d1fe6
- **API (JSON):** https://forefy.com/api/asr/models/8e714cdc-9474-5597-84d1-0df7327d1fe6

## What was done to it

- quantized (declared evidence, from fdtn-ai/Foundation-Sec-8B-Instruct)

## Lineage

meta-llama/Llama-3.1-8B → fdtn-ai/Foundation-Sec-8B → fdtn-ai/Foundation-Sec-8B-Instruct → mradermacher/Foundation-Sec-8B-Instruct-GGUF

## Checks (repo at the pinned revision; not a behavior test)

- **Identity** [pass]: No lookalike name or conflicting provenance
- **Weights format** [pass]: GGUF only, nothing runs on load
- **Pickle files** [pass]: None.
- **Remote code** [pass]: None
- **Chat template** [pass]: Same as fdtn-ai/Foundation-Sec-8B-Instruct's
- **Refusals modified** [pass]: No
- **License** [warn]: Declares other, but derives from a llama3.1 model whose terms carry over
- **Lineage** [pass]: Derives from fdtn-ai/Foundation-Sec-8B-Instruct
- **Model card** [warn]: 2 of 6, missing training data, evaluation results, intended use and limitations, description
- **GGUF headers** [pass]: 2 file(s) parsed, well-formed

## Variants

- F16 (gguf, 16.1 GB)
- Q8_0 (gguf, 8.5 GB)
- Q6_K (gguf, 6.6 GB)
- Q5_K_M (gguf, 5.7 GB)
- Q5_K_S (gguf, 5.6 GB)
- Q4_K_M (gguf, 4.9 GB)
- Q4_K_S (gguf, 4.7 GB)
- IQ4_XS (gguf, 4.5 GB)
- Q3_K_L (gguf, 4.3 GB)
- Q3_K_M (gguf, 4.0 GB)
- Q3_K_S (gguf, 3.7 GB)
- Q2_K (gguf, 3.2 GB)

## Run it

- GGUF: `ollama run hf.co/mradermacher/Foundation-Sec-8B-Instruct-GGUF:Q2_K`