# Hy4-flash

Hy4 flash is our most cost-effective Hy model to date, featuring 220B total parameters (including 64B Engram parameters) with just 12B active parameters per token. It natively accepts text and image inputs, generates text, and supports a context window of up to 1M tokens.

- **Kind:** model (Hugging Face)
- **Hugging Face:** https://huggingface.co/tencent/Hy4-flash
- **Owner:** tencent (https://forefy.com/u/hf/tencent)
- **Parameters:** 220.3B
- **Context:** 1048576 tokens
- **License:** other
- **Focus:** general
- **Architecture:** HYV4FlashForConditionalGeneration
- **Pinned revision:** `d88c9dfd96ba4f2e6b92adba0b8e8f1c8696f959`
- **Page:** https://forefy.com/models/8dc713ff-e130-5273-9eb9-545973e245de
- **API (JSON):** https://forefy.com/api/asr/models/8dc713ff-e130-5273-9eb9-545973e245de

## Checks (repo at the pinned revision; not a behavior test)

- **Identity** [pass]: No lookalike name or conflicting provenance
- **Weights format** [pass]: safetensors only, nothing runs on load
- **Pickle files** [pass]: None.
- **Remote code** [info]: 5 Python file(s), not loaded automatically
- **Chat template** [info]: No parent template to compare
- **Refusals modified** [pass]: No
- **License** [pass]: other
- **Lineage** [info]: No base model declared
- **Model card** [warn]: 2 of 6, missing training data, language, evaluation results, intended use and limitations
- **Safetensors headers** [pass]: Every byte is indexed, no hidden data (8 of 148 files read)

## Variants

- mixed safetensors (safetensors, 440.5 GB)

## Run it

- transformers: `AutoModelForCausalLM.from_pretrained("tencent/Hy4-flash", revision="d88c9dfd96ba4f2e6b92adba0b8e8f1c8696f959")`
