# SecureBERT

SecureBERT: A Domain-Specific Language Model for Cybersecurity

- **Kind:** model (Hugging Face)
- **Hugging Face:** https://huggingface.co/ehsanaghaei/SecureBERT
- **Owner:** ehsanaghaei (https://forefy.com/u/hf/ehsanaghaei)
- **Context:** 514 tokens
- **License:** bigscience-openrail-m
- **Focus:** cti
- **Architecture:** RobertaForMaskedLM
- **Pinned revision:** `3a47918dd874e5c769efd152b51c5756a953fb67`
- **Page:** https://forefy.com/models/3db6ef34-0ed7-56a4-8fc6-03cd37ef2d2d
- **API (JSON):** https://forefy.com/api/asr/models/3db6ef34-0ed7-56a4-8fc6-03cd37ef2d2d

## What was done to it

- finetune (declared evidence, from FacebookAI/roberta-base)

## Lineage

FacebookAI/roberta-base → ehsanaghaei/SecureBERT

## Checks (repo at the pinned revision; not a behavior test)

- **Identity** [pass]: No lookalike name or conflicting provenance
- **Weights format** [warn]: Pickle weights only: loading them unpickles
- **Pickle files** [warn]: Imports outside the tensor-rebuild allowlist in training_args.bin.
- **Remote code** [pass]: None
- **Chat template** [info]: None shipped
- **Refusals modified** [pass]: No
- **License** [pass]: bigscience-openrail-m
- **Lineage** [pass]: Derives from FacebookAI/roberta-base
- **Model card** [warn]: 4 of 6, missing evaluation results, description

## Variants

- PyTorch (pickle) (pickle, 1.5 GB)

## Run it

- transformers: `AutoModelForCausalLM.from_pretrained("ehsanaghaei/SecureBERT", revision="3a47918dd874e5c769efd152b51c5756a953fb67")`