Expand description
ModernBERT
ModernBERT is a modernized bidirectional encoder-only Transformer model.
- Arxiv “Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference”
- Upstream Github repo.
- See modernbert in candle-examples for runnable code
Structs§
- Classifier
Config - Config
- Modern
Bert - Modern
Bert Classifier - Modern
Bert Decoder - Modern
Bert ForMaskedLM - Modern
Bert ForSequence Classification - Modern
Bert Head - Modern
Bert Layer - Modern
BertMLP