Module olmo 

OLMo (Open Language Model) implementation

See OLMo model details at:

• Hugging Face
• OLMo Paper

The model uses:

• RoPE embeddings
• Sliding window attention
• Transformer architecture

References:

• Hugging Face Implementation
• OLMo Paper

Structs

Config

Model