Module quantized_stable_lm 

Module for quantized StableLM implementation.

StableLM is a series of open-source large language models optimized for performance and stability. This implementation provides quantization support for efficient model deployment.

Key characteristics:

• RMSNorm for layer normalization
• Rotary positional embeddings (RoPE)
• Support for 8-bit quantization

References:

• StableLM

Re-exports

pub use crate::quantized_var_builder::VarBuilder;

pub use crate::models::stable_lm::Config;

Structs

Model