Module granite

Module granite 

Source
Expand description

Granite is a Long Context Transformer Language Model.

A high performance transformer model optimized for efficient processing of very long context sequences

Based on implementation from Nod.ai

Structs§

Cache
Config
Granite
GraniteConfig
GraniteRopeConfig

Enums§

GraniteEosToks
GraniteRopeType

Constants§

DEFAULT_MAX_SEQ_LEN