Enum PositionEmbeddingType 

pub enum PositionEmbeddingType {
    Absolute,
    RelativeKey,
    RelativeKeyQuery,
}

Type of position embedding. Choose one of "absolute", "relative_key", "relative_key_query". For positional embeddings use "absolute". For more information on "relative_key", please refer to Self-Attention with Relative Position Representations (Shaw et al.). For more information on "relative_key_query", please refer to Method 4 in Improve Transformer Models with Better Relative Position Embeddings (Huang et al.).

Variants

Absolute

RelativeKey

RelativeKeyQuery

Trait Implementations

impl Clone for PositionEmbeddingType

fn clone(&self) -> PositionEmbeddingType

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for PositionEmbeddingType

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.