Module bert

Module bert 

Source
Expand description

BERT (Bidirectional Encoder Representations from Transformers)

Bert is a general large language model that can be used for various language tasks:

  • Compute sentence embeddings for a prompt.
  • Compute similarities between a set of sentences.
  • Arxiv “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding”
  • Upstream Github repo.
  • See bert in candle-examples for runnable code

Structs§

BertEncoder
BertForMaskedLM
BertLMPredictionHead
BertLayer
BertModel
BertOnlyMLMHead
Config

Enums§

HiddenAct
PositionEmbeddingType

Constants§

DTYPE