towhee.models.layers.position_encoding

Various positional encodings for the transformer.

Functions

build_position_encoding

Classes

PositionEmbedding	Standard positional encoding
PositionEmbeddingLearned	Absolute pos embedding, learned.