towhee.models.layers.attentionΒΆ

Classes

Attention

Scaled dot-product attention mechanism.

MultiHeadAttention

Multi-head attention layer.