towhee.models.shunted_transformer.utilsΒΆ

Classes

Attention

Modified Attention.

Block

Block in Shunted Transformer

HeadPatchEmbed

The patch embedding layer at stage 0.

Mlp

Modified Mlp containing depthwise convolution, based on a standard Mlp in ViT.

OverlapPatchEmbed

Overlap patch embedding layer based on a standard patch embedding layer in ViT