Pyramid Transformer Backbone

The paper introduces DATAR, a Deformable Audio Transformer for audio recognition. The authors argue that the quadratic complexity of self-attention computation in existing transformer models limits their application in low-resource…