🎓How I Study AIHISA
📖Read
📄Papers📰Blogs🎬Courses
💡Learn
🛤️Paths📚Topics💡Concepts🎴Shorts
🎯Practice
⏱️Coach🧩Problems🧠Thinking🎯Prompts🧠Review
SearchSettings
How I Study AI - Learn AI Papers & Lectures the Easy Way

Papers1

AllBeginnerIntermediateAdvanced
All SourcesarXiv
#orthogonal Procrustes

COMPOT: Calibration-Optimized Matrix Procrustes Orthogonalization for Transformers Compression

Intermediate
Denis Makhov, Dmitriy Shopkhoev et al.Feb 16arXiv

COMPOT is a training-free way to shrink Transformer models while keeping their smarts.

#Transformer compression#orthogonal dictionary learning#orthogonal Procrustes