It is necessary to compress the transformer to reduce its memory consumption and accelerate the inference. In this paper, we investigated the binarization of a transformer-DeepViT for efficient human ...

2025-01-23: ARB-LLM is accepted at ICLR 2025. 🎉🎉🎉 2024-10-03: This repo is released. Figure 1 in the main paper demonstrates that our proposed ARB-LLM RC outperforms the previous state-of-the-art ...