Low-Rank Adapting Models for Sparse Autoencoders

Chen, Engels, Tegmark (2025)

Read paper

Tags: training-efficiency, lora

Abstract

We use low-rank adaptation techniques to efficiently train sparse autoencoders, reducing memory and compute requirements.