k-Sparse Autoencoders

Makhzani & Frey (2013)

Read paper

Tags: foundations, architecture

Abstract

We propose a sparse autoencoder based on the k-sparse activation function that enforces sparsity by keeping only the k highest activations. This approach provides a simple and efficient way to train sparse representations.