Mamba paper proposes selective state-space models as a transformer alternative
Letting the model's internal state-update rules depend on the input let a 3-billion-parameter Mamba match transformers twice its size while running five times faster.
Ideas & essays