Speed Always Wins: A Survey on Efficient Architectures for Large Language Models
[NeurIPS 2024] Official code of "LION: Linear Group RNN for 3D Object Detection in Point Clouds"
Triton kernels for linear RNN (currently recurrentgemma)
Sparse autoencoder for recurrentgemma
minGRU (Feng et al.) in PyTorch, plus a measured ladder of state-tracking recoveries — signed, rotation, Givens, and delta (DeltaNet-style Householder products) mixers with time decay, all under one parallel scan — with fused Triton GPU kernels as an optional backend
To associate your repository with the linear-rnn topic, visit your repo's landing page and select "manage topics."