FT Transformer - Implementation of Revisiting Deep Learning Models for Tabular Data in JAX pip install fttjax

GateLoop Transformer - Implementation of GateLoop: Fully Data-Controlled Linear Recurrence for Sequence Modeling in JAX pip install gateloop

Bidirectional Cross Attention - Implementation of Perceiving Longer Sequences With Bi-Directional Cross-Attention Transformers in JAX pip install bidirectional-cross-attention-jax

Axial Positional Embedding - JAX implementation of axial positional embedding used in Reformer: The Efficient Transformer pip install axial-positional-embedding-jax

This website has a lot of cool WASM stuff, all made from scratch by me