2024 in Post-Transformer Architectures: State Space Models, RWKV [Latent Space LIVE! @ NeurIPS 2024]
From the video description
Eugene Cheah of Recursal/Featherless and Dan Fu of Together bring a concise 30 mins updating all the work on RWKV and State Space Models this year, and riff on some hot takes on long context vs RAG
Topics
Sources
Video by Latent Space, played through YouTube.
- Indie Picks
Data and selection notes
Indie Picks uses video metadata for classification. The description above is an uploader excerpt, not an independent review.
Indie Picks: Independently collected SaaS and AI product videos, organized by a founder handbook. Topics and relevance are metadata-indexed; full-video editorial review has not been completed. Descriptions are uploader excerpts where available.
Views, duration and playback status refresh separately from the published catalog. When an update fails, existing data remains visible.
Selection checks
- SaaS & AI candidates: Topic keywords do not match
- Editor-approved picks: Editorial review is required