• 2024-06-12Efficiently Modeling Long Sequences with Structured State Spaces
    目录概符号说明S4代码GuA.,GoelK.andReC.Efficientlymodelinglongsequenceswithstructuredstatespaces.NeurIPS,2022.概Mamba系列第三作.符号说明\(u(t)\in\mathbb{R}\),输入信号;\(x(t)\in\mathbb{R}^N\),中间状态;\(y(t)\in\mathbb{R}\),输
  • 2024-06-05HiPPO: Recurrent Memory with Optimal Polynomial Projections
    目录概Motivation代码GuA.,DaoT.,ErmonS.,RudraA.andReC.HiPPO:Recurrentmemorywithoptimalpolynomialprojections.NIPS,2021.概看下最近很火的Mamba的前身.本文其实主要介绍的是一个如何建模历史信息在正交基上的稀疏的变化情况.Motivation对于