[D] - Why MAMBA did not catch on?
It felt like that MAMBA will replace transformer from all the hype. It was fast but still maintained performance of transformer. O(N) during training and O(1) during inference and gave pretty good accuracy. So why it didn't became dominant? Also what is state of state space models?