We demonstrate that BlackMamba performs competitively versus both Mamba and transformer baselines, and outperforms in inference and coaching FLOPs. We absolutely train and open up-resource 340M/1.5B and 630M/two.8B https://k2spiceshop.com/product/liquid-k2-on-paper-online/