From Scratch to SOTA: Training a 3B State-Space Vision Model — Krishna Prasad Srinivasan, Sarvam
Sarvam introduces Vision India, a 3B parameter Vision Language Model achieving state-of-the-art in document AI for English and 22 Indian languages. It leverages a State Space Model (SSM) backbone for efficiency with long documents and a novel block-level OCR approach. A four-stage training curriculum, including advanced RL with verifiable rewards, and a robust data engine for low-resource languages underpin its superior performance, enabling the digitization of millions of pages for critical sectors.
