AI research and systems, Mumbai

Lean. Tested. Safe.

Language models that run in less memory, hold up under rigorous evaluation, and stay inside their limits.

Third-year B.Tech in Computer Science at SPIT Mumbai, GPA 9.4. First-author preprint on KV-cache compression. Research intern at IIIT Kancheepuram and IIT Jodhpur. Open to collaborations and internships.

3 of 28
A synthetic matrix rebuilt from its strongest components. A few directions carry most of the signal, the idea behind my Ro-SVD work. Reconstruction error:

Memory is the bottleneck.

Long-context inference runs out of GPU memory first. My preprint cuts the KV cache by 35.1% and keeps quality.

Evaluation is the product.

A result needs a test it can fail. I run full benchmarks, 16 LongBench subsets, and significance tests, not hand-picked examples.

Agents need walls.

Agent-written code runs in a sandbox with no network and hard limits, behind a server that manages its own GPU memory.

Claims need proof.

Safe control of a power grid, jailbreaks across text and video: each gets a measured answer, not a demo.

Research threads

01
First-author preprint, Zenodo, May 2026

Ro-SVD: position-aware KV-cache compression

Online low-rank compression of pre-RoPE keys in grouped-query attention, with per-head adaptive rank allocation, a custom CUDA de-rotation kernel, and a randomised SVD path. Over 1,602 samples on all 16 LongBench subsets (Qwen2.5-7B-Instruct, 4-bit NF4, dual T4): 73.91% ROUGE-L win rate against the uncompressed baseline.

What I learned

Python-loop SVD added 29.5% latency, so the algorithm was not the whole story: the implementation had to be batched and randomised. Head-level analysis mattered too, since a few high-entropy heads need more rank than the rest.

02
IIIT Kancheepuram, Prof. Rajesh Kolluri, 2026 to now

Safe reinforcement learning for vehicle-to-grid control

A differentiable residual-Dyna world model: an analytical AC power-flow base plus a learned residual, a quadratic-programming safety projection, and personalised federated learning. Early results are promising.

What I learned

Safety constraints belong in the architecture, not the reward. The projection layer guarantees feasible actions, so the learned residual only has to correct the physics model.

03
IIT Jodhpur, Prof. Deeksha Varshney, 2026 to now

Multilingual small-model distillation

Analysis of distilled small language models on multilingual tasks, extending Microsoft's Phi family to new evaluation settings. Equal contributor on hypotheses, experiments, and evaluation.

04
Multi-agent harness, 2026

Sentinel: cross-modal red-teaming

Probes LLMs across five attack categories and measures how jailbreak success shifts between text, image, and video delivery, compared with McNemar and Wilcoxon tests. Code is private for now.

What I learned

Raw pass rates mislead. Paired tests changed which differences I trusted, and the modality gap only became visible once delivery format was held as the single changing variable.

1,602benchmark samples per evaluation run
7.5xinference speedup with over 0.99 Pearson r (ZENSO)
47/176Kaggle IMAGINE, MEG imagined-word decoding
99.999validation accuracy, Amazon ML Challenge 2026

Things I have built

Read the case studies Engineering notes

Track record

  • Daten & Wissen, AI/ML intern, 2025Fine-tuned PaddleOCR for license plates to about 88% end-to-end accuracy and compared U-Net, SAM, and ResNet backbones on latency against accuracy.
  • Smart India Hackathon 2026Qualified SPIT's internal rounds. National result pending.
  • Open sourceTwo open pull requests to ML4SCI DeepLense-AI-Scientist.
  • ChessFIDE-rated 1700, SPIT institute champion.
  • CertificatesHugging Face Agents and NLP, NVIDIA DLI Agentic AI, Google Cloud ML APIs and Agent Fundamentals.
  • WritingGradient: Weight & Meaning, an explainer series on how language models work.

Build something with me