Hi, I'm a 5th-year Computational Linguistics and Computer Science dual degree student at IIIT Hyderabad. I work on mechanistic interpretability of language models from a linguistics lens at the Language Technologies Research Centre.
Selected Projects
Studied Gemma-2-2B on a controlled role-gated retrieval task where a prepositional gate (to or from) selects which of two entities is correct.
Investigated how multilingual transformers (XLM-RoBERTa, mBERT, IndicBERT) internally encode grammatical information from the Paninian framework across seven Indian languages. Used diagnostic probing to analyze layer-wise encoding patterns, finding syntactic dependencies peak in middle-upper layers (6-9) while lexical features emerge earlier.
Investigated frequency-domain adversarial attacks on Llama Guard 3's multimodal safety filters. Combined vision adversarial attacks with language model security testing.
Explored multi-hop QA using teacher-student distillation for reasoning chain transfer. Built a graph traversal RAG pipeline that achieved 15% accuracy boost by teaching smaller models logical paths.
Experimented with Racket-based tensor DSL, reimagining ML ops through Lisp's compositional philosophy. Built computation graph auto-differentiation from scratch using functional paradigms.
Nanopass compiler in Racket with graph-coloring register allocation. Implemented tuple support and garbage collection using interference graphs for optimal register usage.
Built a black-box detection framework for machine-generated text. Experimented with LoRA adapter fine-tuning for detection tasks, achieving 92% F1 without full retraining.
Network file system built from scratch in C for parallel clients. Implemented LRU caching and concurrent operations for efficient distributed storage.
Shell written from scratch in C with piping, I/O redirection, and networking support for fetching man pages.
Enhanced xv6 OS by replacing round-robin scheduler with a multi-level feedback queue and implementing copy-on-write with performance evaluation.
A minimal forum built using React Query. Backend powered by TypeScript, Mongoose, and MongoDB.
A mobile app to crowdsource campus meal deliveries. Winner of the hackathon organized by the Open Source Developers Group at IIIT Hyderabad (HackIIIT).