Nayab GauharAI/ML engineer

Open to roles and research internships

I work on speech and vision systems that run on ordinary hardware.

I'm a computer science undergrad at Haldia Institute of Technology. Right now I'm a Summer Research Fellow at NIT Puducherry on the IAS/INSA/NASI programme, teaching speech models to understand dysarthric Tamil — speakers that standard ASR handles badly.

Alongside that I build things people actually use: a real-time voice agent handling sales calls, a gaze system that lets a post-stroke patient communicate by looking at objects, and a campus app running on live Postgres.

Nayab Gauhar
Currently

Research fellow
NIT Puducherry

Studying

B.Tech CSE, 8.7 CGPA
Haldia, 2024–28

Based in

Karaikal, Puducherry
India

About

What I'm actually doing

Two things run in parallel for me. There's research, which is slow and mostly reading, and there's client work, which has deadlines and someone waiting on the other end. I've found each one makes me better at the other.

The research is at NIT Puducherry. I fine-tune Wav2Vec2-XLSR-53 on dysarthric Tamil speech — recordings from speakers whose articulation is exactly the case standard ASR was never trained for. The interesting part isn't the model, it's the data discipline: voice-activity segmentation, and splitting by speaker so the model can't memorise a voice and look better than it is. A second project corrects the residuals of SWAT+ hydrology simulations with gradient boosting.

The client side is where the deadlines are. The piece I'd point at is a voice agent that holds real phone conversations for a real-estate client — you can interrupt it mid-sentence and it stops talking, which sounds small and is most of the engineering.

If there's a thread, it's that I'd rather make something work on a laptop than wait for a bigger GPU. GAZE needs no per-patient calibration because a patient in a hospital bed can't do a calibration routine. The dysarthric speech work matters because the speakers who most need dictation are the ones it fails. The constraint is usually where the actual problem is.

Work

Selected projects

Nine of twenty-three public repositories. Each one links to source.

Client work

AI Voice Calling Agent

Python · FastAPI · Twilio

A voice agent that makes and takes real phone calls for a real-estate client. Audio streams from Twilio through speech-to-text, an LLM, and back out as speech, fast enough to feel like a conversation rather than a form.

  • Sub-second round trip, and it stops talking when you interrupt it
  • Cut token spend ~40% by compressing conversation state instead of resending it
  • Swappable provider layer, so a new model takes hours rather than days
  • Deepgram
  • Llama 3.3-70B
  • Sarvam TTS
  • MongoDB
  • WebSockets

Research

GAZE

PyTorch · ONNX

Assistive communication for someone who can't speak or move much: one webcam watches which registered object they're looking at, and tells a caregiver. No calibration routine, because a patient in a bed can't perform one.

  • A detector I trained for this scene runs 330× faster than the zero-shot baseline
  • Benchmarked 8 model variants to find one that holds up on CPU alone
  • Abstains rather than guessing — a wrong word is worse than no word
  • Gaze-LLE
  • YOLO-World
  • Depth Anything V2
  • OpenCV

Platform

Instant Mail

TypeScript · Next.js · Postgres

An email outreach platform. Sequences send from real mailboxes on a schedule; when someone replies, the sequence stops, the reply gets classified, and it becomes a CRM entry.

  • Sending exactly once is enforced by database constraints, not by hoping the worker behaves
  • A background worker does the sending, so campaigns run with no browser open
  • Per-mailbox daily caps and send windows, in the mailbox's own timezone
  • Bun
  • React 19
  • Prisma
  • Tailwind
  • Playwright

Mobile

HIT Connect

Flutter · Supabase

A campus app for my college. Events from every club in one place, and registration that fills itself in from your profile — the specific annoyance of retyping your roll number for the fifth time.

  • 85 tests passing, analyzer clean, running on a real device against live Postgres
  • Permissions live in row-level security policies, so the database refuses bad reads
  • Club admins get a role in the same app, not a second one to install
  • Dart
  • Riverpod
  • go_router
  • PostgreSQL

Tool

Opportunity Bot

Python · GitHub Actions

I was losing evenings to checking scholarship and internship listings, so I stopped. This reads twelve sources, throws out anything irrelevant to me, and sends the rest to Telegram.

  • About 170 listings a run, deduped against everything already sent
  • A small model does the relevance call, which is cheaper than my attention
  • Runs on a cron in Actions; no server to keep alive
  • Groq
  • Llama 3.1
  • Telegram API
  • RSS

Research

fMRI Augmentation with GANs

PyTorch · scikit-learn

Autism classification datasets are small. A WGAN-GP learns the shape of functional-connectivity matrices and generates more, to see whether synthetic training data genuinely helps.

  • The test set is split off before the GAN sees anything — otherwise the result is meaningless
  • 200×200 correlation matrices flattened to 19,900 features
  • Baseline and augmented classifiers judged on the same untouched holdout
  • WGAN-GP
  • fMRI
  • Jupyter

For fun

A POSIX-compliant shell written by hand for the CodeCrafters challenge. Quoting rules are far stranger than I expected before writing the parser.

  • REPL, command parsing, PATH resolution, redirection, builtins
  • No shell libraries — process handling done directly
  • POSIX
  • subprocess
  • uv

Experiment

Cursor control by eye

Python · OpenCV

Moving the mouse by looking, using a plain webcam and no neural network. Facial landmarks find the eyes, thresholding finds each iris, and two calibration points map gaze to the screen.

  • Contour detection for the iris centre — classical vision, and fast
  • Groundwork for the gaze estimation in GAZE
  • dlib
  • pyautogui
  • NumPy

Live demo

Upload a résumé, get back the skills and seniority it reads from it, plus live job listings matched against them. Nothing is stored anywhere.

  • Gemini pulls out skills, experience level and location preference
  • Matched against the APIJobs feed with direct apply links
  • Streamlit
  • Gemini
  • PyPDF2
Experience

Where I've worked

Jun 2026 —
Present

Summer Research Intern

NIT Puducherry · IAS/INSA/NASI Fellowship · Karaikal

  • Selected for the IAS/INSA/NASI Summer Research Fellowship, a national programme.
  • Fine-tuned Wav2Vec2-large-XLSR-53 for dysarthric Tamil speech recognition, with VAD segmentation and speaker-independent splits via Resemblyzer.
  • Built residual-correction models for SWAT+ hydrology simulations using CatBoost, XGBoost, LightGBM and LSTM/GRU.
  • PyTorch
  • Wav2Vec2
  • Resemblyzer
  • gradient boosting

Mar 2025 —
Present

Technical Team Member

ISTE · HIT Student Chapter · Haldia

  • Running technical infrastructure and content for chapter events; maintaining the ISTE website.
  • Handled sponsorship outreach to around 100 companies for the National-Level Hackathon and Annual Convention 2026.

Jan 2026 —
Mar 2026

Full Stack Developer Intern

Pripton Innovations · Remote

  • Built and shipped a client website end to end — design, APIs and database — to deadline.
  • React
  • Node.js
  • Express
  • MongoDB

Aug 2024 —
Aug 2028

B.Tech, Computer Science & Engineering

Haldia Institute of Technology · West Bengal · 8.7 CGPA

Toolkit

What I reach for

Languages

Python, C++, C, JavaScript, TypeScript, Dart, SQL, Bash

Machine learning

PyTorch, scikit-learn, XGBoost, CatBoost, LightGBM. Fine-tuning, computer vision, speech recognition, GANs, ONNX for deployment.

Speech & voice

Wav2Vec2, Deepgram, Sarvam TTS, ElevenLabs, Vapi, Twilio, voice-activity detection, Resemblyzer

Web & apps

FastAPI, Next.js, React, Node, Express, Flutter with Riverpod, Streamlit, Tailwind

Data

PostgreSQL, MongoDB, Supabase, Prisma, row-level security

Everything else

Git, Linux, Docker, GitHub Actions, Playwright, ROS, Power BI, Colab

Awards

Competitions

First place

Quiz-O-Codigo v5.0

CSI Coding Competition, HIT · 2025

Solo win across aptitude, technical rounds, and a two-and-a-half hour algorithmic challenge.

Second place

CSI Innovate-X Hackathon

Team lead, Kodo Gipers · HIT · 2025

Led four people to a podium finish against 50+ teams with a sentiment model at 89% accuracy, and presented it to industry judges.

First place

GitSetGo

GDG on Campus HIT with GDG Ranchi · 2025

Collaboration and version-control event run across two Google Developer Group chapters.

Participant

KrackHack 2.0

Certified · January 2025

If you're working on something similar, I'd like to hear about it.

I'm looking for AI/ML engineer roles and research internships for Summer 2027, and I take on freelance work involving voice or vision. Email reaches me fastest.