Rushil Jaiswal

I build AI systems that have to be right, and I audit the things that decide whether they are.

Claremont McKenna ’29 · CS at Harvey Mudd · Claremont, CA

See the work GitHub Email

Latest What agents don’t test: an RL task where the newest model fails most runs →

01  About

I patented an athletic recovery product at seventeen and shipped 600 units before I finished high school. That taught me the only lesson that transfers: the thing is not real until someone who owes you nothing uses it.

Most of my work now sits on the layer that decides whether an AI system is actually right. Reinforcement learning environments are scored by a verifier, and the verifier is the definition of good. If it can be gamed you train a reward hacker. If it rejects work that is correct but different, you spend the most expensive resource in the pipeline teaching a model that correct is wrong. Almost everyone measures the first failure. vaudit measures the second.

What agents don’t test is the other side of that work: building the task instead of auditing the grader. It went through three versions until the newest model failed most runs, and every failing run had done the same thing: tested thousands of cases, reported a match, and missed exactly the behavior its tests never generated. When I tried a larger version inside a real codebase, three pilots came back clean, which narrowed the claim instead of widening it, and turned up a bug I fixed upstream.

The same instinct runs through the security work. pipecat-firewall blocks prompt injection before a voice agent’s model ever sees the turn, so there is no prompt left to argue with. Vibecheck runs real static analysis over a repo and opens a pull request that fixes what it finds. Sentry writes itself a new guardrail mid-call and refuses the same attack seconds later.

I have also been building AI candidate sourcing for an IT staffing firm, and I still am. Most matching tools rank résumés by keyword overlap with a job description, which is a search problem pretending to be a hiring problem. Mine scores candidates against placement history instead: who actually got hired, for what, and what the recruiter said about them. The feedback loop is a recruiter telling me the ranking is wrong and why, which is the only kind worth having.

Elsewhere: Strata, field guidance for plumbing contractors that has to keep working in a crawl space with no signal, and Yaad, a memory engine for dementia care that refuses to answer when it cannot cite a row.

The through-line is accuracy under pressure. Systems that have to be right about people, and systems that have to stay right when something is actively trying to make them wrong. In all of them the interesting engineering is the failure mode, not the demo.

That is also why every project here ships with what is wrong with it. A portfolio of things that only worked is not evidence of judgement. Most of these pages end with the part I could not solve, and seven of them are dead.

02  Experience

VP of Partnerships, Claremont VC Current 2026 to now Student venture group across the Claremont Colleges. I run partnerships, building the relationships with funds and founders that the rest of the club’s work depends on.
Founder, Wrapit Recovery Shipped High school Designed, patented and sold an athletic recovery product, 600+ units shipped. Manufacturing, fulfilment and customer support included, which is where most of the actual learning was.

03  Selected work

What agents don’t test Research 2026 Every failing agent tested thousands of cases and reported a match. Each had missed exactly what its tests never generated. An RL task for coding agents, built three times and graded against a reference implementation. Opus 5.5 solved the first version from memory and the third in 4 of 9 runs. Three pilots in a real codebase showed where the failure doesn’t appear, and turned up a bug now fixed upstream. Python · Docker · Claude Code · 33 graded runs · 1 upstream PR Airlock Hackathon 2026 Agents will get fooled. Getting fooled shouldn’t move money. A finance team of AI agents that pays invoices from email and does business with other companies’ agents. Bank changes are verified on the vendor’s phone on file, and where money goes comes only from records: zero unauthorized payments across 39 injection attacks. FastAPI · Claude · Primitive · Inkbox · Stripe · MCP vaudit Research 2026 A correct emulator scored below a blank screen. Auditing whether RL graders accept legitimately different correct work. Five CHIP-8 ROMs, each isolating one platform quirk, each pre-registered before its bytes existed. Three of five published grading strategies rank a blank screen above a correct implementation. A follow-up study falsified four of its own predictions to bound exactly when. Python 3.13 · NumPy · pytest · CI on every push Goodhart Research 2026 If the grader can be gamed, training harder just produces a better cheater. RL verifiers are the bottleneck: train against a gameable grader and you get a reward hacker. A red-team swarm finds the holes, a green team seals them, and you get a before/after robustness number against held-out ground truth. Python · Anthropic SDK · FastAPI + WebSocket Telos Building 2026 to now A résumé that echoes the job description is a search result. A person who gets placed is the answer. AI candidate sourcing that ranks on placement outcomes, not keyword overlap. Live JobDiva sync, 23 shipped releases, one real staffing firm using it. FastAPI · Pinecone · Supabase · GPT-4o · JobDiva API Envoy Hackathon 2026 An agent worth delegating to is one that holds your details under pressure. A voice agent you hand a real errand to: it calls the restaurant, negotiates with a live host and books the table. Because it is holding your details while it does, it also writes its own guardrail after a breach, 0/5 → 5/5, independently judged. Pipecat · NVIDIA Nemotron · Twilio · Cekura Hindsight Hackathon 2026 Memory teaches an AI your facts. This teaches it how you tend to be wrong. Memory teaches an AI your facts; Hindsight teaches it your patterns of being wrong. Two days later the concept shipped into GBrain as the named “Hindsight calibration wave”, the name is still in its schema migrations. TypeScript · Express · GBrain skills · Chrome extension Yaad Hackathon 2026 A fluent wrong answer about someone’s grandson is worse than admitting you don’t know. A bilingual voice companion for dementia patients, built on a memory graph that refuses to invent a life. Every answer is grounded in retrieved memory or it says it doesn’t know. LiveKit · Pipecat · MiniMax · Moss · FastAPI Vibecheck Shipped 2026 Real scanners find the bug. The model only translates it and writes the fix. Paste a repo, get a security report a non-engineer can act on, then one click opens the PR that fixes it. Real scanners, not an LLM guessing at vulnerabilities. Next.js · FastAPI · Semgrep · Gitleaks · OSV · Claude

All 23 projects, including the dead ones →

04  Stack

Languages

Python, TypeScript, SQL. Python for anything with data or a model in it; TypeScript when a person has to look at it.

Backend

FastAPI for services, Next.js when the front end and API belong together, Supabase/Postgres for state.

AI

Claude and GPT-4o, Pinecone for retrieval, Pipecat + LiveKit for voice. Deterministic code wherever a model is not actually required.

Quant

pandas, statsmodels, scikit-learn. Enough econometrics to know when a p-value is load-bearing and when it is decoration.

Infra

Vercel, Railway, Docker, GitHub Actions. Boring on purpose, deployment should not be the interesting part.

Reach for first

The smallest thing that can be put in front of a real user this week. Everything I have learned came from that, not from the architecture diagram.

05  Interests

  • AI agents under adversarial pressure
  • labor markets
  • calibration & forecasting
  • prediction markets
  • hip-hop dance
  • guitar
  • running
  • climbing

~/R