Available for opportunities

Zeel Kakadia

Software Engineer & AI Evaluation

Software engineer with 4+ years shipping production backend systems in Java & Spring Boot — the kind of work where correctness, performance and clean migrations matter. I’ve since moved into frontier-AI evaluation: authoring the statistical evals and data that benchmark leading models, and leading a 30-person eval team. Same engineering rigor, applied to both — and I’m open to software and AI-evaluation opportunities.

India · Open to remote

Experience

Career timeline

A backend engineer who moved into frontier-AI evaluation. Most recent first.

Snorkel AI via Syncrope Present

AI Evaluation Engineer · Team Lead

Jun 2026 — Present · Contract

Led a 30-person authoring team

Contracted through Syncrope to build and review evaluation tasks that benchmark frontier AI across data-science, ML and software-engineering domains.

LLM EvaluationBenchmarkingTeam LeadershipRubric DesignQuality ReviewMulti-domain
  • — Lead a 30-person team authoring high-quality evaluation tasks — owning planning, review cadence and the quality bar.
  • — Author evaluation tasks spanning data-science, machine-learning and software-engineering domains.
  • — Reviewer on a large coding-agent evaluation benchmark, upholding correctness and rubric quality across the team’s submissions.
  • — Contributed physics-domain evaluation tasks on a specialized science track.

Abundant AI

AI Data & Evaluation Engineer

Feb 2026 — Jun 2026 · Contract

Owned statistical evals end-to-end · dataset → verifier

Authored self-contained evaluations that benchmarked how well AI agents perform real statistical work — each owned end to end: realistic dataset → analysis contract → oracle (ground-truth) solution → verifier and hidden test variants that score the agent.

LLM EvaluationBenchmarkingStatistical AnalysisVerifier DesignGround-truth Oracles
01

Data-Science Evaluation Tasks

Authored self-contained statistical evals end to end — framing the dataset and analysis contract, implementing the oracle solution that defines ground truth, and building the scoring verifier plus hidden test variants.

  • — Authored statistical evals end-to-end, each owned from dataset to verifier — mostly R, with Python/Colab and Julia.
  • — Survival analysis (Cox PH, Kaplan–Meier), mixed-effects / multilevel models, multiple-testing / FDR, Bayesian & empirical-Bayes shrinkage.
  • — Econometrics & causal inference (Heckman selection, propensity matching, ordered logit); unsupervised methods (LDA, MDS, EM mixtures, factor analysis); spatial statistics; ML calibration / drift / conformal prediction.
02

Advanced Statistical Tasks — Real-World Data

Built the hardest tier of evaluation tasks on real, canonical datasets — genuine applied statistical analysis, not toy data.

  • — Built the hardest-tier tasks in R (with some Julia) — survival, panel, econometrics, robust and mixed-effects methods.
  • — Examples: mortgage-lending data → logistic discrimination; labor-supply data → Heckman selection; investment panels → dynamic panel GMM (Nickell bias).
  • — Clinical survival data → Cox PH diagnostics + competing risks; overdispersed counts → GAMLSS dispersion modeling; repeated-measures data → mixed-effects / AR(1) / NLME family.
03

Hardware RTL Evaluation Tasks

Authored register-transfer-level (RTL) hardware evaluation tasks for frontier-model benchmarking.

  • — Built RTL hardware tasks used to benchmark frontier models on hardware-design work.

Aera Technology

Software Engineer

Jan 2022 — Aug 2026 · Full-time

Aera builds an enterprise “Decision Intelligence” platform. I worked across its data & backend layer — customer migrations, graph services, platform observability, and the data pipelines that feed its GenAI features.

JavaSpring BootNeo4jMySQLKafkaKubernetesCI/CD
01

Multi-Tenant Data Migration

Onboarding every new customer meant moving their entire MySQL + Neo4j footprint onto a new architecture — slow, manual and heavily reliant on DBAs. I automated the whole thing end to end.

  • — Automated customer-project migrations across MySQL & Neo4j with minimal DBA involvement.
  • — Backed up MySQL (MySQL Shell) and exported Neo4j graphs (Cypher-shell), including source-environment cleanup.
  • — Built a GitHub Actions CI/CD pipeline to back up, upload to version-controlled repos, and restore.
  • — Versioned every schema change with Flyway for a traceable, consistent migration history across environments.
60% faster customer migrations
40% faster seed deployments
02

Graph Service Development

The platform’s graph data had to respect complex, per-role access rules. I built the service that generates the right queries dynamically and provisions each project’s database automatically.

  • — Built a graph backend on Neo4j + MySQL with dynamic Cypher generation driven by role-based access filters.
  • — Developed an automated provisioning system that creates schemas, users and role configs per project deployment.
03

System Monitoring & Infrastructure

Made the platform observable and resilient — so we always knew who changed what, and unhealthy services were caught before customers ever noticed.

  • — Designed a real-time Audit Framework tracking user and role modifications.
  • — Built liveness & readiness probes for MySQL, Kafka, Neo4j and Redis to monitor application health.
  • — Replaced the deprecated PhantomJS with Puppeteer (headless Chrome) to automate chart-snapshot generation.
04

Data Processing & GenAI Integration

Connected the data platform to its AI features and to geospatial search — turning raw metadata and map data into something models and queries could actually use.

  • — Generated batch-wise JSON of DataView metadata (measures & dimensions) for entire projects, auto-uploaded to MinIO to feed a GenAI metadata push.
  • — Extracted OpenStreetMap City/State/Country boundaries (multipolygon geometry) and indexed them into OpenSearch for fast, accurate custom-border geospatial queries.
05

Quality & Performance

Raised the reliability bar — hardening the test suite and resolving the issues that actually mattered in production.

  • — Wrote 80+ JUnit tests and API automation suites, systematically resolving critical failures.
  • — Resolved production bugs and shipped performance optimizations, refactoring for code quality and maintainability.
53→85% API test pass rate
80+ JUnit tests authored
Toolbox

Skills & stack

The technologies I reach for, grouped by domain — strong across backend, data and infra, and actively building in AI/ML.

Languages

JavaPythonRJuliaSQL

Backend & Frameworks

Spring BootREST APIsMicroservicesJUnit

Data & Storage

MySQLNeo4j (Cypher)RedisOpenSearchMinIOFlyway

Infra & DevOps

DockerKubernetesKafkaGitHub ActionsCI/CD

AI Evaluation

LLM evaluationBenchmarkingRubric & verifier designGround-truth oraclesData labeling

Statistics & Methods

Survival analysisCausal inferenceMixed-effects modelsBayesian methodsConformal prediction
Beyond work

Side projects

Things I built on my own time to learn front-end, realtime data and full-stack delivery.

Real-Time Chat Application

Person-to-person real-time chat with online/offline presence, last-seen, and persistent timestamped history.

Next.jsFirestoreFirebase Auth

Meme Collection Website

Full-stack CRUD app (GET/POST/PUT/DELETE) for managing memes with image-URL handling. Built during the Crio Externship.

ReactExpressSQLite3
Contact

Let's build something together

I'm open to remote roles and freelance projects, and I usually reply within a day.

Email me