Skip to content
Back to home
About

I own the AI layer all of it

Senior AI Engineer specialising in production RAG systems, LLM infrastructure and multi-agent orchestration. Three-plus years of end-to-end ownership across LLM integration, scalable backend architecture and full-stack delivery — as the sole AI-layer owner covering architecture, prompt engineering, RAG tuning, deployment, evaluation, observability and cost.

In practice that means I am the person accountable when retrieval quality slips, when a provider starts rate-limiting at 2am, or when the monthly LLM bill needs an explanation. Across two roles I have been the sole owner of that layer — designing the agent graphs, tuning the retrieval, writing the eval harnesses, wiring the traces and negotiating the cost/quality trade-offs with the people who care about the P&L.

The full-stack background is not incidental. Three years of shipping React, Next.js, Node and FastAPI means the AI work lands inside real products with real API contracts, real databases and real Core Web Vitals scores — not a notebook thrown over a wall.

Before specialising, I delivered 15+ production web applications and mentored junior developers at Happymonk AI in Bengaluru. That grounding in delivery discipline — code review, testing, sprint cadence — is why the AI systems I build have documentation and eval runs in the repo rather than tribal knowledge in someone's head.

Portrait of Sudhanshu Srivastava
Based in
New Delhi, India
Role
Senior AI Engineer
Focus
LLM Systems & RAG Specialist
Experience
3+ years
Status
Open to senior AI / LLM engineering projects

85%+

RAGAS faithfulness

up from 62% in production

35%

lower inference latency

provider routing + caching

40%

fewer pipeline failures

fault-tolerant async ingestion

25%

LLM cost reduction

per-query, at sustained traffic

Track record

Three years of owning the whole layer

  1. Senior AI Engineer

    Gaup Media Pvt Ltd · New Delhi, India

    Feb 2026 — Present

    • Own end-to-end architecture of a production AI campaign-reporting system integrating Instagram and LinkedIn data pipelines via multi-agent orchestration (LangGraph-style agent graphs); architected ingestion → enrichment → reporting targeting sub-200ms p95 report generation.
    • Drive cross-functional AI delivery as sole AI-layer owner across data engineering and product — sprint planning, stakeholder reviews and every technical decision for the LLM layer.
    • Architected distributed Node.js backend APIs for automated analytics workflows with fault-tolerant async ingestion; cut pipeline failure rate by 40% through robust handling of API failures, rate limits and schema drift.
    • Implemented LLM observability and tracing with LangSmith for real-time monitoring of agent execution, token usage, latency and failure modes across multi-agent workflows.
    • LangGraph
    • LangSmith
    • Node.js
    • PostgreSQL
    • OpenAI
    • Redis
  2. Senior LLM Engineer

    Digitally Next · New Delhi, India

    Apr 2024 — Feb 2026

    • Led end-to-end delivery of production RAG pipelines using GPT-4, LangChain and vector search (Pinecone, ChromaDB) serving ~5K daily queries across 3+ client products; drove RAGAS faithfulness from 62% to 85%+ via semantic chunking, cross-encoder reranking and metadata filtering.
    • Owned LLM cost optimisation — intelligent request routing, response caching and prompt compression cut per-query API cost by 25% at sustained traffic; instrumented full model monitoring via Arize AI.
    • Designed and ran A/B tests on prompt variants and retrieval strategies; drove a 15% increase in user engagement using structured outputs and function-calling patterns.
    • Architected scalable REST APIs integrating ML models with PostgreSQL, MongoDB and Next.js frontends; defined SLA/SLO targets and owned production incident response for the AI feature layer.
    • Reduced application load time by 30% through React performance tuning, lazy loading, code-splitting and optimised API contracts — with direct Core Web Vitals improvement.
    • LangChain
    • GPT
    • Pinecone
    • ChromaDB
    • Arize AI
    • Next.js
    • FastAPI
  3. Software Engineer

    Happymonk AI · Bengaluru, India · Promoted from internship

    Mar 2023 — Apr 2024

    • Owned delivery of 4 client projects spanning fintech and SaaS using React, Node.js and AWS.
    • Mentored 3 junior developers on React architecture and backend best practices; reduced PR review cycles by 25% and lifted team code-quality standards.
    • Drove 20% growth in organic traffic and a 12% conversion uplift through structured data, lazy loading and Lighthouse-based Core Web Vitals work.
    • React
    • Node.js
    • AWS
    • TypeScript
    • SEO
  4. Software Engineer Intern

    Happymonk AI · Bengaluru, India · Internship

    Dec 2022 — Mar 2023

    • Delivered 15+ production web applications using React, Node.js and AWS (EC2, S3, Lambda) across fintech, e-commerce and SaaS clients.
    • Built Express-based microservices with DynamoDB and S3 for scalable storage; implemented AI-driven automation pipelines for analytics and personalisation.
    • Contributed to codebase quality through unit testing and code review inside Agile sprint cycles.
    • Express
    • DynamoDB
    • S3
    • Lambda
    • React

Education

B.Tech, Computer Science
Lovely Professional University
2020 — 2024 · Punjab, India

Certifications

  • Generative AI with Large Language ModelsDeepLearning.AI & AWS
  • Deep Learning SpecializationCoursera · deeplearning.ai
  • IBM Full Stack Application DevelopmentedX · IBM
  • Advanced React and GraphQLUdemy
The toolkit

Everything I reach for, and why it's there

No tool here is on the list because it looked good on a slide. Each one earned its place solving a specific production problem.

AI & LLM Engineering

The orchestration layer. Agent graphs with explicit state beat one long prompt every time — they can be traced, tested and reasoned about.

  • RAG Pipelines
  • LangChain
  • LangGraph
  • LlamaIndex
  • OpenAI APIs
  • Structured Outputs
  • Function Calling
  • Hugging Face
  • Llama 3
  • Mistral
  • vLLM
  • Ollama
  • Prompt Engineering
  • Embeddings
  • Multi-agent Orchestration
  • LoRA / QLoRA
  • RAGAS
  • Inference Optimization

Observability & MLOps

If it isn't traced, it isn't real. Tokens, latency and failure modes go on a dashboard before the feature goes to users.

  • LangSmith
  • Arize AI
  • Helicone
  • Model Monitoring
  • Guardrails
  • LLM Tracing
  • Experiment Tracking
  • GitHub Actions

Vector Databases

Retrieval quality is a data problem before it's a model problem. Chunking, metadata and reranking do most of the heavy lifting.

  • Pinecone
  • ChromaDB
  • FAISS
  • pgvector

Backend & APIs

The unglamorous half. Async queues, request routing and honest API contracts are what keep an LLM feature from falling over under load.

  • Node.js
  • Express
  • Python
  • FastAPI
  • REST
  • Microservices
  • Async Job Queues
  • Distributed Systems
  • System Design

Frontend

The AI has to land somewhere. Shipping the interface myself means the contract between model and UI never gets lost in translation.

  • React
  • Next.js
  • TypeScript
  • Tailwind CSS
  • Core Web Vitals
  • SEO

Cloud & Data

Where it all runs. Containers, managed Postgres and object storage — boring, predictable, easy to hand over.

  • AWS EC2 / S3 / Lambda
  • Docker
  • Kubernetes
  • PostgreSQL
  • MongoDB
  • DynamoDB
  • Redis
  • MySQL