Home / Careers / Senior AI Engineer (LLM & RAG)
AUDIO & AI TEAM
Senior AI Engineer (LLM & RAG)
Design and ship LLM, RAG and agent features that are grounded, evaluated and ready for enterprise buyers.
Ahmedabad · Hybrid
Full-time
5+ years
Posted 8 Nov 2026
About the role
You will lead LLM application builds for clients in the United States and Canada: retrieval pipelines, agents, evaluation and guardrails, from prototype to production with clear cost and quality targets.
What you'll do
✓
Design RAG pipelines: chunking, embeddings, hybrid search and re-ranking
✓
Build agents with tool use, guardrails and human approval steps
✓
Set up evaluation sets and automated quality gates
✓
Track and reduce cost and latency per request
✓
Guide junior AI engineers and review their code
What you bring
✓
5+ years in software or ML, 2+ with LLM apps in production
✓
Strong Python and API design
✓
Hands-on with vector databases and at least one LLM provider
✓
Experience with evaluation and prompt or model versioning
✓
Comfort talking with client stakeholders
Nice to have
✓
Fine-tuning or distillation experience
✓
Knowledge of ISO 42001 or the EU AI Act
✓
Audio or speech model experience
What we offer
✓
Paid certification exams and study time
✓
Learning budget for courses and conferences
✓
Health cover for you and your family
✓
Hybrid working from Zundal, Ahmedabad
Team
Audio & AI
Location
Ahmedabad, India · Hybrid
Type
Full-time
Experience
5+ years
Salary
Competitive, shared on first call
Your hiring manager
AI Engineering Lead, Audio & AI team
WHAT HAPPENS NEXT
From application to offer in about 2 weeks
01
Apply
2 minutes
02
Intro call
30 minutes
03
Practical test
A short lab, not homework
04
Meet the team & offer
1 hour
APPLY
Apply for Senior AI Engineer (LLM & RAG)
SIMILAR ROLES
You might also like
What does a Senior AI Engineer (LLM & RAG) do at Zuroth?
You will lead LLM application builds for clients in the United States and Canada: retrieval pipelines, agents, evaluation and guardrails, from prototype to production with clear cost and quality targets. Design and ship LLM, RAG and agent features that are grounded, evaluated and ready for enterprise buyers.
What experience do I need for this role?
We look for 5+ years in software or ML, 2+ with LLM apps in production, strong Python and API design and hands-on with vector databases and at least one LLM provider. If you meet most of the requirements and are keen to learn, we still want to hear from you.
Is this role hybrid or remote?
This role is hybrid from our office in Zundal, Ahmedabad, with flexible days agreed with your manager. Most client work is for companies in the United States and Canada, so some days include a short overlap with US Eastern Time.
What does the hiring process look like?
There are four steps: a 2-minute application, a 30-minute intro call, a short practical exercise relevant to the role, and a one-hour meeting with the team before an offer. Most candidates hear back within 3 business days and finish in about 2 weeks.
What growth and learning support do you offer?
Every role has a learning budget for courses and conferences, paid certification exams with study time, and a growth path reviewed twice a year. Senior roles mentor others and help shape how our practices work.