Home / Careers / Senior AI Engineer (LLM & RAG)

AUDIO & AI TEAM

Senior AI Engineer (LLM & RAG)

Design and ship LLM, RAG and agent features that are grounded, evaluated and ready for enterprise buyers.

Ahmedabad · Hybrid

Full-time

5+ years

Posted 8 Nov 2026

About the role

You will lead LLM application builds for clients in the United States and Canada: retrieval pipelines, agents, evaluation and guardrails, from prototype to production with clear cost and quality targets.

What you'll do

✓

Design RAG pipelines: chunking, embeddings, hybrid search and re-ranking

✓

Build agents with tool use, guardrails and human approval steps

✓

Set up evaluation sets and automated quality gates

✓

Track and reduce cost and latency per request

✓

Guide junior AI engineers and review their code

What you bring

✓

5+ years in software or ML, 2+ with LLM apps in production

✓

Strong Python and API design

✓

Hands-on with vector databases and at least one LLM provider

✓

Experience with evaluation and prompt or model versioning

✓

Comfort talking with client stakeholders

Nice to have

✓

Fine-tuning or distillation experience

✓

Knowledge of ISO 42001 or the EU AI Act

✓

Audio or speech model experience

What we offer

✓

Paid certification exams and study time

✓

Learning budget for courses and conferences

✓

Health cover for you and your family

✓

Hybrid working from Zundal, Ahmedabad

Ready to apply?

It takes about 2 minutes. We reply within 3 business days.

Apply now

Team

Audio & AI

Location

Ahmedabad, India · Hybrid

Type

Full-time

Experience

5+ years

Salary

Competitive, shared on first call

Your hiring manager

AI Engineering Lead, Audio & AI team

WHAT HAPPENS NEXT

From application to offer in about 2 weeks

01

Apply

2 minutes

02

Intro call

30 minutes

03

Practical test

A short lab, not homework

04

Meet the team & offer

1 hour

APPLY

Apply for Senior AI Engineer (LLM & RAG)

Apply for this role

By applying, you agree to our Privacy Policy. Your details are only used for recruitment.

SIMILAR ROLES

You might also like

FAQ

Questions about this role

Questions about this role?

Email our HR team: hr@zuroth.com

What does a Senior AI Engineer (LLM & RAG) do at Zuroth?

You will lead LLM application builds for clients in the United States and Canada: retrieval pipelines, agents, evaluation and guardrails, from prototype to production with clear cost and quality targets. Design and ship LLM, RAG and agent features that are grounded, evaluated and ready for enterprise buyers.

What experience do I need for this role?

We look for 5+ years in software or ML, 2+ with LLM apps in production, strong Python and API design and hands-on with vector databases and at least one LLM provider. If you meet most of the requirements and are keen to learn, we still want to hear from you.

Is this role hybrid or remote?

This role is hybrid from our office in Zundal, Ahmedabad, with flexible days agreed with your manager. Most client work is for companies in the United States and Canada, so some days include a short overlap with US Eastern Time.

What does the hiring process look like?

There are four steps: a 2-minute application, a 30-minute intro call, a short practical exercise relevant to the role, and a one-hour meeting with the team before an offer. Most candidates hear back within 3 business days and finish in about 2 weeks.

What growth and learning support do you offer?

Every role has a learning budget for courses and conferences, paid certification exams with study time, and a growth path reviewed twice a year. Senior roles mentor others and help shape how our practices work.