Senior Software Engineer - AI Gateway & Agentic AI Solutions
EXL · India · full-time
Source: Adzuna
Posted 30/9/2026
How to get ready for this job
We’ll help you choose the best next step before you apply.
A strong path is: practice the most relevant skills, tailor your resume to this role, then run a mock interview before you apply.
Description Top 5 Responsibilities Architect and implement the AI Gateway. Design and build an Azure-native LLM gateway in C# providing unified ingress across multiple model providers (Azure OpenAI, Azure AI Foundry models, and others) - covering intelligent routing, fallback/load balancing, rate limiting and token-quota enforcement, semantic caching, and centralized API key/secret management. Reference the LiteLLM feature set as the functional bar to hit. Build the observability and governance…
Share:
ATS Match
Sign in to run ATS match for this job.