TrueFoundry provides a Kubernetes-based, cloud-agnostic PaaS that automates ML workflows—model deployment, autoscaling, monitoring, RAG/agent workflows, GPU/memory optimization, and centralized access controls for multi-cloud and on-premises environments.
<p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>About TrueFoundry</strong></span></p> <p>Every production AI system whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.</p> <p><strong>That infrastructure layer is being built right now.</strong></p> <p>We're TrueFoundry, and we're building it. We're looking for a Backend Intern to join our Engineering team.</p> <h2><span style="font-size: 12pt; font-family: arial, helvetica, sans-serif;"><strong>The Problem We're Solving</strong></span></h2> <p>Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.</p> <p>The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.</p> <p>You need a control plane that handles:</p> <ul> <li>Intelligent routing with observability, cost policies, and fallback logic</li> <li>Centralized tool and MCP server management with security and lifecycle controls</li> <li>Agent orchestration with governance and guardrails</li> <li>A unified compute layer to run self-hosted models, custom tools, and agents</li> </ul> <p>We've built two products to solve this:</p> <p><strong>AI Gateway</strong> is the control plane five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.</p> <p><strong>AI Deploy</strong> is the compute layer of Kubernetes-based platform that abstracts ML workloads as standard software primitives, so everything runs on unified infrastructure.</p> <p>We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.</p> <p>Contribution to open source repos is preferred<br>* Experience writing concurrent and distributed programs, AWS lambda, Kubernetes, Docker, Spark is preferred.<br>* Experience with one relational &amp; 1 non-relational DB is preferred<br>* Prior work in the ML domain will be a big boost<br><br>**What You’ll Do**<br>* Help realize the product vision: Production-ready machine learning models with monitoring within moments, not months.<br>* Help companies deploy their machine learning models at scale across a wide range of use-cases and sectors.<br>* Build integrations with other platforms to make it easy for our customers to use our product without changing their workflow.<br>* Write maintainable, scalable performant python code<br>* Building gRPC, rest API servers<br>* Working with Thrift, Protobufs, etc.</p> <p>Education: <strong data-start="6" data-end="47">IITians are highly preferred for education</strong>, especially in engineering and technology.</p> <p><strong>Traits we are looking for:</strong> Ownership, ability to execute, hustle and think out of the box, data driven decision making, be comfortable with more unknowns than knowns</p> <p><strong>What you'll be doing?</strong> You will play a crucial role in helping us achieve our growth objectives. Your primary responsibility will be to assist in building and optimizing both our Outbound funnels.</p> <p><span style="font-family: arial, helvetica, sans-serif; font-size: 12pt;"><strong>What do we do?</strong></span></p> <p>TrueFoundry is a Cloud-native PaaS for Machine learning teams to build, deploy and ship ML/LLM Applications on their own cloud/on-prem Infra in a faster, scalable, cost efficient way with the right governance controls, allowing them to achieve 90% faster time to value than other teams.</p> <p>TrueFoundry abstracts out the engineering required and offers GenAI accelerators - LLM PlayGround, LLM Gateway, LLM Deploy, LLM Finetune, RAG Playground and Application Templates that can enable an organisation to speed up the layout of their overall GenAI/LLMOps framework. Enterprises can plug and play these accelerators with their internal systems as well as build on top of our accelerators to enable a LLMOps platform of their choice to the GenAI developers. TrueFoundry is modular and completely API driven, has native integration with popular tools in the market like LangChain, VectorDBs, GuardRails, etc.</p>