Backend Engineer, AI Engineering: Duo Chat

About this role

<div class="content-intro"><p>GitLab is the intelligent orchestration platform for DevSecOps. GitLab enables organizations to increase developer productivity, improve operational efficiency, reduce security and compliance risk, and accelerate digital transformation. More than 50 million registered users and more than 50% of the Fortune 100* trust GitLab to ship better, more secure software faster.</p> <p>The same principles built into our products are reflected in how our team works: we embrace AI as a core productivity multiplier, with all team members expected to incorporate AI into their daily workflows to drive efficiency, innovation, and impact. GitLab is where careers accelerate, innovation flourishes, and every voice is valued. Our high-performance culture is driven by our values&nbsp;and continuous knowledge exchange, enabling our team members to reach their full potential while collaborating with industry leaders to solve complex problems. <a href="https://www.youtube.com/watch?v=OuZIb5zszQI">Co-create the future with us</a> as we build technology that transforms how the world develops software.</p> <p>*<em>Fortune 500® is a registered trademark of Fortune Media IP Limited, used under license. Claim based on GitLab data. Fortune 100 refers to the top 20% ranked companies in the 2025 Fortune 500 list, published in June 2025. Fortune and Fortune Media IP Limited are not affiliated with, and do not endorse products or services of GitLab.</em></p></div><h3><strong>An overview of this role</strong></h3> <p>As a Backend Engineer on the Chat Engine team, you'll build the engine behind GitLab Duo Chat, the conversational AI experience for GitLab. You'll work primarily in Python to build and maintain our agentic runtime: the Flow Registry, LangGraph flows, and the Duo Workflow Service. You'll also work in the GitLab Rails monolith, where Chat connects with the product.</p> <p>You'll own scoped parts of the system, ship small features and improvements with minimal guidance, and collaborate with the team on larger projects. You'll work alongside senior and staff engineers who will partner with you on design and support your growth.</p> <h3><strong>What you’ll do</strong></h3> <ul> <li>Develop secure, well-tested, and performant features and improvements for GitLab Duo Chat.</li> <li>Implement and extend agentic flows in Python using LangGraph, registered through the Flow Registry and served by the Duo Workflow Service.</li> <li>Integrate Chat capabilities with the GitLab Rails monolith, including its GraphQL application programming interface (API).</li> <li>Write maintainable code that meets our internal standards for a high-scale environment, including tests with every merge request.</li> <li>Review code within our Code Review Guidelines and respond promptly to contributions from people who don't work for GitLab.</li> <li>Identify technical debt and propose and implement solutions that improve the team's efficiency.</li> <li>Collaborate with Product Management, User Experience, and Frontend team members to improve product quality, security, and performance.</li> <li>Participate in Tier 2 or Tier 3 weekday, weekend, and occasional night on-call rotations to help troubleshoot product operations, security operations, and urgent engineering issues.</li> </ul> <h3 style="line-height: 1.5;"><strong>What you’ll bring</strong></h3> <ul> <li style="line-height: 1;">Professional experience with Python, including building and testing production services.</li> <li>Working proficiency with Ruby on Rails, or a willingness to learn it, since a meaningful part of Chat lives in the GitLab monolith.</li> <li>Exposure to, or strong interest in, building on top of large language models, including prompting, tool or function calling, evaluation, and the failure modes of non-deterministic systems.</li> <li>Experience designing and building APIs, including diagnosing and optimizing performance issues, and comfort working with well-documented third-party services.</li> <li>A security-minded development approach that applies secure coding guidelines early in the development process.</li> <li>Clear and concise written communication about technical problems and iterative solutions, which is essential in a remote, largely asynchronous environment.</li> <li>Manage work independently, organize priorities, and ask for help when an issue is taking longer than expected.</li> <li>Demonstrate GitLab's values by collaborating effectively in a fully remote, intensely iterative environment.</li> <li>Experience with LangGraph, LangChain, or a comparable agent orchestration framework.</li> <li>Experience with GraphQL and RSpec.</li> <li>Experience with the GitLab product as a user or contributor.</li> <li style="line-height: 1.5;">Experience working on a remote, globally distributed team.</li> </ul> <h3><strong>About the team</strong></h3> <p>We're part of GitLab's AI Engineering organization and own the AI-powered chat experience embedded across the GitLab platform. Chat Engine is the backend-focused team within the Duo Chat group. We're backend, frontend, and AI specialists working asynchronously across time zones, using issues, merge requests, and documentation as our main collaboration tools. We focus on expanding generative and agentic AI capabilities, improving the performance and reliability of chat workflows, and strengthening the debugging and testing foundations that help us run AI features safely at scale.</p> <div>&nbsp;</div><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p><em>The base salary range for this role’s listed level is currently for residents of the&nbsp;United States only. This range is intended to reflect the role's base salary rate in locations throughout the US.&nbsp;Grade level and salary ranges are determined through interviews and a review of education, experience, knowledge, skills, abilities of the applicant, equity with other team members, alignment with