AI Agent Engineer

Location: Charlotte, North Carolina, United States
Posted: 5d ago

pythongodatabrickslangchainllmci/cd

Role description

About this role

<div class="content-intro">Here at Scout Motors, we're carrying forward the heritage of one of the most iconic American vehicles in history. A vehicle dating back to 1960. One that forged the path for future generations of rugged SUVs and trucks and will do so once again. But Scout is more than just a brand, it’s a legacy steeped in a culture of exploration, caretaking, and hard work. The Scout brand is all about respect. Respect for the past and the future by taking an iconic American brand that hasn’t been around for a while, electrifying it, digitizing it, and loading it with American innovation. Respect for communities by creating a company that stands for its people and its customers. Respect for both work and play, with vehicles that are equally at home at a camp site, a job site, or on a Tuesday commute. And respect for our customers by developing two powertrains that meet their requirements — an all-electric powertrain as well as the Harvester™ range extender powertrain which includes a built-in gas-powered generator with an estimated 500 miles of combined range. At Scout Motors, we empower our talented, inclusive, and entrepreneurial teams to innovate. What makes a Scout employee? Someone who is a visionary and a leader, who seeks new paths and shares lessons learned. A knowledgeable doer who collaborates across the company to build better. A go-getter with unrivaled passion. Join us at Scout Motors and be part of shaping the future of transportation. If you're ready to drive change and make history, apply now!</div><h4>What you’ll do</h4> Become part of an iconic brand that is set to revolutionize the electric pick-up truck & rugged SUV marketplace by achieving the following: <ul> <li>Design, develop and deploy AI agents on Databricks, owning the full lifecycle from prototyping to production – including versioning, monitoring, and maintenance of multiple agents running in parallel </li> <li>Build and maintain robust evaluation frameworks using MLflow's evaluation suite, implementing and customizing judges (built-in, guideline-based, and custom) to systematically assess agent quality across correctness, safety, and business-specific criteria </li> <li>Drive continuous quality improvement of AI agents through structured offline evaluation pipelines (curated datasets, benchmarks) and online production monitoring, leveraging MLflow tracing to understand agent execution patterns </li> <li>Collect, structure and incorporate human feedback from diverse stakeholder groups (engineering, quality, business) into evaluation workflows and agent improvement cycles </li> <li>Collaborate with Data Engineers, IT, and R&D to define data configurations and pipelines that feed AI agents with reliable, high-quality inputs </li> <li>Leverage and combine multiple data sources (on-site, off-site, connected vehicle data) to build agents that identify trends, anomalies, and quality signals at scale </li> <li>Surface agent outputs and quality insights to Quality business stakeholders through dashboards and visual reporting tools, translating complex model behavior into understandable and actionable information </li> <li>Identify and close data quality gaps, ensuring that data feeding into agents is clean, consistent, and continuously improving through well-defined requirements and automated checks </li> </ul> Location & Travel Expectations: <ul> <li>This role may be based out of the Scout Motors corporate headquarters in Charlotte, NC. </li> <li>This role requires 4-5 days per week in the office, with regular in-person meetings and events. </li> <li>Applicants should expect that the role will require the ability to convene with Scout colleagues in person and travel to participate in events on behalf of the company from time to time.</li> </ul> <h4>What you’ll bring </h4> We expect all Scout employees to have integrity, curiosity, resourcefulness, and strive to exhibit a positive attitude, as well as a growth mindset. You’ll be comfortable with change and flexible in a fast-paced, high-growth environment. You’ll take a collaborative approach to achieve ambitious goals. Here's what else you'll bring:  <ul> <li>Bachelor's Degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, or a related field – or equivalent practical experience </li> <li>4+ years of experience in MLOps, AI/ML engineering, or data engineering in production environments<span data-ccp-props="{"134245417":false,"335559685":835,"335559738":120,"335559739":120,"469777462":[839],"469777927":[0],"46

AI Agent Engineer

Role description

About this role

Related roles