Software Development Engineer in Test, ML/AI
at Sonyinteractiveentertainmentglobal
- Location
- United States, San Mateo, CA
- Posted
- 6d ago
pythonjavareactnode.jsawsgcpkubernetesdockerdatabricksllmci/cdgithub actions
at Sonyinteractiveentertainmentglobal
<div class="content-intro"><p><strong>Why Sony Interactive Entertainment?</strong></p> <p>Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As a subsidiary of Sony Group Corporation, we’re part of a proud legacy of innovation and excellence. SIE is a dynamic technology company, delivering cutting-edge hardware and network services to more than 100 million people and an entertainment leader, home to some of the most beloved and recognizable intellectual properties (IP) in the world. Our role at SIE is to create and nurture the experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity.</p></div><h2><span style="color: #000000;"><strong>Software Development Engineer In Test, ML/AI</strong></span></h2> <p><span style="color: #000000;">PlayStation offers more than just the Best Place to Play; it is also a top workplace. Today, we are a global entertainment leader. Our portfolio includes PlayStation®5, PlayStation®4, PlayStation®VR, PlayStation®Plus, and well-known software from PlayStation Studios.</span></p> <p><span style="color: #000000;">PlayStation works to foster an inclusive environment where employees feel supported and diversity is valued. We encourage individuals with passion and curiosity for innovation, technology, and play to apply for our open roles and become part of our growing distributed team.</span></p> <p><span style="color: #000000;">The PlayStation brand falls under Sony Interactive Entertainment, a wholly-owned subsidiary of Sony Group Corporation.</span></p> <p><span style="color: #000000;">At SIE, we believe in making play safer for everyone. Within our Information Security team, we protect our people, platforms, and products with smart, scalable, and thoughtful solutions. Our mission is to provide clear, actionable risk and security insights that guide the business and enable amazing player experiences.</span></p> <p><span style="color: #000000;">We’re building a team that thrives on collaboration, curiosity, and delivering real value. Come help us make a difference!</span></p> <h2><span style="color: #000000;"><strong>Overview</strong></span></h2> <p><span style="color: #444746;">We are hiring a Software Engineer in Test specializing in ML/AI quality, including automation for model evaluation, LLM-assisted test generation, and validation of AI-powered workflows</span><span style="color: #000000;">. The role includes guiding quality strategy and developing automation frameworks. You will also manage implementation for complex, cross-functional, machine learning-powered products and services. This role involves more than test development. You will lead quality initiatives from start to finish, ensuring teams stay synchronized, dependencies are managed, and releases are delivered confidently. You will work closely with ML, engineering, product, and infrastructure teams. You will shape how quality is built, monitored, and expanded while leading embedded QE efforts within projects.</span></p> <h2><span style="color: #000000;"><strong>What you’ll do</strong></span></h2> <ul> <li style="color: #000000 !important;"><span style="color: #000000;">Define and complete quality strategies, test plans, and automation coverage for ML-powered services and platform components.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Use LLMs and other AI-assisted techniques to generate, expand, and maintain high-value test cases for ML-powered workflows.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Design scenario-based test suites for AI features, including adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Lead QE efforts for multi-functional projects, driving risk assessment, dependency management, and release readiness.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Design, develop, and maintain scalable automation frameworks for backend services, APIs, and ML inference systems using Python and/or Java.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Build automated validation for ML and LLM outputs, including ranking behavior, score distributions, prompt/response quality, hallucination indicators, and probabilistic model evaluation.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Debug test failures, service anomalies, model inconsistencies, and AI behavior regressions to identify root causes and drive resolution.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Perform functional, integration, regression, API, end-to-end, performance, and reliability testing for distributed systems.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Improve automation reliability, reduce flakiness, and optimize execution efficiency.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Partner with engineering and ML teams to integrate automated testing into CI/CD pipelines and release workflows.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">Collaborate across teams to establish scalable quality standards, tooling, and guidelines.</span></li> </ul> <h2><span style="color: #000000;"><strong>Required qualifications</strong></span></h2> <ul> <li style="color: #000000 !important;"><span style="color: #000000;">Bachelor’s degree in Computer Science or equivalent practical experience.</span></li> <li style="color: #000000 !important;"><span style="color: #000000;">3+ years of experience as an SDET or QE engineer focused on backend and distributed systems.</span></li> <li style="color: #000000 !important;"><span style="color: #0000