Staff Machine Learning Systems Engineer

About this role

<div class="content-intro"><div class="c-message_kit__blocks c-message_kit__blocks--rich_text"> <div class="c-message__message_blocks c-message__message_blocks--rich_text" data-qa="message-text"> <div class="p-block_kit_renderer" data-qa="block-kit-renderer"> <div class="p-block_kit_renderer__block_wrapper p-block_kit_renderer__block_wrapper--first"> <div class="p-rich_text_block"> <div class="p-rich_text_section">Reddit is a community of communities. It’s built on shared interests, passion, and trust, and is home to the most open and authentic conversations on the internet. Every day, Reddit users submit, vote, and comment on the topics they care most about. With 100,000+ active communities and approximately 130 million daily active unique visitors, Reddit is one of the internet’s largest sources of information. For more information, visit <a class="c-link" href="http://www.redditinc.com/" target="_blank" data-stringify-link="http://redditinc.com" data-sk="tooltip_parent">www.redditinc.com</a>.</div> </div> </div> </div> </div> </div></div><p><strong>Who We Are: </strong><strong><br></strong>The Machine Learning Platform team at Reddit is a high-impact team that owns the infrastructure that powers recommendations, content discovery, user and content quantification, while directly impacting other teams such as Growth, Ads, Feeds, and Core Machine Learning teams.</p> <p><strong>What You’ll Do:</strong><strong><br></strong>As a&nbsp;<strong>Staff</strong> <strong>ML Infrastructure Engineer,</strong> you will lead development of a platform for large scale ML models at Reddit.</p> <ul> <li>Design end-to-end model lifecycle patterns (MLOps) to boost velocity of development for ML engineers, including data preparation, model management, experiment tracking, and more</li> <li>Zero-to-one development and support of a graph ML codebase and platform that abstracts away common patterns and enables greater model scalability and iteration</li> <li>Collaborate with ML engineers on performance tuning, including improving model training time, efficiency, and GPU training costs in a large, distributed ML training environment</li> <li>Optimize batch data processing within a data warehouse and with tools such as Apache Beam, Apache Spark, Ray Data, and more</li> <li>Architect pipelines to build and maintain massive graph data structures on the order of billions of nodes and tens of billions of edges</li> </ul> <p><strong>Who You Might Be:</strong></p> <ul> <li>8+ years of experience in ML infrastructure, including model training and model deployments</li> <li>Hands-on experience with ML optimization, including memory and GPU profiling</li> <li>Deep experience with cloud-based technologies for supporting an ML platform, including tools like GCP BigQuery, Google Cloud Storage, infrastructure-as-code (Terraform), and more</li> <li>Hands-on experience administering and integrating MLOps tools for experiment tracking, model serving, and model registries (e.g. MLflow or Wandb)</li> <li>Proficiency with the common programming languages and frameworks of ML, such as Python, PyTorch, Tensorflow, etc.</li> <li>Deep experience working with distributed training frameworks, including Ray and Kubernetes</li> <li>Strong focus on scalability, reliability, performance, and ease of use. You are an undying advocate for platform users and have a deep intuition for the machine learning development lifecycle.</li> <li>Strong organizational &amp; communication skills</li> <li>Experience working with graph databases (Neo4j, JanusGraph, TigerGraph) is a big plus</li> <li>Experience working with graph neural networks (GNNs) and associated graph ML frameworks (PyTorch Geometric, Deep Graph Library) is a big plus</li> </ul><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p><strong>Pay Transparency:</strong></p> <p>This job posting may span more than one career level.</p> <p>In addition to base salary, this job is eligible to receive equity in the form of restricted stock units, and depending on the position offered, it may also be eligible to receive a commission. Additionally, Reddit offers a wide range of benefits to U.S.-based employees, including medical, dental, and vision insurance, 401(k) program with employer match, generous time off for vacation, and parental leave. To learn more, please visit <a href="https://www.redditinc.com/careers/" target="_blank">https://www.redditinc.com/careers/</a>.</p> <p>To provide greater transparency to candidates, we share base salary ranges for all US-based job postings regardless of state. We set standard base pay ranges for all roles based on function, level, and country location, benchmarked against similar stage growth companies. Final offer amounts are determined by multiple factors including, skills, depth of work experience and relevant licenses/credentials, and may vary from the amounts listed below.</p></div><div class="title">The base salary range for this position is:</div><div class="pay-range"><span>$230,000</span><span class="divider">—</span><span>$322,000 USD</span></div></div></div><div class="content-conclusion"><p>In select roles and locations, the interviews will be recorded, transcribed and summarized by artificial intelligence (AI). You will have the opportunity to opt out of recording, transcription and summarization prior to any scheduled interviews.</p> <p><span style="font-weight: 400;">During the interview, we will collect the following categories of personal information: Identifiers, Professional and Employment-Related Information, Sensory Information (audio/video recording), and any other categories of personal information you choose to share with us. We will use this information to evaluate your application for employment or an independent contractor role, as applicable.&nbsp; We will not sell your personal information or disclose it to any third party for their marketing purposes.&nbsp; We will delete any recording of your i