Machine Learning Research Engineer (LLMs & AI Systems)

About this role

<div class="content-intro"><p>Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency. With AI redefining the computing paradigm, solutions must evolve to unify innovations in software models, compilers, platforms, networking, and semiconductors. Our diverse team of technologists have developed a high performance RISC-V CPU from scratch, and share a passion for AI and a deep desire to build the best AI platform possible. We value collaboration, curiosity, and a commitment to solving hard problems. We are growing our team and looking for contributors of all seniorities.</p></div><p>Tenstorrent is building next-generation AI systems that push the boundaries of model training, inference, and large-scale distributed compute. The ML Models team sits at the intersection of cutting-edge AI research and high-performance hardware, bringing state-of-the-art machine learning models to life on Tenstorrent’s custom AI accelerators. From training large language models to optimizing inference performance at scale, this team works across the full stack to turn breakthrough research into production-ready AI systems. If you are passionate about advancing the frontier of AI research, inference and training optimizations, this is an opportunity to shape how future AI models are developed and deployed.</p> <p>This role is hybrid, based out of Toronto, ON and Boston, MA.</p> <p>We welcome candidates at various experience levels for this role. During the interview process, candidates will be assessed for the appropriate level, and offers will align with that level, which may differ from the one in this posting.</p> <p>&nbsp;</p> <p><strong>Who You Are</strong></p> <ul> <li data-section-id="utngix" data-start="20" data-end="104">Strong Python and PyTorch experience developing and training deep learning models.</li> <li data-section-id="1ti37no" data-start="105" data-end="188">Deep understanding of ML architectures, LLM training, and inference optimization.</li> <li data-section-id="1f8xd0h" data-start="189" data-end="256">Hands-on experience training large-scale machine learning models.</li> <li data-section-id="10ict0e" data-start="257" data-end="342">4+ years of industry and/or academic experience in ML research and LLM development.</li> <li data-section-id="1e21aum" data-start="343" data-end="427">PhD, published research, or experience with speculative decoding is highly valued.</li> </ul> <p><strong>What We Need</strong></p> <ul> <li data-section-id="18jeun8" data-start="450" data-end="541">Lead research and development efforts focused on LLM training and inference optimization.</li> <li data-section-id="19tj74x" data-start="542" data-end="625">Train, evaluate, and optimize state-of-the-art AI models on Tenstorrent hardware.</li> <li data-section-id="1bndex5" data-start="626" data-end="768">Improve performance through techniques such as speculative decoding, quantization, kernel fusion, flash attention, and distributed training.</li> <li data-section-id="1sez5f2" data-start="769" data-end="871">Investigate system bottlenecks and collaborate cross-functionally to drive performance improvements.</li> <li data-section-id="1po50rs" data-start="872" data-end="951">Translate cutting-edge ML research into scalable, production-ready solutions.</li> </ul> <p><strong>What You Will Learn</strong></p> <ul> <li data-section-id="z91ihg" data-start="981" data-end="1063">How to optimize AI models on custom AI accelerators from application to silicon.</li> <li data-section-id="1r2ths8" data-start="1064" data-end="1139">How large-scale ML systems are deployed, tuned, and scaled in production.</li> <li data-section-id="jeaiv3" data-start="1140" data-end="1223">How hardware, compiler, kernel, and ML teams collaborate to maximize performance.</li> <li data-section-id="agehh7" data-start="1224" data-end="1309" data-is-last-node="">The challenges and tradeoffs of scaling modern AI workloads across custom hardware.</li> </ul> <p>&nbsp;</p> <p><em>Compensation for all engineers at Tenstorrent ranges from $100k - $500k including base and variable compensation targets. Experience, skills, education, background and location all impact the actual offer made.</em></p> <p><em>Tenstorrent offers a highly competitive compensation package and benefits, and we are an equal opportunity employer.</em></p><div class="content-conclusion"><p><em>This offer of employment is contingent upon the applicant being eligible to access U.S. export-controlled technology. &nbsp;Due to U.S. export laws, including those codified in the U.S. Export Administration Regulations (EAR), the Company is required to ensure compliance with these laws when transferring technology to nationals of certain countries (such as EAR Country Groups D:1, E1, and E2). &nbsp; These requirements apply to persons located in the U.S. and all countries outside the U.S. &nbsp;As the position offered will have direct and/or indirect access to information, systems, or technologies subject to these laws, the offer may be contingent upon your citizenship/permanent residency status or ability to obtain prior license approval from the U.S. Commerce Department or applicable federal agency. &nbsp;If employment is not possible due to U.S. export laws, any offer of employment will be rescinded.</em></p></div>