RadixArk develops open-source and commercial tools that accelerate the inference and continual optimization of large AI models.
<div data-page-id="Tk0DdPSVaoiz1Jx8LC7jhatbpEc" data-lark-html-role="root" data-docx-has-block-data="false"> <h3 class="heading-3 ace-line old-record-id-Mo8id68lKoFoSwxC9Gtj9Bmrp6d">About the Role</h3> <div class="ace-line ace-line old-record-id-R3Fkd6rbtoEW4HxMjdOjYF25pHR">RadixArk is seeking a Member of Technical Staff, Developer Technology (DevTech) to make LLM inference and training dramatically faster, cheaper, and more accessible on modern GPU hardware. Our systems sit at the center of how modern AI is served and trained: SGLang is a high-performance inference engine that serves trillions of tokens daily across leading AI companies and research labs, and Miles is our reinforcement-learning post-training framework for large-scale LLM and MoE models. Your work directly advances our mission to democratize AI: every improvement you ship lowers the cost and raises the ceiling of what developers everywhere can build.</div> <div class="ace-line ace-line old-record-id-PGLXd4migowFtoxfOgqjbufmpEb"> </div> <div class="ace-line ace-line old-record-id-KqJfdkmypounenx4pYMjYLBVptV">As our technical face to a community of expert users and partners, you'll push the performance of SGLang and Miles through the lens of real production workloads. You'll profile and optimize GPU performance, enable new models and hardware, build kernels, deliver day-0 model support, and push the limits of inference and training. Working in close partnership with leading teams across the ecosystem, you'll turn their hardest, most ambiguous problems into concrete wins and clear guidance, and feed those improvements back into our systems and future roadmap.</div> <div class="ace-line ace-line old-record-id-YJLqd1l6FoTeHAxXqk4j5Ov9pcg"> </div> <h3 class="heading-3 ace-line old-record-id-SuCed5jcJooJI6xBq9sjwj4op1b">Key Responsibilities</h3> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-GGuvdgL4ko999BxcGLjjmeC1pPd" data-list="bullet"> <div><strong>Accelerate AI workloads</strong><strong>.</strong> Profile and optimize GPU performance for real production workloads on current and next-generation hardware, root-causing bottlenecks from kernels to distributed multi-node systems.</div> </li> <li class="ace-line ace-line old-record-id-KLJIdoABaownJnxAh1ijZg45pgd" data-list="bullet"> <div><strong>Go deep in one or two focus areas.</strong> The team collectively covers the full stack; each engineer specializes in one or two tracks:</div> <ul class="list-bullet2"> <li class="ace-line ace-line old-record-id-C2HXd3510o7zsUxhfigjiBWPpof" data-list="bullet"> <div><em>Inference performance</em>: engine tuning, benchmarking, long-context and multi-turn optimization, parallelism strategy, production debugging</div> </li> <li class="ace-line ace-line old-record-id-LRZ9dtFHUo25ABx0NMqjDW8Wpvb" data-list="bullet"> <div><em>Kernels and model/hardware enablement</em>: custom CUDA/ROCm/Triton kernels, low-precision quantization, day-0 support for new models on new silicon</div> </li> <li class="ace-line ace-line old-record-id-DPoJdjFZtoee7Vxw4OxjwRxPpT9" data-list="bullet"> <div><em>Speculative decoding</em>: draft-model training, acceptance-rate tuning, cross-platform kernel adaptation</div> </li> <li class="ace-line ace-line old-record-id-GOlqdUTcToMQxTxm8hAjhxrup3c" data-list="bullet"> <div><em>Training systems</em>: RL post-training with Miles, FP8 training, elasticity, long-rollout and long-context efficiency</div> </li> </ul> </li> <li class="ace-line ace-line old-record-id-YaRrd5wbEo6QfpxoE1HjNkJXpqe" data-list="bullet"> <div><strong>Partner directly with the ecosystem. </strong>Turn ambiguous, high-stakes problems from expert engineers at our key partners into concrete wins, clear technical guidance, and reproducible cookbooks.</div> </li> <li class="ace-line ace-line old-record-id-UjHhd3aIjoEvtexcS1VjgIKlpXb" data-list="bullet"> <div><strong>Enhance SGLang and Miles</strong><strong>.</strong> Feed user-driven improvements back into our open-source systems and roadmap, so every win compounds across the ecosystem.</div> </li> </ul> <div class="ace-line ace-line old-record-id-SMDbdjp0IovRFtxZ4APjxUe4psg"> </div> <h3 class="heading-3 ace-line old-record-id-CVEtdUOxqoxXWqxxSspjN5qhpPQ">Qualifications</h3> <div class="ace-line ace-line old-record-id-Yxwcd4jNvoGSw6xau6FjoBIlppf"><strong>Minimum Requirements</strong></div> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-QpvVd7n1OoYcIyxFgKHj4eP5pvd" data-list="bullet"> <div>4+ years of experience in GPU systems, LLM infrastructure, or performance engineering.</div> </li> <li class="ace-line ace-line old-record-id-HweidEu8DofOFtxia4ajyQgxpOg" data-list="bullet"> <div>Strong profiling and debugging skills: able to root-cause performance and correctness issues across the stack.</div> </li> <li class="ace-line ace-line old-record-id-GSUodVfoHoDCJZx1p7njRR5rpTe" data-list="bullet"> <div>Hands-on GPU programming experience in at least one of CUDA, ROCm, or Triton, and willingness to work across platforms.</div> </li> <li class="ace-line ace-line old-record-id-VrWPd6iEXoYrv6xI8KLj57jcpPe" data-list="bullet"> <div>Strong programming skills in Python plus C++ or CUDA.</div> </li> <li class="ace-line ace-line old-record-id-ELPjd8zJwouXYoxYxDrjCTP9pie" data-list="bullet"> <div>Comfortable making progress on hard, ambiguous problems with little context to start from, and fast to ramp into unfamiliar systems, codebases, and domains.</div> </li> <li class="ace-line ace-line old-record-id-ClVdd2rJJoD2y6xMNa2j7VR4pad" data-list="bullet"> <div>Ability to translate ambiguous asks into clear technical plans, verified cookbooks, and actionable recommendations, and to communicate credibly with expert engineering audiences.</div> </li> </ul> <div class="ace-line ace-line old-record-id-M5NkdDhFDo7ahcx7p1Oj3PvPp6f"><strong>Preferred (Bonus) Qualifications</strong></div> <ul class="list-bullet1"> <li class="ace-line ace-line old-record-id-FS0xdASDboy765xJsObj5KS