Software Development Engineer in Test
at Clockwork Systems · 11-50 employees
Series B · $20.5M · Sep 2025
- Work model
- Onsite
- Location
- On Site, Palo Alto, California
- Posted
- 5d ago
pythongoawsgcpazurekubernetesdockerterraformpytorchci/cdgithub actions
at Clockwork Systems · 11-50 employees
Clockwork builds high-precision clock-synchronization and latency-observability software—FleetIQ GPU fabric and Latency Sensei—providing sub-microsecond sync, microsecond cluster visibility, hardware-agnostic GPU support, and congestion detection.
<div class="content-intro"><h4><strong>About Clockwork Systems</strong></h4> <p><strong>Clockwork.io – Software Driven Fabrics to increase GPU cluster utilization</strong></p> <p>Clockwork Systems was founded by Stanford researchers and veteran systems engineers who share a vision for redefining the foundations of distributed computing. As AI workloads grow increasingly complex, traditional infrastructure struggles to meet the demands of performance, reliability, and precise coordination. Clockwork is pioneering a software-driven approach to AI fabrics by delivering <strong>cross-stack observability</strong> to catch and quickly resolve problems, <strong>workload fault tolerance</strong> to keep jobs running through failures, and <strong>performance acceleration</strong> that dynamically routes and paces traffic to avoid congestion.</p> <h4>To learn more, visit<a href="https://www.clockwork.io"> www.clockwork.io</a>.</h4></div><h3><strong>Summary</strong></h3> <p>We are looking for a <strong>Software Development Engineer in Test</strong> who thrives in fast-paced startup environments and is excited to be a co-owner and major contributor to our testing and CI/CD infrastructure. You will play a critical role in ensuring the quality, performance, and reliability of every release before it reaches our customers.</p> <p>Our software runs on production <strong>GPU and CPU</strong> clusters across Ethernet, RDMA/RoCE, and InfiniBand networks. Testing here means standing up real multi-node clusters, running real workloads against them, and measuring what happens. This is a <strong>hands-on engineering role</strong>, not a manual QA position. You will be deeply embedded in our engineering team, responsible for building robust automation, maintaining pipelines, and contributing directly to the product during quieter times. A meaningful part of this role is <strong>DevOps work</strong>, not just test authoring.</p> <h3><strong>Responsibilities</strong></h3> <ul> <li>Design, build, and maintain integration, regression, and end-to-end tests for <strong>distributed systems</strong> running on Kubernetes, Slurm, and bare-metal GPU/CPU clusters</li> <li>Extend our in-house end-to-end test automation framework and share ownership of the <strong>CI/CD testing infrastructure and pipeline</strong></li> <li>Build and run <strong>performance and scale benchmarks</strong>, and catch regressions before they ship</li> <li>Automate cluster lifecycle and environment management across cloud and bare-metal environments</li> <li>Ensure all code releases meet high quality standards before shipping to customers</li> <li>Collaborate closely with engineers to identify gaps in test coverage and build tools or frameworks to fill them</li> <li>Investigate and diagnose build failures, flaky tests, and regressions</li> <li>Contribute to engineering efforts beyond QA when appropriate (feature development, tooling, etc.)</li> </ul> <h3><strong>Qualifications</strong></h3> <ul> <li><strong>3+ years</strong> of experience in a Test Engineering, DevOps, or QA role with a strong technical background</li> <li>Strong <strong>Python</strong>; comfortable reading and debugging Go</li> <li>Demonstrated expertise in building <strong>automated test scripts and frameworks</strong> from scratch</li> <li>Proven experience with <strong>CI/CD tools</strong> such as GitHub Actions, Jenkins, or GitLab CI, and testing frameworks such as pytest and Playwright</li> <li>Experience with public cloud infrastructure (GCP, AWS, or Azure)</li> <li>Familiarity with release management and deployment processes, including versioning, release candidates, and rollout verification</li> <li>Working knowledge of Linux, containerization, and orchestration (Docker, Kubernetes, Helm)</li> <li>Strong debugging, problem-solving, and communication skills</li> <li>A startup mindset, self-motivated, adaptable, and eager to take ownership</li> </ul> <h3><strong>Nice to have</strong></h3> <ul> <li>Experience with AI/ML infrastructure: GPUs, RDMA/RoCE or InfiniBand, NCCL, DCGM, PyTorch training jobs</li> <li>Workload managers and schedulers (Slurm, Kubeflow/PyTorchJob)</li> <li>Build systems at scale (Bazel), infrastructure-as-code (Terraform)</li> <li>Chaos or fault-injection testing of distributed systems</li> </ul> <h3><strong>Why Join Us</strong></h3> <ul> <li>Be part of a <strong>foundational team</strong> shaping the future of infrastructure software</li> <li>Work onsite in a collaborative environment in <strong>Palo Alto</strong></li> <li>Opportunity to grow into broader engineering roles</li> </ul> <p><strong>Enjoy</strong></p> <ul> <li>Challenging projects.</li> <li>A friendly and inclusive workplace culture.</li> <li>Competitive compensation.</li> <li>A great benefits package.</li> <li>Catered lunch.</li> </ul> <p>Compensation for this position will vary based on the skills and experience you bring, as well as internal equity considerations. For candidates hired at the posted level, the expected base salary range is $130,000 - $175,000. The offered compensation package may also include stock options or other equity awards, subject to Clockwork’s equity program and applicable approvals.<br>In addition to cash compensation, this role is eligible to participate in the company’s equity program, which may include stock options granted in accordance with the company’s equity plan and subject to approval and applicable vesting schedules.</p><div class="content-conclusion"><p><strong>Clockwork Systems is an equal opportunity employer.</strong> We are committed to building world-class teams by welcoming bright, passionate individuals from all backgrounds. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, religion, age, sex, sexual orientation, gender identity or expression, national origin, disability, or protected veteran status. We believe diversity drives innovation, and we grow stronger together.</p></div>