Site Reliability Engineer - Data Engineering

About this role

<p class="_13fp8yk6c dzswju0 dzswju2"></p> <p data-local-id="128d98d1b4d6" data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="1 1 []">Join our dynamic and high-impact Data Engineering team, where you'll be responsible for our large-scale data collection, storage, access and query platforms. The work includes the safe and reliable operation of the platform, as well as projects to evolve and expand the capabilities. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights.&nbsp;</p> <p data-local-id="5f6028600f9b" data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="1 1 []">You will join a growing team of four in Sydney which is part of the larger APAC Data Team, and will collaborate with counterparts in Chicago, Mumbai and Amsterdam.</p> <p data-local-id="128d98d1b4d6" data-prosemirror-content-type="node" data-prosemirror-node-name="paragraph" data-prosemirror-node-block="true" data-pm-slice="1 1 []"></p> <p class="_13fp8yk6c dzswju0 dzswju2"><strong class="_13fp8yk6c dzswju0">Your Core Responsibilities:</strong></p> <ul> <li class="_13fp8yk6c dzswju0 dzswju2">Manage and monitor distributed systems, storage infrastructure, and data processing platforms, including Kafka, HDFS, Dremio, and in-house data pipelines.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Drive heavy focus on systems automation and CI/CD to enable rapid deployment of hardware and software solutions.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Collaborate closely with systems and network engineers, traders, and developers to support and troubleshoot their queries.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Stay up to date with the latest technology trends in the industry; propose, evaluate, and implement innovative solutions.</li> </ul> <p class="_13fp8yk6c dzswju0 dzswju2"><strong class="_13fp8yk6c dzswju0">Your Skills and Experience:</strong></p> <ul> <li class="_13fp8yk6c dzswju0 dzswju2">2+ years of experience in managing large-scale multi-petabyte data infrastructure in a similar role.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Knowledge of Linux system administration and internals, with proven ability to troubleshoot issues in Linux environments.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Experience in at least one of the following technologies: Kafka, HDFS, Kubernetes.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Working knowledge of Docker, Kubernetes, and Helm.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Experience with data access technologies such as Dremio and Presto.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Familiarity with workflow orchestration tools like Airflow and Prefect.</li> <li class="_13fp8yk6c dzswju0 dzswju2">Exposure to cloud platforms such as AWS, GCP, or Azure.</li> </ul><div class="content-conclusion"><p><strong>About Us</strong></p> <p>IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.</p> <p>&nbsp;</p></div>