Data Engineer

About this role

<p>We are seeking a dedicated and experienced Data Engineer to join our Chicago team. The ideal candidate is energized by working in a cutting-edge environment that enables IMC to continue to be at the forefront of the evolving global financial markets.</p> <p><strong>Core Responsibilities</strong></p> <ul> <li>Architect, develop and deploy our Big Data environment (Kafka, Hadoop, Dremio, etc.)</li> <li>Build, deploy, and monitor our data processing pipelines (Java, Python, Spark, Flink)</li> <li>Collaborate with development teams on data modeling, data ingestion, and capacity planning</li> <li>Work with users to ensure data integrity and availability</li> <li>Act as a Big Data SME and consult on a variety of data-related questions from users and developers</li> </ul> <p><strong>Skills and Experience:</strong></p> <ul> <li>5+ years experience working in a mature data engineering environment</li> <li>3+ years of experience building Kafka streaming applications and/or maintaining Kafka clusters</li> <li>2+ years of experience building applications/pipelines with Big Data backends (S3, HDFS, Databricks, Iceberg, etc)</li> <li>Experience with Apache Spark, Apache Flink or similar tools</li> <li>Strong Java, Python, and SQL development skills</li> <li>Experience with common data-science toolkits, especially python-based</li> <li>Hands-on experience with Kubernetes and Docker</li> <li>Experience with monitoring tools such as Prometheus/Grafana, Alert Manager, Alerta and OpsGenie</li> <li>Strong statistical analysis skills</li> <li>Demonstrated ability to troubleshoot and conduct root-cause analysis</li> <li>Unix scripting experience (bash, python, etc.)</li> </ul> <p>&nbsp;</p> <p><span style="color: rgb(221, 234, 255);">#LI-DNP</span></p><div class="content-pay-transparency"><div class="pay-input"><div class="description"><p>The Base Salary range for the role is included below. Base salary is only one component of total compensation; all full-time, permanent positions are eligible for a discretionary bonus and benefits, including paid leave and insurance.&nbsp;Please visit <a href="https://www.imc.com/us/careers/benefits">Benefits - US | IMC Trading</a> for more comprehensive information.</p></div><div class="title">Salary Range</div><div class="pay-range"><span>$175,000</span><span class="divider">—</span><span>$225,000 USD</span></div></div></div><div class="content-conclusion"><p><strong>About Us</strong></p> <p>IMC is a global trading firm powered by a cutting-edge research environment and a world-class technology backbone. Since 1989, we’ve been a stabilizing force in financial markets, providing essential liquidity upon which market participants depend. Across our offices in the US, Europe, Asia Pacific, and India, our talented quant researchers, engineers, traders, and business operations professionals are united by our uniquely collaborative, high-performance culture, and our commitment to giving back. From entering dynamic new markets to embracing disruptive technologies, and from developing an innovative research environment to diversifying our trading strategies, we dare to continuously innovate and collaborate to succeed.</p> <p>&nbsp;</p></div>