DevOps Engineer
- Location
- Budapest
- Posted
- 5d ago
pythonkafkaawskubernetesdockerterraformlambdasnowflakesparkairflowci/cd
<h2><strong>The Wow</strong></h2> <p>This role will design and implement the automation of our data platform. The focus will be on enabling and optimizing the data lifecycle by applying DevOps practices, such as <em>Infrastructure as Code (IaC)</em>, <em>CI/CD</em>, and <em>GitOps</em>, to ensure the efficiency, reliability, and speed of our data deliveries.</p> <p> </p> <h2><strong>A taster of what you will be involved with: </strong></h2> <ul> <li>Develop and maintain the data platform's infrastructure using <strong>Terraform</strong>.</li> <li>Implement and manage CI/CD pipelines for the automation of data and ai processes and pipelines.</li> <li>Automate the provisioning, configuration, and monitoring of resources in <strong>AWS</strong>.</li> <li>Apply <strong>GitOps</strong>principles to manage configurations and deployments.</li> <li>Ensure the security, scalability, and resilience of the infrastructure through automation.</li> <li>Collaborate with Data Engineers to optimize the data development lifecycle (DDLC).</li> <li>Own the automation and infrastructure of orchestration tools like <strong>Airflow</strong>.</li> <li>Document the automation architecture and deployment processes.</li> </ul> <p> </p> <h2><strong>Must haves:</strong></h2> <ul> <li>Solid experience with <em>Infrastructure as Code (IaC)</em> tools, especially Terraform<strong>.</strong></li> <li>Experience in creating and managing<strong> CI/CD</strong> pipelines (e.g., Github Action, AWS CodePipeline).</li> <li>Deep knowledge of version control tools and workflows with<strong> GIT.</strong></li> <li>Experience in automation scripting with<strong> Python, AWS CLI, Spark.</strong></li> <li>Knowledge of<strong> </strong>AWS services automation and management.|</li> </ul> <p> </p> <h2><strong>Nice to haves:</strong></h2> <ul> <li>Familiarity with the AWS data ecosystem (<strong>S3, Glue, Lambda, Redshift, Snowflake</strong>).</li> <li>Familiarity with orchestrators like <strong>Airflow</strong>.</li> <li>Familiarity with data streaming technologies such as <strong>Kafka</strong>.</li> <li>Knowledge of monitoring and visualization tools (<strong>Prometheus, Grafana, CloudWatch</strong>).</li> <li>Basic knowledge of containerization (Docker, Kubernetes).</li> <li>Excellent verbal and written English communication skills.</li> </ul> <p> </p> <h2><strong>What we are looking for</strong></h2> <ul> <li>University Degree in Computer Science, Engineering or equivalent</li> <li>At least 2 years of experience in DataOps, DevOps, or infrastructure automation</li> <li>Excellent verbal and writing English communication skills</li> <li>Good learning mindset</li> <li>Able to set priorities and multitask</li> </ul> <p> </p> <h2>What we offer</h2> <ul> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="10" data-aria-level="1"><span data-contrast="auto">Fitness-wellness allowance </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 🧗♂️</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="11" data-aria-level="1"><span data-contrast="auto">Company mobile phone for private use with 100 GB </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 📱</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="12" data-aria-level="1"><span data-contrast="auto">Annual HUF devaluation compensation </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 💡</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="13" data-aria-level="1"><span data-contrast="auto">Hybrid model: 3 days in the office 🏢 </span><span data-contrast="auto"> & 2 days from home </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 🏠</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="14" data-aria-level="1"><span data-contrast="auto">Private Health Insurance </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 🩺</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"multilevel"}" data-aria-posinset="15" data-aria-level="1"><span data-contrast="auto">Career development </span><span data-ccp-props="{"134233117":true,"134233118":true,"201341983":0,"335551550":6,"335551620":6,"335559739":200,"335559740":240}"> 📈</span></li> <li data-leveltext="" data-font="Symbol" data-listid="19" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,