Sr. Platform Engineer - (Cloudera CDP & DevOps)

About this role

We are looking for an experienced Technology Engineer with strong expertise in Cloudera CDP, Hadoop ecosystem, DevOps, OpenShift, and CI/CD to support enterprise Technology Platforms & Data Platforms initiatives. The ideal candidate should possess hands-on production support experience, platform engineering expertise, automation capabilities, and strong knowledge of containerized data platforms. This role requires ownership of Cloudera platform administration, performance optimization, infrastructure automation, observability, and CI/CD implementation within large-scale enterprise environments. Requirements Key Responsibilities Provide Tier-2 production support for enterprise Cloudera CDP environments. Install, configure, administer, and maintain Cloudera Data Platform (CDP) clusters. Perform installation, upgrades, patching, and maintenance of CDP 7.1.9 (or latest versions). Administer and support Cloudera Data Services (CDS) 1.5.4 / 1.5.5 and latest releases. Enable and maintain enterprise security controls across Cloudera CDP environments. Optimize Hadoop cluster performance, resource utilization, and overall platform stability. Collaborate with Data Engineering teams to optimize Spark workloads and improve application performance. Troubleshoot and resolve production issues related to: Spark Jobs Hive Jobs YARN Jobs Support CDP containerization using Cloudera Data Services. Design, develop, and maintain infrastructure automation for platform operations. Build and maintain automated CI/CD pipelines for analytics and data engineering workloads. Automate infrastructure provisioning, deployment, configuration management, and operational tasks. Implement observability, monitoring, logging, and alerting solutions for platform health. Automate security, compliance, and regulatory validation processes. Plan and execute automated patch management across enterprise environments. Work closely with Infrastructure, DevOps, Security, Data Engineering, and Platform teams to ensure reliable platform operations. Participate in Agile ceremonies and contribute to continuous engineering improvements. Required Technical Skills Cloudera & Hadoop Strong hands-on experience supporting Cloudera CDP production environments. Experience with: Cloudera Data Platform (CDP) CDP 7.1.9 or latest versions Cloudera Data Services (CDS) 1.5.4 / 1.5.5 Hadoop ecosystem administration. Spark administration and performance optimization. Hive administration and troubleshooting. YARN administration and troubleshooting. Cluster installation, upgrades, maintenance, and optimization. DevOps & Automation Strong experience with: Ansible Shell Scripting Terraform Groovy Python automation Experience developing infrastructure automation and operational workflows. CI/CD Hands-on experience building and managing automated pipelines using: GitHub Actions Jenkins ArgoCD Experience implementing CI/CD for data engineering and analytics workloads. Containers & Platform Engineering Hands-on experience with: Docker Podman Kubernetes OpenShift (OCP) Experience deploying and managing containerized data platform environments. Observability & Monitoring Experience implementing: Platform monitoring Logging Alerting Observability frameworks Performance monitoring Security & Infrastructure Experience with: CDP security implementation Authentication & authorization Security hardening Automated security checks Regulatory compliance automation Automated patch management Operating Systems & Version Control Linux system administration Linux networking fundamentals Git version control Source code management best practices Required Competencies Strong production support experience within enterprise environments. Excellent troubleshooting and root cause analysis skills. Strong understanding of distributed data platforms. Ability to optimize platform performance and reliability. Strong ownership mindset with focus on operational excellence. Excellent communication and stakeholder collaboration skills. Ability to work effectively in Agile engineering environments. Experience working across Infrastructure, DevOps, and Data Engineering teams. Strong analytical and problem-solving capabilities. Preferred Experience Enterprise Data Platform Engineering. Large-scale Hadoop & Cloudera environments. Data Platform Operations. Platform Automation & Infrastructure as Code. DevOps Engineering. Cloud-native platform engineering. OpenShift-based enterprise deployments.