Senior Software Engineer, Data & Platform Services

About this role

<p><strong>Location:</strong> Berlin, Germany&nbsp; <strong>Remote Status:</strong> Fully Remote (#LI-Remote)</p> <p>LivePerson (NASDAQ: LPSN) is a leader in trusted enterprise conversational AI and digital transformation. The world's leading brands use our award-winning Conversational Cloud platform to connect with millions of consumers. We power nearly a billion conversational interactions every month, providing uniquely rich data analytics and safety tools to unlock the power of conversational AI for better business outcomes. Fast Company named LivePerson the #1 Most Innovative AI Company in the world.</p> <h3><strong>Position Overview</strong></h3> <p>We're looking for a <strong>Senior Software Engineer</strong> to join our globally distributed <strong>Data Platform</strong> team in Europe and play a key role in shaping the future of our data ecosystem.</p> <p>In this high-impact individual contributor role, you'll lead the modernization of our core data platform by migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a scalable, cloud-native Databricks architecture. You'll have the opportunity to drive technical decisions, influence platform architecture, and build the foundation that powers data across the business.</p> <p>If you're a hands-on engineer who enjoys solving complex technical challenges, building modern data platforms, and making a lasting impact at scale, we'd love to hear from you!</p> <h3><strong>You Will: Key Responsibilities &amp; Impact</strong></h3> <ul> <li> <p><strong>Lead the Modernization of Our Data Platform:</strong> Take ownership of migrating mission-critical data pipelines from legacy Hadoop, Spark, and Impala environments to a modern, scalable Databricks ecosystem. You'll re-architect ETL workflows, convert complex SQL, and seamlessly migrate integrations, connections, and secrets.</p> </li> <li> <p><strong>Accelerate Development with AI-Powered Engineering:</strong> Leverage cutting-edge AI coding assistants such as Claude and Codex to dramatically accelerate migration efforts. Rather than manually rewriting legacy code, you'll guide AI tools to convert SQL, modernize ETL scripts, untangle dependencies, and generate clean, maintainable code—while applying your engineering expertise to validate architecture, performance, and quality.</p> </li> <li> <p><strong>Build the Next Generation of Data Pipelines:</strong> Design, develop, and optimize scalable data workflows using Airflow and Databricks. You'll create resilient, high-performance pipelines that are reliable, cost-efficient, and built to support growing business needs.</p> </li> <li> <p><strong>Champion Data Quality:</strong> Ensure the accuracy and consistency of migrated data by implementing comprehensive validation and testing strategies. You'll play a critical role in maintaining data integrity throughout the migration journey.</p> </li> <li> <p><strong>Improve Platform Reliability:</strong> Help drive operational excellence by enhancing observability, monitoring, and incident response practices. Contribute to service reliability through SLOs/SLAs and participate in a scalable on-call rotation to support production systems.</p> </li> <li> <p><strong>Deliver Meaningful Business Impact:</strong> Apply your understanding of contact center analytics to build platforms that power customer conversation insights, reporting, and business intelligence. You'll embrace a data-driven mindset, designing systems that are measurable, observable, and continuously improving.</p> </li> </ul> <h3><strong>You Have: Required Skills &amp; Qualifications</strong></h3> <ul> <li> <p><strong>Extensive Software Engineering Experience:</strong> 6–8 years of experience building and supporting distributed systems and large-scale data platforms, with a proven ability to own complex technical initiatives from design through production.</p> </li> <li> <p><strong>Proven Platform Modernization Experience:</strong> Hands-on experience leading or playing a key role in migrating enterprise data platforms from legacy technologies—such as Hadoop, Spark, Hive, or Impala—to modern cloud-based solutions like Databricks.</p> </li> <li> <p><strong>Deep Databricks Expertise:</strong> Strong knowledge of the Databricks ecosystem, including Jobs, Delta Lake, cluster configuration and optimization, and migrating complex SQL workloads from Impala or Hive to Spark SQL.</p> </li> <li> <p><strong>Data Pipeline &amp; Orchestration Skills:</strong> Advanced Python programming skills for ETL development and extensive experience designing, building, debugging, and optimizing production data pipelines and orchestration workflows using Airflow and Databricks.</p> </li> <li> <p><strong>Cloud &amp; Infrastructure Knowledge:</strong> Experience working with cloud-native data platforms, particularly Google Cloud Platform (GCP) and Google Cloud Storage (GCS), with an understanding of containerized, Kubernetes-based (GKE) microservice architectures.</p> </li> <li><strong>Modern Data Platform Expertise:</strong> <ul> <li> <p>Strong understanding of distributed data processing architectures and the trade-offs between real-time and batch data processing.</p> </li> <li> <p>Hands-on experience with legacy big data technologies, including Hadoop and MapReduce, with the ability to modernize and migrate complex data ecosystems.</p> </li> <li> <p>Knowledge of data integration patterns, including APIs, connectors, webhooks, and event-driven architectures.</p> </li> </ul> </li> <li><strong>Cloud &amp; Platform Engineering:</strong> <ul> <li> <p>Experience building, deploying, and managing cloud-native data platforms, with Google Cloud Platform (GCP) experience preferred.</p> </li> <li> <p>Familiarity with containerized environments and running data workloads on Kubernetes.</p> </li> <li> <p>A strong focus on building highly reliable, scalable, and observable platforms, with experience implementing monitoring, validation, and