Lead Data Engineer - Identity

About this role

<div class="content-intro"><p><strong>^{Who We Are}</strong><br>_{Kargo creates powerful moments of connection between brands and consumers to build businesses. Every day, our 600+ employees work to radically raise the bar on what agentic AI, CTV, eCommerce, social, and mobile can do to deliver unique ad experiences across the world’s most premium platforms. Taking a creative science approach to all we do, we continuously innovate solutions that outperform industry benchmarks and client expectations. Now 20+ years strong, Kargo has offices in NYC, Chicago, LA, &nbsp;Dallas, Sydney, Auckland, London and Waterford, Ireland.&nbsp;}</p> <p style="text-align: left;"><strong>^{<br>Who We Hire<br>}</strong>_{Techies who want to build the future. Creatives who want to design it better. Communicators to win business. Collaborators to build it. Data pros who turn numbers into insights. Product builders who turn ideas into innovations. Anyone eager to be on a team that doesn’t stop to ask what’s next, because they’re already building it.&nbsp;}</p></div><p><strong>The Opportunity</strong></p> <p>Identity is central to how AdTech works today: advertisers want cross-surface reach, user-level measurement, and lower-funnel attribution. Their data reaches us two ways, and each has a clear next step: direct onboarding currently runs on a partner's identity spine and we want to build a new, multi-source graph of our own; DMP feeds are proven and now need to scale as we enter in-app inventory.</p> <p>In this role you'll own the graph, a standardized ingestion path that stands up each new feed faster and cheaper than the last, and the audience state and reporting behind self-serve discovery. You'll also set the technical bar for the engineers building it with you.</p> <p><strong>The Daily To-Do</strong></p> <ul> <li><strong>Build a new identity graph</strong>. Take stock of what we have today, set its direction, and sequence the rollout: identifier sync, translation, clustering (with Data Science), opt-out handling.</li> <li><strong>Standardize partner and client onboarding</strong> across web, CTV and mobile identifiers, including cleanroom onboarding, so each new feed costs less to stand up than the last.</li> <li><strong>Ready the identity audience data layer for self-serve</strong>: creation, activation, state, and the reporting clients will discover audiences through.</li> <li><strong>Own and raise the bar on the domain's observability and alert response</strong>. Inventory today's signals, monitors and alerts, centralize them, and bring each to standard: a freshness and quality commitment, context for AI-assisted triage, and a runbook.</li> <li><strong>Lead and grow the domain's data engineers</strong>. Define the standards for testability, cost efficiency and the patterns worth repeating, then raise the team to them through your own code, reviews, and knowledge-sharing, recording decisions in ADRs.</li> </ul> <p>&nbsp;</p> <p><strong>Qualifications</strong></p> <p>&nbsp;</p> <ul> <li>You've designed and owned large-scale, interdependent data systems, including at least one you built from scratch, and you turn ambiguity into a sequenced roadmap with Product and Data Partnerships.</li> <li>You've led engineers, setting direction, reviewing work, developing people, while staying hands-on.</li> <li>You have mastery of Python, Airflow and Spark, and write transformations that are idiomatic, testable and tuned for cost and performance; you write SQL for Snowflake with the same discipline.</li> <li>You're at home in AWS and Kubernetes, can read infrastructure logs to diagnose failures and slowness, and have worked with third-party APIs inside ingestion pipelines.</li> <li>You're fluent with AI tooling in your own work, and you think about what makes a codebase legible to it.</li> </ul> <p><strong>Strongly Preferred</strong></p> <ul> <li>Identity resolution or graph work in AdTech: matching, device and household graphs.</li> <li>Privacy and consent obligations: opt-outs, deletion, GDPR and CCPA.</li> <li>Data cleanrooms for partner or client onboarding.</li> <li>CI/CD with GitHub Actions/ArgoCD; monitoring with VictoriaMetrics/Prometheus/Grafana.</li> </ul> <p><strong>Nice To Have</strong></p> <ul> <li>Iceberg or a comparable table format at production scale.</li> <li>Streaming or near-real-time processing (Kafka, Redpanda or similar).</li> <li>Low-latency stores such as Aerospike&nbsp;</li> <li>Experience with OLAP databases like Clickhouse.</li> </ul><div class="content-conclusion"><p><strong>Our Laurels</strong></p> <ul> <li>AdAge Best Places to Work&nbsp;</li> <li>ThinkLA Partner of the Year</li> <li>Built In Best Places to Work&nbsp;</li> <li>Cynopsis 2025 Top Women in Media - Jeannine Shao Collins</li> <li>Martech Breakthrough Awards - Best Overall Adtech Company</li> <li>Digiday Media Awards Best Event</li> <li>Cynopsis Media Impact Awards-Best CTV Platform</li> <li>Martech Breakthrough Awards-CTV Innovation</li> <li>Adweek Media Plan of the Year Awards - Best Use of Insights</li> </ul> <p><strong>Follow Our Lead</strong></p> <ul> <li>Big Picture:&nbsp; <a href="kargo.com">kargo.com</a></li> <li>The Latest:&nbsp; Instagram (@kargo.hq) and LinkedIn (Kargo)</li> </ul> <p class="font-claude-response-body break-words whitespace-normal leading-[1.7]"><em>Kargo is an Equal Opportunity Employer. We are committed to building an inclusive and diverse workplace where all employees and applicants are treated with respect and dignity. We do not discriminate on the basis of race, color, ethnic origin, religion or belief, sex, sexual orientation, gender identity or expression, age, disability, marital or family status, national origin, veteran status, or any other characteristic protected by applicable local, state, or federal law. All qualified applicants will receive consideration for employment.</em></p> <p class="font-claude-response-body break-words whitespace-normal leading-[1.