Principal Data Engineer

Responsibilities

• Design, build, and optimize scalable data pipelines and ETL/ELT workflows for large, complex datasets.
• Implement foundational data architecture supporting identity resolution and ID graph systems.
• Process and unify multi-source datasets including cookies, device IDs, and behavioral data.
• Write efficient, testable, and maintainable code using Python and SQL for large-scale processing.
• Optimize data models, queries, and storage strategies for performance, scalability, and cost efficiency.
• Build and maintain data validation, monitoring, and alerting systems to ensure data quality.
• Collaborate with data, platform, DevOps, and product teams to deliver production-ready solutions.
• Drive complex data problems end-to-end, from initial design through production deployment.

Requirements

• 8-12+ years of hands-on experience in data engineering or large-scale data processing.
• Strong expertise in SQL (Postgres, BigQuery, Redshift, etc.) and Python for data processing.
• Proven experience with Google Cloud Platform (BigQuery, Dataflow, Pub/Sub) or AWS (S3, Redshift, EMR).
• Experience working with massive datasets containing hundreds of millions to billions of records.
• Deep understanding of data modeling, partitioning, indexing, and query optimization.
• Familiarity with CI/CD, containerization, and orchestration tools such as Docker and Kubernetes.
• Strong debugging and troubleshooting skills in complex, distributed data environments.

Preferred Qualifications

• Experience with identity graphs, entity resolution, or record linkage systems.
• Background in AdTech, digital identity, or audience data platforms.
• Experience with real-time or streaming data systems.
• Knowledge of modern data platforms like Snowflake or Databricks.
• Exposure to AI/ML technologies and agentic frameworks.

About the Company

Dun & Bradstreet is a global leader in business decisioning data and analytics. For over 180 years, businesses have trusted us to turn uncertainty into opportunity by helping companies worldwide grow, manage risk, and innovate.