Data Engineer

Responsibilities

• Architect and lead the delivery of AWS-based lakehouse solutions using Databricks, integrating with services like S3, Glue, Lambda, and Redshift.
• Design, build, and optimize ETL/ELT pipelines using Apache Spark, Delta Lake, Python, and SQL for batch and streaming use cases.
• Define data architecture standards, including ingestion patterns, medallion designs, schema evolution, and cost optimization.
• Implement production-grade engineering practices such as data quality validation, monitoring, and operational alerting.
• Apply data security and governance controls appropriate for federal and defense environments.
• Partner with client stakeholders to translate mission requirements into technical designs and delivery roadmaps.
• Lead and mentor data engineers through code reviews, architecture reviews, and delivery execution.
• Establish and mature CI/CD pipelines for Databricks workloads and supporting infrastructure.

Requirements

• US Citizenship is required.
• An active and maintained "Secret" Federal or DoD security clearance.
• 7+ years of progressive experience in data engineering, data platform delivery, or data architecture.
• Strong hands-on experience with AWS data platforms and operating production systems on Databricks.
• Deep expertise with Apache Spark, Databricks, Delta Lake, Python, and SQL.
• Proven ability to design scalable, secure data architectures for analytics and AI/ML enablement.
• Strong written and verbal communication skills for interacting with technical and non-technical stakeholders.

Preferred Qualifications

• Experience delivering Azure-based data platforms (Azure Databricks, ADLS Gen2, Data Factory, or Synapse).
• Experience with Databricks Unity Catalog for permissions and governance.
• Infrastructure-as-Code experience using tools like Terraform.
• Experience with streaming and event-driven architectures such as Kafka or Kinesis.
• Cloud or platform certifications (AWS, Databricks, or Azure).
• Prior experience supporting DoD or Defense & Security federal clients.

Benefits

• Medical, Rx, Dental, and Vision Insurance.
• 401(k) Retirement Plan and Student Loan PayDown.
• Parental Leave and Adoption Assistance.
• Tuition Reimbursement and continuous learning opportunities.
• Flexible benefits including Health Savings Accounts and Dependent Care FSAs.

About the Company

Guidehouse is a global AI-led professional services firm delivering advisory, technology, and managed services to the commercial and government sectors. We drive efficiency and resilience in the healthcare, financial services, energy, infrastructure, and national security markets.