Data Engineering Lead

Responsibilities

• Develop scalable, reliable, and efficient data pipelines and architectures
• Optimize and maintain data platforms for performance, cost, and reliability
• Ensure data quality, integrity, and availability across systems
• Implement optimized data transformations leveraging distributed processing
• Work closely with business, analytics, and product teams to understand requirements
• Implement data validation and monitoring frameworks
• Automate deployments using CI/CD pipelines
• Participate in technical walkthroughs and ensure compliance with organizational standards

Requirements

• B.Tech/MCA/Graduation (minimum 15+ years of formal education)
• 5+ years of proficiency in data engineering technologies such as Python and Spark
• 4+ years of hands-on experience with cloud platforms (Azure, AWS, or GCP) and data services
• Experience with infrastructure-as-code tools (e.g., Terraform, ARM templates)
• Knowledge of data cataloging, lineage, and metadata tools
• Exposure to modern data platforms such as Databricks or Snowflake
• Excellent written and verbal communication and coordination skills

Preferred Qualifications

• Experience working in enterprise environments with complex data landscapes
• Exposure to the Healthcare domain
• Experience with AI and utilizing LLM models
• Experience with Airflow

Benefits

• Life: Resources and support to focus on what matters most to you
• Emotional: Education, tools, and resources to help manage stress and build resilience
• Physical: Health plans and coverage to support wellness for you and your loved ones
• Financial: Benefits to help you plan for today and the future, including retirement

About the Company

Optum is a global organization that delivers care, aided by technology, to help millions of people live healthier lives. We connect people with the care, pharmacy benefits, data, and resources they need to feel their best.