I
Posted 2 days ago
Data Engineer 2
Illumina
Requirements
Proficiency in Python, Scala, or Java, Understanding of data quality, governance, security, and lineage, Troubleshooting data-related issues, Bachelor's or master's degree in Computer Science or Engineering, 3+ years of Data Engineering experience, Familiarity with Docker and Kubernetes
Skills
PythonScalaJavaDockerKubernetes.NET
About the role
Responsibilities
- Design, develop, and maintain a common unified data framework to enable seamless integration from various sources.
- Create and optimize data pipelines for ingesting, processing, transforming, and storing large volumes of structured and unstructured data.
- Collaborate with data scientists and analysts to translate data requirements into robust data models.
- Develop and maintain data engineering tooling to improve ingestion, quality, monitoring, and governance processes.
- Troubleshoot and resolve data pipeline issues to ensure uninterrupted data flow.
- Monitor pipeline performance, identify bottlenecks, and optimize processing and storage efficiency.
- Evaluate and integrate third-party data tools and technologies to enhance organizational capabilities.
Requirements
- Proficiency in object-oriented or functional programming languages such as Python, Scala, or Java.
- Solid understanding of data quality, data governance, security, and lineage concepts.
- Strong ability to troubleshoot data-related issues effectively.
- Excellent communication and collaboration skills for working with cross-functional teams.
- Demonstrated passion for data engineering, automation, and continuous learning.
Preferred Qualifications
- Bachelor's or master's degree in Computer Science, Engineering, or a related field.
- At least 3 years of experience as a Data Engineer with a track record of building production-grade pipelines and models.
- Familiarity with containerization technologies like Docker and orchestration tools like Kubernetes.
- Experience applying AI or intelligent techniques to improve data quality or development workflows.
- Knowledge of C# web development using Microsoft .NET.
About the Company
Illumina is a leader in genomics, expanding access to genomic technology to realize health equity for billions of people worldwide. Our technology empowers researchers and clinicians to improve cancer treatments, change the course of diseases, and protect the environment.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer 2
Illumina · Woodlands
