
Posted 3 days ago
Data Engineering & Migration Lead
CSpringData Engineering & Migration Lead
Requirements
Proven experience leading two large-scale legacy-to-cloud migrations, Hands-on expertise with AWS S3, Glue, or Lambda, Deep understanding of Change Data Capture (CDC) or watermarking, Expert-level SQL skills, Experience with Snowflake multi-layer architectures
Skills
AWSSnowflakeSQLPythonData Engineering
About the role
Responsibilities
- Design and execute technical data migration strategies to move complex legacy datasets into modern cloud environments.
- Develop robust, repeatable frameworks for incremental data loads to support phased migration strategies.
- Architect "Bronze" layer ingestion processes using AWS S3 and AWS Glue or Lambda.
- Lead SQL-based transformations within Snowflake to promote data through Medallion (Bronze, Silver, Gold) layers.
- Serve as the technical subject matter expert, providing architectural guidance and performing code reviews.
- Build automated reconciliation scripts and "self-healing" pipelines with comprehensive logging and error handling.
- Optimize ELT processes to ensure high performance and cost-efficiency within agency benchmarks.
Requirements
- Proven experience leading at least two large-scale legacy-to-cloud data migrations.
- Hands-on expertise with AWS storage and compute services, specifically S3 and Glue or Lambda.
- Deep understanding of Change Data Capture (CDC) or watermarking techniques for incremental migrations.
- Expert-level SQL skills.
- Experience working with Snowflake multi-layer (Medallion) architectures.
Preferred Qualifications
- Experience working with state or federal data security requirements (e.g., NIST, CJIS, or HIPAA).
- Proficiency with Snowflake-specific features such as SnowSQL, Tasks, Streams, and Snowpipe.
Benefits
- Purposeful projects that improve systems serving real people.
- A people-first culture focused on professional growth, autonomy, and community.
- Strategic, hands-on work with influence over the entire solution delivery process.
About the Company
CSpring is a purpose-driven consulting firm specializing in data strategy, data engineering, and data analytics. We partner with clients across the public and private sectors to solve complex problems and drive measurable results through the power of data.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineering & Migration Lead
CSpring · Indianapolis
