Data Engineer

Responsibilities

• Work closely with predictive modelers to assemble large, complex data sets
• Perform data manipulation and transformation using SQL and Python
• Identify, design, and implement internal process improvements and automation
• Discover and explore new sources of data
• Create and maintain optimal data pipeline architecture
• Author detailed documentation of data pipelines and technical solutions
• Ensure data quality and completeness

Requirements

• Advanced working SQL knowledge and experience with relational databases
• Proven history of manipulating and extracting value from large, disconnected datasets
• 3+ years of experience in a Data Engineer role or equivalent
• BS in Computer Science, Information Technology, Data Analytics, or equivalent
• Proficiency in data integration services like SSIS or Azure Data Factory
• Strong organizational and critical thinking skills

Preferred Qualifications

• Experience with Python, Scala, C++, or Java
• Experience with Snowflake or other cloud-based data warehouses
• Knowledge of NoSQL databases or unstructured data
• Experience with Azure cloud services
• Experience with Databricks, Spark, or Azure Data Factory

About the Company

AGSI is committed to supporting the goals of Arch divisions through exceptional service delivery, focusing on flexibility, responsiveness, and sound project management.