
Posted 3 days ago
Senior Data Engineer
AIFTSenior Data Engineer
Requirements
Bachelor's degree in CS or related field, 5+ years data engineering experience, Cloud data platforms (Snowflake, Databricks, BigQuery, or Redshift), SQL proficiency, Workflow orchestration (Airflow), Streaming platforms (Kafka), GitLab and CI/CD
Skills
SQLAirflowKafkaSnowflakeDatabricksCI/CDPython
About the role
Responsibilities
- Own day-to-day operations of data platforms, including capacity management, stability, upgrades, and recovery drills.
- Design and manage multi-source data ingestion from exchanges and internal/external systems with robust retry mechanisms.
- Develop rule-based and statistical data quality checks for completeness, uniqueness, and anomaly detection.
- Plan and maintain scalable ETL/ELT pipelines supporting both batch and real-time streaming.
- Implement automated remediation, reconciliation workflows, and historical backfilling.
- Enforce data access controls, encryption, and auditing to comply with regulatory requirements and PII management.
- Apply Infrastructure-as-Code, data versioning, and CI/CD to improve pipeline predictability.
- Contribute to embedded GenAI and LLM-powered data applications for enterprise analytics and productivity.
Requirements
- Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
- 5+ years of experience in data engineering, data platform architecture, or AI/ML engineering.
- Strong experience with modern cloud data platforms such as Snowflake, Databricks, BigQuery, or Redshift.
- Proficiency in SQL and workflow orchestration tools like Airflow.
- Hands-on experience with streaming platforms such as Kafka.
- Familiarity with GitLab and CI/CD pipelines.
- Solid understanding of data warehouse development lifecycles and dimensional modeling.
- Working knowledge of data governance, lineage, privacy, and security frameworks.
About the Company
AIFT is building advanced data-driven solutions and enterprise-grade AI applications to power analytics and decision-making in regulated environments.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSenior Data Engineer
AIFT · Taiwan
