
Posted a day ago
AWS Data Engineer
NCS Australia
Requirements
Data Engineering experience, AWS cloud services (S3, Glue, Lambda, Redshift, RDS, EC2), Data migration expertise, AWS DMS and SCT, Python and SQL proficiency, Spark or PySpark, Data warehousing and modelling
Skills
AWSPythonSQLPySparkRedshiftETL
About the role
Responsibilities
- Lead large-scale cloud transformation initiatives by migrating data from legacy and on-premise systems to AWS.
- Design and execute end-to-end data migration strategies, including lift-and-shift, re-platforming, and re-architecture.
- Perform database migrations using AWS DMS and manage schema conversion and optimization using AWS SCT.
- Build scalable ETL/ELT pipelines using AWS Glue, PySpark, and Lambda.
- Migrate structured and unstructured data into S3-based data lakes and optimize data in Amazon Redshift.
- Implement data governance and security best practices using IAM, encryption, and access controls.
- Collaborate with stakeholders to plan cutover strategies and monitor pipeline performance and reliability.
Requirements
- Strong experience in Data Engineering and data migration projects.
- Hands-on experience with AWS cloud services (S3, Glue, Lambda, Redshift, RDS, EC2).
- Expertise in using AWS DMS and Schema Conversion Tool (SCT).
- Proficiency in Python and SQL.
- Experience with big data frameworks such as Spark or PySpark.
- Solid understanding of data warehousing concepts and data modelling.
- Proven experience building and managing ETL/ELT pipelines.
Preferred Qualifications
- Experience with Snowflake or other modern data platforms.
- Exposure to real-time streaming technologies like Kafka or Kinesis.
- AWS Certifications (e.g., Data Analytics Specialty or Solutions Architect).
Benefits
- Paid parental leave and well-being initiatives.
- Discounted health insurance and various product/service discounts.
- Access to career development through the Capability Fingerprint and AI-driven learning platforms.
- Regular recognition and rewards for high performance.
About the Company
NCS Australia is a technology services provider committed to quality, innovation, and purposeful work. We partner with clients and communities to shape better outcomes through creative and resilient technology solutions.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeAWS Data Engineer
NCS Australia · Sydney
