Data Engineer

About the Company

Activate Interactive Pte Ltd (“Activate”) is a leading technology consultancy headquartered in Singapore with a presence in Malaysia and Indonesia. Our clients are empowered with quality, cost-effective, and impactful end-to-end application development, like mobile and web applications, and cloud technology that remove technology roadblocks and increase their business efficiency.

Responsibilities

• Design, develop and deploy data tables, views and marts in data warehouses, operational data store, data lake and data virtualization
• Perform data extraction, cleaning, transformation, and flow, including web scraping
• Design, build, launch and maintain efficient and reliable large-scale batch and real-time data pipelines
• Integrate and collate data silos in a scalable and compliant manner
• Collaborate with Project Managers, Data Architects, and Analysts to build scalable data driven products
• Develop backend APIs and work on databases to support applications
• Work in an Agile Environment practicing Continuous Integration and Delivery
• Participate in pair programming and code review processes

Requirements

• Proficiency in data cleaning and transformation using SQL, pandas, or R
• Experience building ETL pipelines (e.g., SSIS, AWS DMS, Python, AWS Lambda, AWS Glue)
• Proficiency in database design and various databases (e.g., PostgreSQL, AWS S3, Athena, MongoDB, MySQL)
• Experience with cloud technologies (AWS, Azure, or Google Cloud)
• Knowledge of system design, data structures, and algorithms
• Familiarity with data modelling and storage infrastructure (Data Mart, Data Lake, Data Warehouse)
• Familiarity with big data frameworks (e.g., Hadoop, Spark, Kafka, Databricks)
• Experience with web scraping tools (e.g., BeautifulSoup, Selenium, Node.js)
• Comfort with scripting languages like SQL or Python
• Ability to work in both Windows and Linux environments

Benefits

• Competitive compensation and variable performance bonus
• Outpatient medical, specialist coverage, and customizable flexi-benefits
• Life and health insurance
• Learning programmes and dedicated staff development budget
• Structured career pathways and competency frameworks
• Flexible work arrangements (flexi-place, flexi-time, and flexi-load)