Senior Data Engineer

Responsibilities

• Design, construct, install, and maintain large-scale processing systems and other infrastructure
• Develop and maintain data pipelines using tools such as Apache Airflow, Spark, or similar
• Optimize data systems for performance, reliability, scalability, and quality
• Implement data integration processes from multiple sources including APIs, internal databases, and third-party data
• Ensure data is secure, governed, and meets compliance standards
• Collaborate with analytics and product teams to support their data needs
• Monitor, troubleshoot, and optimize data workflows and data storage solutions

Requirements

• 2+ years of experience in data engineering
• Proficiency in Java programming language
• Experience with AWS Cloud and AWS Redshift
• Experience with Kafka and streaming technologies
• Experience with Spark, Storm, or Flink
• Experience with NiFi
• Experience with Oozie, Airflow, or Ctrl+M
• Experience with MongoDB or Cassandra
• Strong communication skills

About the Company

LUMIQ is the leading Data and Analytics company in the Financial Services and Insurance (FSI) industry. Trusted by the world's largest FSIs, LUMIQ creates next-gen data technology products to help enterprises organize, manage, and effectively use data.