Lead Software Engineer

Responsibilities

• Lead the design, development, and maintenance of scalable cloud-based data processing pipelines and infrastructure.
• Architect and refine data models for large-scale datasets to optimize for high-performance retrieval and advanced analytics.
• Partner with cross-functional teams to translate complex business requirements into effective data engineering solutions.
• Define and execute data strategy, including the development of enterprise data models and end-to-end infrastructure management.
• Drive data quality initiatives and ensure seamless data accessibility while maintaining strict compliance with governance and regulatory requirements.
• Author and review technical requirements and architectural designs to deliver cost-effective business solutions.

Requirements

• 5+ years of applied software engineering experience with formal training in software engineering concepts.
• Expertise in distributed data processing frameworks, specifically Apache Spark.
• Expertise in cloud Data Lakehouse platforms such as AWS Data Lake or Databricks.
• Proficiency in Python, SQL, and at least one additional language such as Java or Scala.
• Experience with orchestration tools like Airflow or AWS Step Functions.
• Strong knowledge of microservices architecture and containerization tools including Docker and Kubernetes.
• Experience working with streaming platforms such as Kafka or MQ.
• Proficiency in data structures, serialization formats (JSON, AVRO, Protobuf), and big-data storage formats (Parquet, Iceberg).

Preferred Qualifications

• Hands-on experience with Infrastructure as Code (IaC) tools, preferably Terraform or AWS CloudFormation.
• Proficiency in cloud-based data pipeline technologies such as Spinnaker.
• Strong working knowledge of the Snowflake data platform.
• Experience in budgeting, resource allocation, and managing vendor relationships for data engineering projects.

About the Company

JPMorganChase is a leading global financial services firm within the Consumer and Community Banking division, dedicated to delivering market-leading technology products in a secure, stable, and scalable way.