
Posted 9 hours ago
DataOps Engineer
MarexDataOps Engineer
Requirements
DataOps or DevOps implementation experience, CI/CD pipeline design for data workloads, Databricks (AWS/Azure) expertise, Proficiency in Python and SQL, Infrastructure as Code (Terraform), SDLC and software engineering best practices, Experience in regulated environments
Skills
DatabricksPythonSQLTerraformCI/CDAWSAzure
About the role
Responsibilities
- Design, implement, and operationalize the DataOps target state through consistent frameworks, tooling, and standards.
- Build and maintain CI/CD pipelines for data and ML workloads to enable automated promotion across environments.
- Define and implement test-driven development practices, including unit, integration, and end-to-end testing for data pipelines.
- Embed data reliability patterns aligned to the Medallion Architecture (Bronze, Silver, Gold).
- Implement data quality enforcement, monitoring, and observability frameworks to improve platform stability.
- Partner with Governance, Risk, and Control stakeholders to translate regulatory requirements into repeatable engineering controls.
- Provide technical leadership and design advisory services to Data Engineering, AI/ML, and Analytics teams.
Requirements
- Strong experience implementing DataOps or DevOps practices in complex data environments.
- Proven expertise designing and operating CI/CD pipelines for data and analytics workloads.
- Hands-on experience with Databricks (AWS and/or Azure) in production environments.
- High proficiency in Python and SQL.
- Experience applying Infrastructure as Code (IaC) using tools such as Terraform.
- Deep understanding of software engineering best practices and the SDLC.
- Experience working within a regulated environment and managing associated risk and compliance requirements.
Preferred Qualifications
- Experience in financial services, specifically with ETD and OTC derivative markets.
- Experience with orchestration platforms such as Azure Data Factory or Apache Airflow.
- Proficiency with data transformation platforms like dbt or Databricks Lakeflow.
- Experience supporting ML pipelines and model lifecycle operations.
- Databricks Certified Data Engineer Professional or DAMA Certified Data Management Professional (CDMP) credentials.
About the Company
Marex Group plc is a diversified global financial services platform providing essential liquidity, market access, and infrastructure services across energy, commodities, and financial markets. With over 3,000 employees and 40 offices worldwide, Marex leverages technology-led services to provide award-winning data, insights, and analytics to a global client base.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeDataOps Engineer
Marex · London
