
Posted a day ago
Data Engineer - AVP
Barclays
Requirements
Large scale data platforms experience, AWS Glue, Lambda, S3, Redshift, Athena, Databricks, Python and PySpark, Advanced SQL, Data modeling and schema design, DevOps and CI/CD (Jenkins, GitLab)
Skills
AWSPythonPySparkSQLDatabricksRedshift
About the role
Responsibilities
- Build and maintain data architecture pipelines to ensure the transfer and processing of durable, complete, and consistent data.
- Design and implement data warehouses and data lakes that manage high data volumes and velocity while adhering to security measures.
- Develop processing and analysis algorithms suitable for complex data volumes.
- Collaborate with data scientists to build and deploy machine learning models.
- Lead complex tasks, guide team members through structured assignments, and influence decision-making within the business function.
- Identify ways to mitigate risk and develop new policies or procedures to support governance and control.
Requirements
- Considerable hands-on experience working with large-scale data platforms and delivering cloud-based data solutions.
- Solid understanding of distributed computing and data architecture paradigms.
- Practical experience with AWS data platforms, including Glue, Lambda, S3, Redshift, Athena, and Databricks.
- Proficiency in Python and PySpark, along with advanced SQL skills including query tuning and performance optimization.
- Experience designing and building batch data ingestion and transformation pipelines for large datasets.
- Understanding of IAM roles, cloud security, and AWS infrastructure.
Preferred Qualifications
- Validated capability in data modeling and schema design.
- Experience with DevOps and CI/CD pipelines using tools such as Jenkins and GitLab.
- Knowledge of data governance standards, metadata oversight, and data quality frameworks (e.g., Alation, Glue Data Quality, data mesh).
- Comfort working in Agile delivery environments.
- Ability to propose and influence solution-level architecture for diverse technology use cases.
Benefits
- Competitive medical, dental, and vision coverage.
- 401(k) retirement plan.
- Life insurance.
- Paid leave for qualifying circumstances.
- Eligibility for incentive awards.
About the Company
Barclays is a global institution dedicated to redefining the future of banking through innovative solutions. We value respect, integrity, service, excellence, and stewardship, fostering a culture where employees are empowered to challenge the status quo and drive meaningful change.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeData Engineer - AVP
Barclays · Whippany
