
Posted 8 days ago
Software Development Engineer II - Data
Safe Security
Requirements
Bachelor's or Master's in Computer Science or related field, 3+ years data engineering experience, Expertise in Snowflake and distributed data stores, Experience with Apache Spark, Flink, and Airflow, Proficiency in Python, SQL, Scala, or Go/Nodejs, Experience with Docker and Kubernetes
Skills
Apache SparkSnowflakePythonAWSKafkaAirflow
About the role
Responsibilities
- Architect and implement high-scale data pipelines leveraging Apache Spark, Flink, and Airflow to process streaming and batch data.
- Build and maintain data lakes and ingestion frameworks using Snowflake, Apache Iceberg, and Parquet to ensure scalability and cost efficiency.
- Design robust, maintainable data models to handle structured and semi-structured datasets for analytical and operational use cases.
- Develop low-latency pipelines using Kafka and Spark Structured Streaming to support billions of events per day.
- Automate and orchestrate end-to-end ELT processes with Airflow, ensuring reliability and observability.
- Build scalable, secure, and cost-effective data solutions leveraging AWS native services such as S3, Lambda, and ECS.
- Implement strong observability, data quality checks, and performance tuning to maintain high data reliability.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering with a proven track record of designing large-scale, distributed data systems.
- Strong expertise in Snowflake and other distributed analytical data stores.
- Hands-on experience with Apache Spark, Flink, Airflow, and modern data lakehouse formats like Iceberg or Parquet.
- Proficiency in Python, SQL, Scala, or Go/Nodejs with strong debugging and performance-tuning skills.
- Experience deploying containerized applications using Docker and Kubernetes.
- Experience with streaming architectures, CDC pipelines, and data observability frameworks.
Preferred Qualifications
- Exposure to CI/CD pipelines, automated testing, and infrastructure-as-code for data workflows.
- Familiarity with streaming platforms such as Kafka, Kinesis, or Pulsar.
- Experience with real-time analytics engines like Druid, Pinot, or Rockset.
- Understanding of data governance, lineage tracking, and compliance in a multi-tenant SaaS platform.
Benefits
- Meaningful equity as a shareholder in a $170M Series C-funded company.
- Unlimited leave policy based on trust and commitment to the mission.
- Comprehensive medical insurance and wellness benefits.
- Rapid career trajectory for high-performers in a growing organization.
About the Company
Safe Security is a category leader in AI-driven cyber risk management. We provide the C-Suite with a clear, quantified, and real-time view of their security posture, serving 10% of the Fortune 500, including companies like Apple, Netflix, and Verizon.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSoftware Development Engineer II - Data
Safe Security · Bengaluru
