D
Posted 2 days ago
Staff Software Engineer
DatabricksStaff Software Engineer - Distributed Data Systems
Requirements
BS in Computer Science, 8+ years experience in Java, Scala, or C++, Strong algorithms and data structures knowledge, Experience with distributed systems and big data
Skills
JavaScalaC#Distributed SystemsApache Spark
About the role
Responsibilities
- Build next-generation distributed data storage and processing systems
- Develop open source frameworks like Apache Spark™
- Deliver high-performance services for cloud storage backends such as AWS S3 and Azure Blob Store
- Work on Delta Lake to provide ACID transactions and time travel capabilities
- Build query optimizers and execution engines that are scalable and robust
- Orchestrate and operate large-scale data pipelines via Delta Pipelines
Requirements
- BS in Computer Science or related technical field
- 8+ years of production-level experience in Java, Scala, or C++
- Strong foundation in algorithms and data structures
- Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop)
- Ability to work towards multi-year visions with incremental deliverables
Preferred Qualifications
- MS or PhD in databases or distributed systems
About the Company
Databricks is the data and AI company. Founded by the original creators of Apache Spark™, Delta Lake, and MLflow, the company provides a Data Intelligence Platform used by over 10,000 organizations worldwide to unify data, analytics, and AI.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeStaff Software Engineer
Databricks · San Francisco
