A
Posted 7 hours ago
Software Engineer - Distributed
AchiraSoftware Engineer - Distributed
Requirements
Distributed computing frameworks (Ray, Dask, Celery), Parallel computing and job scheduling, Cloud platforms (AWS, GCP, Azure), Cluster orchestration (Kubernetes, Slurm), ML frameworks (PyTorch, TensorFlow, JAX)
Skills
PythonKubernetes
About the role
About the Company
Achira is building best-in-class foundation models to solve the most challenging problems in simulation for drug discovery and beyond. We are a world-class team of scientists, ML researchers, and engineers working to reshape the future of drug discovery through massive compute and frontier-scale ML infrastructure.
Responsibilities
- Architect, design, and optimize distributed compute infrastructure for ML data processing, training, and fine-tuning
- Improve cluster observability, scheduling, and resource utilization across CPU, GPU, and TPU
- Research and implement cost-efficient compute solutions including spot instances, auto-scaling, and multi-cloud strategies
- Develop tools for monitoring, debugging, and performance tuning of large-scale ML workloads
- Collaborate with ML engineers to accelerate training pipelines and reduce bottlenecks
Requirements
- Extensive experience building or working with distributed computing frameworks such as Ray, Dask, or Celery
- Strong grasp of parallel computing, job scheduling, and resource management
- Proficiency in identifying and resolving performance issues like profiling, bottlenecks, and network overhead
- Experience with cloud compute platforms (AWS, GCP, Azure) and cluster orchestration (Kubernetes, Slurm)
- Familiarity with ML frameworks such as PyTorch, TensorFlow, or JAX
- Understanding of MLOps best practices, model deployment, and GPU performance monitoring
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeSoftware Engineer - Distributed
Achira · San Francisco
