Software Engineer III

Responsibilities

• Build and deploy scalable LLM, RAG, and agent-based systems
• Architect efficient LLM inference and deployment pipelines
• Optimize models for production using quantization, pruning, and distillation
• Collaborate with data science, research, and product teams to deliver impactful AI solutions
• Ensure engineering excellence through clean code, testing, reproducibility, and CI/CD
• Mentor junior engineers and drive engineering best practices
• Ensure ethical, secure, and responsible AI development

Requirements

• BA/BS in Computer Science, Information Technology, or a related field
• Proven experience with LLM and RAG systems
• Strong knowledge of vector databases such as FAISS, Pinecone, or Chroma
• Experience with model optimization and serving using FastAPI
• Proficiency with CI/CD pipelines, Docker, Kubernetes, and MLOps tools like MLflow
• Experience with cloud AI deployments on AWS, Azure, or GCP

Preferred Qualifications

• Experience with Multimodal AI (text, vision, audio) including CLIP, Whisper, or LLaVA
• Knowledge of data pipelines and ELT/ETL using Snowflake
• Experience with orchestration tools like Airflow

About the Company

Carelon Global Solutions is a healthcare solutions company dedicated to simplifying complex operational processes to improve the health of the healthcare system. As a subsidiary of Elevance Health, we bring together a global team of innovators to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more effective and efficient.