Senior Software Engineer III

Responsibilities

• Build and deploy scalable LLM, RAG, and agent-based systems
• Architect LLM inference and deployment pipelines
• Optimize models for efficient and cost-effective production
• Collaborate with data science, research, and product teams
• Ensure clean code, testing, reproducibility, and CI/CD
• Mentor junior engineers and drive engineering best practices
• Ensure ethical, secure, and responsible AI development

Requirements

• BA/BS in Information Technology, Computer Science, or a related field
• 5+ years of experience in data or software engineering roles
• Advanced Python proficiency with NumPy, Pandas, and scikit-learn
• Deep learning expertise using PyTorch or TensorFlow
• Hands-on experience with Hugging Face Transformers and LangChain
• Strong experience with Agentic AI frameworks such as AutoGen, CrewAI, or LangGraph
• Expertise in RAG pipelines, semantic search, and vector databases
• Strong software engineering practices including microservices and TDD
• Hands-on experience with Snowflake (data modeling, performance tuning, and SQL optimization)

Preferred Qualifications

• Experience with model optimization techniques like quantization, pruning, or distillation
• Knowledge of Multimodal AI (text, vision, audio) using CLIP, BLIP, or Whisper
• Experience with LLM serving using FastAPI and vector DBs like FAISS, Pinecone, or Chroma
• Proficiency with CI/CD pipelines, Airflow, Docker, and Kubernetes
• Experience with Cloud AI deployments on AWS, Azure, or GCP (e.g., SageMaker)
• Familiarity with MLOps and tracking tools like MLflow

About the Company

Carelon Global Solutions is a healthcare solutions company dedicated to simplifying complex operational processes to improve the health of the healthcare system. As a subsidiary of Elevance Health, we bring together a global team of innovators to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective, and efficient.