Machine Learning Engineer

Responsibilities

• Support the development, deployment, and maintenance of machine learning systems within the AI Solutions Hub.
• Build and maintain ML deployment pipelines, including model packaging, registry management, and promotion workflows.
• Support batch and real-time inference workflows using serving frameworks such as FastAPI, TorchServe, or vLLM.
• Implement logging, monitoring, and alerting for deployed ML services to track latency, prediction drift, and error rates.
• Contribute to CI/CD pipelines for ML applications, including automated testing of model artifacts and data validation.
• Collaborate with cross-functional teams including data scientists, engineers, and faculty experts.

Requirements

• Bachelor's or Master's degree in Computer Science, Software Engineering, or a closely related field.
• 0-2 years of experience in software engineering, machine learning engineering, or applied ML projects.
• Strong programming skills in Python and familiarity with software engineering practices (testing, version control, documentation).
• Exposure to cloud platforms (AWS, Azure, or GCP) and ML deployment concepts.
• Knowledge of containerization tools like Docker.
• Understanding of ML workflows with an emphasis on model serving, validation, and inference.

Preferred Qualifications

• Experience with Kubernetes, GPU-based workloads, or distributed training/inference.
• Familiarity with vector databases, retrieval-augmented generation (RAG), or embedding-based search systems.
• Knowledge of orchestration frameworks such as LangGraph or CrewAI.
• Experience with infrastructure-as-code concepts (e.g., Terraform, CloudFormation).
• Familiarity with ML versioning tools like DVC, MLflow, or Weights & Biases.

Benefits

• Comprehensive medical, vision, and dental insurance.
• Paid time off and retirement plans.
• Tuition assistance and wellness programs.
• Commuting and transportation support.

About the Company

Northeastern University is a global research university and a leader in experiential lifelong learning. Through the Roux Institute in Portland, Maine, the AI Solutions Hub (AISH) serves as the delivery arm of Northeastern’s Experiential AI Institute, focusing on scalable, reliable, and responsible AI innovation.