Senior Staff Engineer, AI Software

Responsibilities

• Lead the co-design of software and hardware solutions to optimize AI model inference performance
• Analyze and optimize LLM and agentic AI workloads across the full software stack
• Profile and characterize model execution to guide architectural decisions for HBM and memory-centric compute
• Collaborate with hardware teams to influence memory architecture and acceleration strategies
• Develop, optimize, and benchmark inference and serving solutions using PyTorch and vLLM
• Provide technical mentorship across software–hardware co-design efforts

Requirements

• 15+ years experience with Bachelor's, 13+ with Master's, or 10+ with PhD
• Experience writing high-performance AI framework software for GPUs or accelerators
• End-to-end understanding of AI infrastructure and software stacks
• Understanding of LLM model architectures and agentic AI workflows
• Hands-on expertise with PyTorch and vLLM
• Knowledge of memory architecture including High Bandwidth Memory (HBM)
• Proficiency in Linux development environments
• Command of GitHub and Jira

About the Company

Samsung Semiconductor develops technology solutions that power smartphones, electric vehicles, hyperscale data centers, and IoT devices. The AGI Computing Lab focuses on solving complex system-level challenges for future AI/ML workloads through hardware and software co-design.