
Posted 4 days ago
Staff Software Engineer
HarmonicStaff Software Engineer
Perks & benefits
CommissionHealth InsuranceMedical InsuranceVisa
Requirements
7-8+ years experience building distributed systems, Experience scaling search or recommendation systems, ML or LLM production integration experience, Technical leadership and mentoring experience, Experience with data-intensive or event-driven architectures
Skills
LLMDistributed SystemsBackendAI/MLgenerative AIRAGLangChainMLOpsNLPDeep LearningGenAIData ScienceAIMachine LearningPyTorch
About the role
Responsibilities
- Architect the core intelligence and end-to-end sourcing engine, including data ingestion, ranking, and model orchestration
- Define scalable frameworks for retrieval, reranking, and LLM-driven evaluation to ensure high-quality, personalized results
- Lead technical discovery for emerging technologies such as memory systems, embedding models, and agentic frameworks
- Partner with product and design teams to shape AI-native product experiences and agentic UX patterns
- Provide architectural leadership and mentorship to engineers, raising the bar for system design and technical decision-making
- Drive cross-team clarity with Data and Infrastructure teams to ensure the sourcing system evolves as a cohesive unit
Requirements
- 7-8+ years of experience building distributed systems or large-scale backend architecture
- Proven experience designing and scaling search, recommendation, or ranking systems
- Experience leading or heavily contributing to ML or LLM integrations in a production environment
- Strong background with data-intensive systems, asynchronous processing, or event-driven architectures
- Demonstrated track record of technical leadership and mentoring other engineers
Benefits
- Top of the line health, dental, and vision insurance with 100% premium coverage
- 401k matching
- Free lunch in the office
- Monthly team dinners
- Commuter benefits
About the Company
Harmonic is the startup discovery engine. We are mapping the entire startup landscape to put the right companies in front of the right people at the right time. Our platform is used by leading investors and GTM teams at companies like Anthropic, OpenAI, and Notion to find breakout companies and turn discovery into action.
ScoutJobs Agent
Get matches like this delivered daily
Sign up free — we'll pull jobs that fit your CV from across the web and rank them for you.
Get started — it's freeStaff Software Engineer
Harmonic · New York
