Software Engineer, AI Platform

Responsibilities

• Own the data platform and maintain the platform that powers every job across the company
• Run the LLM ETL pipeline including ingestion, transformation, enrichment, and storage
• Build agent transformation infrastructure to turn agent outputs into structured, queryable data
• Improve reliability, throughput, and cost of LLM-driven jobs in production
• Build observability and tooling for rapid debugging and iteration
• Partner with AI Engineers to expose new capabilities through the platform
• Participate in on-call rotation and incident response

Requirements

• Strong Python engineering experience supporting production systems (FastAPI or similar)
• Experience building or maintaining production pipelines with retries, backfills, and failure recovery
• Hands-on experience with a data orchestrator (Dagster, Airflow, Prefect, or Temporal) and dbt
• Proficiency with PostgreSQL at scale, including schema design and migrations
• Experience with AWS infrastructure (ECS, Lambda, SQS, Step Functions, RDS, S3) and IaC (Terraform/Terragrunt)
• Familiarity with LLM APIs and operational realities like latency, cost, and structured output

Preferred Qualifications

• Experience with distributed compute for Python (Anyscale Ray, Dask, or Spark)
• Experience with Polars and Pandas for data processing
• Familiarity with Datadog for observability and tracing
• Experience with cost optimization for LLM workloads
• Familiarity with pgvector or other vector stores
• Multi-region AWS deployment experience
• TypeScript/Node experience

Benefits

• Base salary: $180,000 - $250,000
• ESOP available
• $1,000 per month food and commuting allowance
• Laptop of choice
• E-3 sponsorship available for Australians with stipend

About the Company

Fluency builds a platform that captures how work actually happens inside large organizations, measures productivity and process conformance, and analyzes where AI can do the work.