Junior/Senior/Staff Software Engineer, Inference / Compute Infrastructure Engineering

Amsterdam30+ days ago

In English

About the job

Together AI is hiring a Software Engineer for its Inference / Compute Infrastructure Engineering team in Amsterdam. You will build and automate the physical host lifecycle and control plane for inference clusters, ensuring reliability and partnering with ML platform teams.

What you will do

Build provisioning state machine for physical host lifecycle
Design declarative APIs and control plane for inference clusters
Automate self-healing of degraded or failed nodes
Ensure reliability of provisioning pipeline with idempotency and drift detection
Partner with inference/ML platform team on cluster requirements
Engineer infrastructure code with strong typing, tests, and CI/CD

What you bring

Strong software engineering background in Go, Python, Rust, or similar
Experience with durable workflow orchestration tools like Temporal or Cadence
Experience building software control planes or orchestration systems
Experience with event-driven systems using message queues or pub/sub
Product mindset with experience building internal platforms or APIs

Nice to have

Exposure to bare-metal provisioning or networking fundamentals
Experience with GPU cluster software stacks
Prior work at hyperscaler or datacenter-scale infrastructure organization
Systems programming in Rust or Go

Summary by Personeel.com. The full job description and the application form are on Together AI's website (job-boards.greenhouse.io); Apply takes you straight there.

More jobs at Together AI

All 10 jobs at Together AI