Senior Backend Engineer – AI / ML Infrastructure (Remote)

The Opportunity:

We’re partnering with a high-growth AI infrastructure company building a market-leading ML observability platform used by some of the most advanced engineering teams in the world.

The Backend Engineering team is responsible for highly scalable, distributed systems that power real-time analytics, model evaluation, and LLM monitoring at massive scale. While Go is the primary language, the platform also includes services written in Python, Java, and TypeScript.

This is a role for engineers who enjoy hard problems: distributed systems, OLAP architectures, real-time data pipelines, and AI-native tooling. You’ll be part of a core product team shaping how modern ML and LLM-powered applications are built, evaluated, and monitored in production.

What You’ll Be Building:

1. Core backend services powering a high-scale AI observability platform
2. Distributed analytics systems built primarily in Go (with Python, Java, and TypeScript in the mix)
3. APIs and infrastructure designed specifically for ML and LLM workflows
4. Real-time data pipelines handling massive throughput
5. Open-source extensions to OLAP databases and messaging systems
6. Tooling that helps teams understand, debug, and improve AI systems in production
7. Internal AI agents that help power and scale the product
8. You’ll work closely with product, design, and directly with customer engineering teams

What We’re Looking For:

1. 5+ years building backend or infrastructure systems that actually run in production
2. Strong experience in Go, Python, Java, TypeScript/Node, or similar
3. Comfort operating in fast-moving, low-bureaucracy environments
4. Experience with cloud infrastructure and containers (AWS/GCP/Azure, Kubernetes)
5. Curiosity and genuine excitement about AI, LLMs, and what’s coming next

Bonus Points:

1. Distributed streaming systems (Kafka or similar)
2. OLAP or analytics-heavy systems
3. Observability tooling (Prometheus, etc.)
4. ML / data science exposure
5. Hands-on experience building or shipping LLM-powered products

Comp & Perks:

1. $125k – $225k base + meaningful equity
2. Medical, dental, vision, 401(k)
3. Unlimited PTO
4. Generous parental leave
5. Mental health & wellness support

How We Work:

1. Remote-first, async-friendly culture
2. Optional offices in NYC and the SF Bay Area

Apply below if you're interested!

Are you looking for remote jobs near your area? At Yulys, thousands of employers are looking for exceptional talent like yours. Find a perfect job now.