Backend Engineer, AI (Agent Systems) – Remote Job at Bjak | Find My Remote

Own and operate the AI inference and orchestration backend powering production AI interactions, emphasizing low latency, reliability, and scalable pipelines.

Responsibilities

Design AI inference pipelines and orchestration layers.
Build production APIs for AI interactions used by clients.
Implement monitoring, logging, alerting, and incident response.
Optimize latency, throughput, caching, batching, and streaming.
Ensure reliability for multi-step workflows and external tools.
Debug distributed systems under load.
Collaborate with ML and frontend teams to ship features.
Maintain clear API boundaries and service design.

Requirements

Proficiency in Python and Node.js.
Experience with PyTorch for AI inference.
Experience with OpenAI/Anthropic or open-source LLMs.
Strong SQL and NoSQL database experience.
Kubernetes and Docker for deployments.
Designing production-grade inference pipelines.
Building low-latency, high-throughput services.
Debugging distributed systems under load.
Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
Experience operating production systems with monitoring and incident response.

Nice to Have

Experience with multi-modal AI systems.
Experience with task automation or workflow tooling.
Familiarity with caching and streaming architectures.
Experience shipping in small, high-talent teams.