Eater
Software Engineer - AI Tooling Infrastructure
- Location
- US, United States
- Work type
- Remote · Full-time
- Posted
- (1 day ago)
About the role
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in United States.
We are looking for an experienced Software Engineer to build, operate, and scale the backend infrastructure powering innovative AI-driven developer tools. In this role, you will take ownership of production services, including infrastructure supporting AI agents, developer assistants, and Model Context Protocol (MCP) integrations. You will focus on ensuring reliability, security, performance, and observability in an environment where AI-driven traffic introduces unique infrastructure challenges. Working closely with platform, security, and infrastructure teams, you will help shape scalable architectures and improve operational excellence. This is a hands-on engineering position offering significant ownership over systems running in production. You will join a globally distributed, asynchronous engineering environment that values autonomy, open-source development, and continuous improvement.
Accountabilities:
Requirements:
At least 5 years of experience building, deploying, and operating production backend services, including participation in on-call rotations. Strong programming skills in TypeScript or Go, with practical working knowledge of the other language. Proven experience designing and maintaining APIs, including versioning, error handling, rate limiting, and backward compatibility. Strong understanding of OAuth, OpenID Connect (OIDC), JWT, and API authorization, with the ability to troubleshoot authentication and permission issues in production environments. Good knowledge of PostgreSQL and relational database systems. Experience with CI/CD pipelines, Docker, containerized deployments, and Infrastructure as Code (IaC). Ability to troubleshoot distributed systems using metrics, logs, and traces to identify performance bottlenecks and service failures. Strong written and verbal communication skills, with the ability to collaborate across teams and work effectively in globally distributed, asynchronous environments. Adaptability, ownership, and the ability to navigate ambiguity while delivering solutions in fast-paced engineering environments. Deep expertise in at least one of the following areas: APIs and Authentication: Experience designing permission models, token scopes, and OAuth flows for third-party integrations or machine clients, including safely migrating authentication systems without disrupting existing users. Production Operations: Hands-on experience managing production services, participating in on-call rotations, developing alerts and runbooks, implementing SLOs, and improving system reliability. Gateways and Distributed Systems: Experience building or operating proxies, gateways, or distributed services, troubleshooting retries, partial failures, upstream outages, and making appropriate fail-open or fail-closed decisions under degraded conditions.Nice to have:
Experience with AI agent tooling, Model Context Protocol (MCP), or infrastructure serving AI agents and LLM clients. Experience extracting services from larger codebases while maintaining compatibility with existing integrations. Familiarity with observability platforms such as Grafana, OpenTelemetry, or Logflare, along with practical experience implementing SLOs. Contributions to open-source projects, particularly within the Node.js, Go, TypeScript, or API tooling ecosystems.