Sr Engineer (Backend)

We are looking for a mid to senior level API Platform Engineer.

In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform.

Responsibilities

Design and build the Menlo API Platform, focusing on high reliability, performance, and a world-class developer experience

Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities

Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams

Manage and evolve a modern, cloud-native infrastructure stack, using Kubernetes, Docker, and infrastructure-as-code (IaC) tools

Ensure platform reliability, including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms

Contribute to developer and operations workflows, including CI/CD pipelines, release management, and on-call rotations

Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration

Continuously improve platform performance, cost-efficiency, and observability as we scale to serve millions of users worldwide

Requirements

3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations

Strong experience with containerization and orchestration: Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd)

Proficiency with cloud platforms: AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling

Hands-on coding skills in Python and JavaScript/TypeScript, with familiarity in backend frameworks (e.g., FastAPI, Express)

Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning

Experience with databases: PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS)

Familiarity with CI/CD pipelines, GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins

Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry

Bonus Experience

Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc.

Understanding of access control systems: ACLs, RBAC, multi-tenant security and isolation

Knowledge of billing systems, rate limiting, chargeback models, quota enforcement, and usage metering

Prior experience working on developer platforms or API products with a strong focus on UX and documentation

Originally posted on Himalayas