ML Platform and Inference Engineer - Content Developer

Jala University is an innovative initiative designed to bridge the gap between academia and industry by delivering practical education tailored to industry needs, with a unique educational model integrating experts from both academia and industry.

Our goal is to transform the economies of underserved regions through the software industry, creating professional opportunities that impact individuals, communities, and regions, while leaving a lasting legacy for future generations.

Requirements

We're looking for a content developers for its Master in AI Systems Engineering. You'll design module content, labs, a reference implementation, an evaluation harness, and an instructor guide.

Requirements

5+ years shipping production software, including 2+ in production AI/ML

Able to personally build the course artifact to production standard

Public evidence of technical writing (docs, technical blog, open-source project)

Reproducibility discipline (pinned dependencies, containers, seeded runs)

Professional written English

Willing to hand over developed material to the program (course will be taught by others)

Track record fine-tuning classical ML / small foundation models

Experience shipping containerized inference services to production

Experience with multi-tenant serving in production (routing, queueing, isolation)

Track record in quantization and caching, with demonstrable serving cost reduction

Tech Stack

Docker, Modal (CPU/T4/A10 and H100/A100), Hugging Face Hub, scikit-learn, PyTorch, vLLM, Prometheus, Grafana, Locust or k6

Benefits

Remote work modality (home office).

Joining a dynamic and growing organization with international reach.

Originally posted on Himalayas