Search open positions
Back to results Apply
Platform Lead
Newbury
, Ohio Direct Hire
Remote
Platform Lead
Remote
$160,000-210,000
The Platform Lead will architect and implement distributed systems that integrate LLMs and agentic orchestration frameworks into our platform. They will partner with engineering, data science, and DevOps to deliver production-ready solutions while balancing scalability, reliability, security, and cost efficiency.
Platform Lead Responsibilities
Platform Lead Requirements
Remote
$160,000-210,000
The Platform Lead will architect and implement distributed systems that integrate LLMs and agentic orchestration frameworks into our platform. They will partner with engineering, data science, and DevOps to deliver production-ready solutions while balancing scalability, reliability, security, and cost efficiency.
Platform Lead Responsibilities
- Architecture & Systems Design: Design distributed systems and microservices, evaluating trade-offs in latency, throughput, and scalability
- Agentic Framework Integration: Implement and optimize orchestration frameworks (LangChain, AutoGen, Haystack, etc.); evaluate open source vs. enterprise tools.
- LLM Integration: Connect with APIs (OpenAI, Anthropic, Mistral, Cohere) and manage model hosting environments (Hugging Face, vLLM, Sagemaker, Azure).
- Tooling & Plugins: Develop and manage connectors that allow agents to interact with APIs, databases, and custom tools.
- Security & Compliance: Enforce RBAC, secrets management, auditing, and data governance best practices.
- DevOps/MLOps: Deploy and manage workloads with Docker/Kubernetes, implement CI/CD pipelines, and ensure monitoring, observability, and cost optimization.
Platform Lead Requirements
- 6+ years of experience in software/platform engineering, with at least 2+ years in technical leadership.
- Proven expertise in distributed systems and microservices design.
- Hands-on experience with agentic orchestration frameworks (LangChain, AutoGen, Haystack, etc.).
- Proficiency with LLM APIs and hosting platforms.
- Strong knowledge of cloud-native infrastructure (AWS, Azure, or GCP).
- Solid background in containerization (Docker, Kubernetes) and CI/CD pipelines
- Understanding of security and compliance practices (RBAC, secrets management, governance)
#ZR
