Posted 4 weeks ago
Software Engineer (Agentic Runtime)
United States 🇺🇸
- Onsite
- Full Time
- AWS
- Azure
- Google Cloud
- JavaScript
$180,000 - $210,000 year
Job description
- The Agentic Runtime team builds the low‑latency, reliable, and secure foundation that powers Glean’s AI agents and assistant experiences at scale
- You’ll design and operate core runtime services for multi‑turn orchestration, tool calling, model routing, memory, streaming, and safety
- You’ll work across distributed systems, production observability, and ML infra integrations to deliver an experience that feels instant, accurate, and trustworthy — while optimizing cost and reliability
- Own impactful runtime problems end‑to‑end — from architecture and design to production launch and ongoing reliability
- Build and evolve core services for session lifecycle, streaming responses (e.g., gRPC/WebSockets), structured tool execution, memory/state, and policy/guardrails
- Design for performance, correctness, and cost: reduce p50/p95 latency, improve tail behavior, and optimize token/tool budgets
- Integrate with leading LLM providers (e.g., OpenAI, Anthropic, Google Gemini) and internal evaluation frameworks to improve quality and predictability
- Harden the platform with fault isolation, retries, timeouts, circuit‑breaking, backpressure, and graceful degradation
- Instrument deep observability (tracing, metrics, logs) and create playbooks/SLOs for high availability and on‑call excellence
- Collaborate closely with product, quality, and application teams to prioritize the most impactful roadmap investments
- Experience operating services on Kubernetes and at least one major cloud (e.g., GCP, AWS, or Azure)
- Background in one or more areas is a plus: policy/guardrails, multi‑tenant isolation, rate‑limiting, concurrency control, cost optimization
- Practical understanding of LLM/agents building blocks: tool/function calling, structured outputs, streaming, and model selection/routing
- 3+ years of software engineering experience building production distributed systems or cloud‑native applications
- Ownership‑driven with a positive, proactive attitude; comfortable leading projects or learning from battle‑tested engineers
- Familiarity with event/streaming systems (e.g., Pub/Sub, Kafka), caching (e.g., Redis), and data stores for low‑latency paths
- Product‑minded: you prioritize customer impact, clear SLAs/SLOs, and pragmatic iteration
- BS/BA in Computer Science or related field, or equivalent practical experience
- Strong coding skills in at least one of: Python, Go, Java, Javascript, Typescript, C++, with a focus on reliability, performance, and tests
- Strong observability and debugging skills: tracing (e.g., OpenTelemetry), metrics, dashboards, and production forensics
More jobs at Glean
Native Mobile Software Engineer
Glean San Francisco, California, United States🇺🇸
Onsite Full Time $140,000 - $265,000 year 2 weeks ago
Software Engineer (Tech Lead, Admin Console)
Glean San Francisco, California, United States🇺🇸
Onsite Full Time $200,000 - $300,000 year 3 weeks ago
Software Engineer (Product Backend)
Glean United States 🇺🇸
Onsite Full Time $140,000 - $265,000 year 5 weeks ago
Frontend Software Engineer
Glean United States 🇺🇸
Onsite Full Time $115,000 - $260,000 year 11 weeks ago
Fullstack Software Engineer
Glean United States 🇺🇸
Onsite Full Time $140,000 - $265,000 year 11 weeks ago
Software Engineer (Developer Productivity)
Glean United States 🇺🇸
Onsite Full Time $140,000 - $265,000 year 11 weeks ago
Software Engineer (Data Foundations)
Glean United States 🇺🇸
Onsite Full Time $180,000 - $300,000 year 11 weeks ago
Other jobs in United States
Instructional Facilitator, Special Education, Elementary Schools
Howard County Public School System United States 🇺🇸
Onsite Full Time 15 minutes ago
Environmental Services Aide
Golden Valley Memorial Healthcare United States 🇺🇸
Onsite Full Time 17 minutes ago
Electrolyte Systems & Chemical Process Engineer
Voxel Innovations, Inc. Knightdale, North Carolina, United States🇺🇸
Onsite Full Time 17 minutes ago
In-Home Bath/Shower Sales Representative
Bath Concepts Independent Dealers Billings, Montana, United States🇺🇸
Onsite Full Time $75,000 - $150,000 year 12 minutes ago
Bath/Shower Installer (Wet-Area / Tub-to-Shower Conversions)
Bath Concepts Independent Dealers Billings, Montana, United States🇺🇸
Onsite Full Time $22 - $29 hour 14 minutes ago
Sunnyvale Campus Pastor
Echo Church Sunnyvale, California, United States🇺🇸
Onsite Full Time $90,000-$110,00 Salary 24 minutes ago
Guest Room Supervisor
InTown Services Corp Greenville, South Carolina, United States🇺🇸
Onsite Full Time 24 minutes ago
Senior Software Engineer: Site Reliability Engineering
Jack Henry Remote · United States 🇺🇸
Remote Full Time 24 minutes ago