Posted 6 weeks ago

Technical Product Manager (Observability)

Mirantis
Remote · United States 🇺🇸
  • Remote
  • Full Time
  • Kubernetes
  • Product Management

Job description

  • Mirantis is looking for a Technical Product Manager to own observability for k0rdent AI, our control plane for GPU infrastructure and distributed AI workloads
  • In this role, you will define the observability strategy, roadmap, and feature priorities that determine how operators gain visibility into the health, performance, and resource utilization of GPU clusters running large-scale training and inference
  • You will shape how k0rdent AI handles everything from GPU-level metrics and distributed tracing across AI workloads, to multi-tenant log aggregation and intelligent alerting — powered by the OpenTelemetry ecosystem, and Prometheus-compatible metrics pipelines
  • You will work directly with engineering to shape requirements, with marketing to define positioning, and with customers to help ensure their success
  • Own the vision, roadmap, and priorities for k0rdent AI observability across the full stack: GPU compute, east-west fabric (InfiniBand, RoCE), high-performance storage, DPU/SmartNIC telemetry, workload schedulers, inference serving, and data services
  • Translate requirements from NeoClouds, GPU clouds, telcos, sovereign clouds, and enterprise platform teams into clear product direction; partner with engineering to define requirements and evaluate trade-offs
  • Manage the observability backlog using feedback from production deployments and design partners to refine priorities
  • Track and shape our response to emerging observability standards and technologies, including OpenTelemetry (OTel), DCGM GPU metrics, InfiniBand/RoCE fabric counters, storage platform telemetry APIs, and AI workload profiling
  • Define integration strategies for vendor telemetry sources across the ecosystem — NVIDIA compute and BlueField DPUs, storage platforms (VAST, Weka, DDN), workload managers (SLURM), inference stacks, and vector and relational databases — into a unified, operator-facing observability plane
  • Partner with product marketing and field teams on positioning, technical briefs, and reference architectures; represent Mirantis with customers, analysts, and ecosystem partners
  • The ideal candidate brings strong technical fluency in observability tooling and the AI infrastructure stack
  • Fluency in Kubernetes observability, cloud-native monitoring, or metrics and alerting pipeline architecture
  • 5+ years in product management or a senior technical role owning an observability product or operating large-scale monitoring infrastructure
  • Working knowledge of Prometheus, OpenTelemetry, distributed tracing (Jaeger, Tempo), and log aggregation (Loki, Elasticsearch/OpenSearch)
  • Ability to work directly with engineering on technical trade-offs and with field teams in competitive GPU cloud and NeoCloud deals
  • Exposure to GPU observability, including DCGM metrics, AI workload profiling and performance analysis
  • Familiarity with east-west fabric telemetry - InfiniBand counters, RoCEv2 congestion metrics (ECN, PFC, DCQCN), or switch-level fabric health
  • Experience with high-performance storage telemetry from platforms such as VAST Data, Weka, or DDN, including IOPS, latency, and throughput instrumentation at scale
  • Familiarity with NVIDIA BlueField DPU telemetry, SR-IOV, or offload pipeline observability
  • Exposure to workload-level visibility for SLURM job scheduling, inference serving stacks (vLLM, Triton, TensorRT-LLM), or data service telemetry from vector databases (Milvus, Qdrant) and relational databases in AI pipelines

More remote jobs in the United States