About

The Anh Nguyen

Hi, I’m The Anh Nguyen (@ntheanh201), based in Hanoi, Vietnam. I lead a team building GPU infrastructure and LLM serving on Kubernetes, and I speak at community events about what we learn along the way.

Now

I’m tech lead and solutions architect for the Viettel AI Platform at Viettel Networks, a multi-tenant GPU platform and a Certified Kubernetes AI Platform under CNCF’s AI Conformance program. That includes Token Factory, which serves LLMs at scale.

  • Token Factory: LLM inference at scale with NVIDIA Dynamo, serving multiple LLM families
  • GPU fleet: NVIDIA H200 clusters on NVIDIA AI Enterprise and Base Command Manager (BCM)
  • GPU and fabric: GPU Operator and Network Operator, InfiniBand with GPUDirect RDMA, multi-node NCCL, and HAMi fractional-GPU sharing for multi-tenancy
  • Upstream: contributing to NVIDIA DSX OS components: KAI Scheduler, Run:ai, Workload Map, AI Cluster Runtime (AICR) and Cluster Readiness Engine (NVCRE)

Recognition

See all certifications, including NVIDIA NCP-AII and NCP-AIN, LFCS and the Nebius AI certifications.

Open source

Project What I do
kai-scheduler/KAI-Scheduler NVIDIA DSX OS: Kubernetes-native scheduler for AI workloads
dsx-ai-factory/run-ai NVIDIA DSX OS: Run:ai AI workload orchestration platform
dsx-ai-factory/workload-map NVIDIA DSX OS: maps framework CRDs into a generic workload structure
NVIDIA/aicr NVIDIA DSX OS: AI Cluster Runtime (AICR), validated, version-locked recipes for GPU Kubernetes clusters
NVIDIA/cluster-readiness-engine NVIDIA DSX OS: Cluster Readiness Engine (NVCRE), certifies GPU clusters under real distributed load before production
kubernetes/website Kubernetes org member, SIG Docs Vietnamese localization approver
cncf/glossary Vietnamese localization lead for the Cloud Native Glossary
Project-HAMi/HAMi Org member; fractional GPU sharing for Kubernetes
kubeflow/kubeflow AI/ML platform on Kubernetes
apache/trafficcontrol CDN; upstreamed the Grafana Scenes dashboards

Talks

I speak at community events in Vietnam, from Cloud Native Hanoi meetups to KCD & OpenInfra Days. Each talk below links to a recap on this site.

Competitions

As tech lead of the AI Platform, I’m responsible for the GPU platform these competitions run on:

  • Viettel AI Race 2025 and 2026: the environments every team trains and submits on (Hackathon Day 2025)
  • Vietnam AI Open Hackathon 2026, with NVIDIA: on the technical support team; the cluster passed all 14 checks in NVIDIA’s Cluster Readiness Checklist (post)

Projects

Elsewhere

GitHub · LinkedIn · X · Facebook