About
Hi, I’m The Anh Nguyen (@ntheanh201), a software engineer based in Hanoi, Vietnam.
Now
I’m the Solutions Architect for the Viettel AI Platform at Viettel Networks, a multi-tenant GPU supercomputing platform, and I lead the Token Factory project.
- Token Factory: LLM inference at scale with NVIDIA Dynamo, serving multiple LLM families
- GPU fleet: NVIDIA H200 clusters on NVIDIA AI Enterprise and Base Command Manager (BCM)
- GPU and fabric: GPU Operator and Network Operator, InfiniBand with GPUDirect RDMA, multi-node NCCL, and HAMi fractional-GPU sharing for multi-tenancy
- Upstream: contributing to NVIDIA DSX OS components: KAI Scheduler, Run:ai, Workload Map, AI Cluster Runtime (AICR) and Cluster Readiness Engine (NVCRE)
Recognition
- CNCF Ambassador, Cloud Native Computing Foundation
- Kubestronaut: CKA, CKAD, CKS, KCNA, KCSA
- NVIDIA-Certified Professional: AI Operations (NCP-AIO), AI Infrastructure (NCP-AII), AI Networking (NCP-AIN)
- Claude Certified Architect – Foundations, Anthropic
- The Shubhra Kar Linux Foundation Training (LiFT) Scholarship, 2025 recipient
- Turning GPU-hours into tokens, my case study on serving multiple LLM families with NVIDIA Dynamo, is listed in NVIDIA Dynamo External Publications
See all certifications, including NVIDIA NCP-AII and NCP-AIN, LFCS and the Nebius AI certifications.
Open source
| Project | What I do |
|---|---|
| kai-scheduler/KAI-Scheduler | NVIDIA DSX OS: Kubernetes-native scheduler for AI workloads |
| dsx-ai-factory/run-ai | NVIDIA DSX OS: Run:ai AI workload orchestration platform |
| dsx-ai-factory/workload-map | NVIDIA DSX OS: maps framework CRDs into a generic workload structure |
| NVIDIA/aicr | NVIDIA DSX OS: AI Cluster Runtime (AICR), validated, version-locked recipes for GPU Kubernetes clusters |
| NVIDIA/cluster-readiness-engine | NVIDIA DSX OS: Cluster Readiness Engine (NVCRE), certifies GPU clusters under real distributed load before production |
| kubernetes/website | Kubernetes org member, SIG Docs Vietnamese localization approver |
| cncf/glossary | Vietnamese localization lead for the Cloud Native Glossary |
| Project-HAMi/HAMi | Org member; fractional GPU sharing for Kubernetes |
| kubeflow/kubeflow | AI/ML platform on Kubernetes |
| apache/trafficcontrol | CDN; upstreamed the Grafana Scenes dashboards |
Talks
- Turning GPU-Hours into Tokens, and Tokens into a Service: Agent Router and NVIDIA Dynamo, VOI & CNVN x AWS FCAJ Meetup: Cloud & AI Infrastructure, Hanoi, 2026
- From Project to Production: HAMi and Viettel Cloud, KCD & OpenInfra Days Vietnam 2026
- Auditable Autonomy: Engineering With AI Teammates That Leave a Trace, The Future of Software Engineering in the Agentic AI era
- From Vietnam to the World: Contributing to Kubernetes and earning the Linux Foundation Scholarship, #cTENcf Birthday Bash Hanoi
- AI GÕ CỬA — Doanh nghiệp Việt đã sẵn sàng?, VIETTELDX TALKS #8
- HAMi: Fractional GPU for Efficient AI in Cloud Native, OpenInfra & Cloud Native Day Vietnam 2025
- Fractional GPU for AI: Open Source Solutions in Cloud Native, Cloud Native Hanoi May Meetup
Projects
- trafficcontrol-grafana-scenes: dynamic Grafana dashboards for Apache Traffic Control built on Scenes, upstreamed in trafficcontrol#7927
- k8s-auto-healing: a Go controller that runs periodic health checks and auto-remediates known failures (e.g. Zalando Postgres replication lag) from Prometheus alerts
- react-user-feedback: a drop-in feedback widget for React apps