MP@MinglongPan

Seattle · Field notes, 2026

MinglongPan

Software Engineer · AI Infrastructure

I build the infrastructure that lets models act in production—multi-tenant LLM serving, model guardrails, staged rollouts, and bounded agent systems.

I / The system registry

Seven systems,
one point of view.

Agents should be inspectable, bounded, and worth interrupting a human for. This atlas is the public edge of the systems I build and the patterns I am testing.

  1. N-01

    paws / woolroom

    Live private product · MIT engine

    A shared ambient digital pet for two humans, live with real users. paws is the private household product; woolroom is its MIT-licensed, self-hostable engine for room state, mood, memory, realtime sync, and bounded responses.

    Watch paws ↗Open-source engine →
  2. N-02

    ThreadLang

    OSS · PyPI

    A compact DSL and single-node runtime for bounded, traceable LLM workflows — grammar → frozen-dataclass AST → deterministic runtime with durable runs, contracts, and replay. Published on PyPI.

    Install from PyPI ↗
  3. N-03

    finance-os

    Private

    A personal investment platform: a ~70-name universe scored on 11 LLM-graded dimensions, with kill-trigger monitors and daily Telegram alerts.

    Design notes →
  4. N-04

    Valhalla

    Personal OS

    The product layer between my agent fleet and my attention — one ranked decision surface, deterministic rendering, and a constrained action gate. Private by design.

    Product walkthrough →
  5. N-05

    Persona-routed MCP

    Pattern

    A persona-routed stdio MCP server — a semantic router maps the task or todos to persona → skills → tools, auto-loading team resource packages; team behavior lives in its own JSON config. Adopted across teams without forking shared infrastructure.

    Pattern note →
  6. N-06

    Agent fleet

    Fleet

    A personal fleet of AI agents on Telegram — runtime-agnostic by design: Claude Code, Hermes, Codex, and Kimi are interchangeable labor. Ming owns the ideas and final review; the fleet assists production and maintenance.

    How it's run →
  7. N-07

    agent-usage-manager

    OSS

    htop for AI agents — liveness, CPU/RAM/GPU usage, and a kill switch for headless agents: OpenClaw, Hermes, Ollama, vLLM, Claude Code.

    Install from PyPI ↗

II / Selected work

Production is
the design constraint.

At Amazon, I own multi-tenant LLM serving, model guardrails, and staged-rollout infrastructure for real-time GenAI translation across regions.

Current practiceAI platform · Amazon

Make the model operable, not merely impressive.

Tenant onboarding, request routing, per-tenant cost tracking, eval-gated rollout, safety controls, and a kill switch—the infrastructure around inference is the product.

  • Multi-tenant serving
  • AWS Bedrock
  • Production evals
  • Model guardrails
  • Staged rollout

III / Trajectory

From the
subsurface
to systems
that act.

  1. Rice University · M.S. in Geophysics

    Signal, structure, and uncertainty—the visual language of this atlas begins in seismic imaging.

  2. Viridien (formerly CGG Geophysics) · Software Engineer

    Signal-processing and 3D seismic-imaging pipelines over large subsurface datasets.

  3. Amazon · Software Engineer

    Distributed backend systems, chat infrastructure, and production GenAI translation on AWS.

  4. Independent systems

    Open-source runtimes, personal agent infrastructure, and field notes on keeping AI bounded and observable.

Complete career recordExperience · skills · education · research
8 yrsdistributed backend and AI infrastructure on AWS
Multi-tenantLLM-serving platform for GenAI translation
Multi-regionreal-time LLM translation serving in production
MCPreusable AI-agent infrastructure adopted across teams
01

Summary

Software engineer building production AI infrastructure for large-scale, customer-facing systems. I own multi-tenant LLM serving, model guardrails, and rollout infrastructure for real-time GenAI translation at Amazon, serving many languages across multiple regions. ~8 years building distributed backend systems across AWS, production operations, and large-scale data processing.

02

Experience

Software Engineer, Amazon

Jun 2021 — Present

Customer Service · GenAI Translation · Chat Infrastructure

AI Platform & Multi-Tenant LLM Serving

  • Designed and own multi-tenant LLM serving for real-time GenAI translation on AWS Bedrock — automated tenant onboarding, request routing, and per-tenant cost tracking across regions, with faster tenant onboarding and improved serving efficiency at production scale.
  • Built the multi-tenant serving and staged-rollout infrastructure used to migrate production traffic from legacy machine translation to GenAI translation on Bedrock — eval-gated dial-up rollouts across many languages and regions.
  • Built a persona-routed MCP server framework (Python FastMCP, stdio) on Anthropic's Model Context Protocol — semantic routing of tasks to persona → skills → tools, with team resource packages and per-team JSON config; adopted by peer teams without forking shared infrastructure.
  • Built MCP-based internal AI agents for developer-productivity and incident-response workflows.
  • Led an enterprise onboarding across European and Japanese marketplaces — large-scale terminology and multilingual configuration, delivered as a staged production change.

Inference Reliability, Safety & Cost Optimization

  • Built guardrails on AWS Bedrock for the GenAI translation stack, screening model output before it reaches customers; extended the translation evaluation framework with standard MT-quality metrics (chrF++, COMET) and LLM-as-judge meaning-preservation checks.
  • Built a direction-aware SageMaker scaling tool with dry-run and rollback that significantly right-sized GenAI inference capacity during the MT→GenAI cutover, materially cutting compute cost.
  • Built staged prompt-rollout controls with a safe kill-switch and per-tenant gating; hardened batch inference with retry/backoff and concurrency limits for reliability under throttling.

Distributed Platform Engineering & Migrations

  • Migrated a regional voice channel to Amazon Connect — resolved cross-region TLS and IAM integration challenges and coordinated multiple partner teams to bring customer-service agents online at scale.
  • Migrated a core chat service to a container-based architecture on ECS/Fargate; built load- and stress-testing infrastructure for active chat monitoring, throttling, and persistence across regions.
  • Led the cross-organization transfer of a suite of chat services between engineering teams — authored knowledge-transfer documentation and ramped the receiving team with no major operational incidents.

Technical Communication

  • Authored internal engineering write-ups on AI developer tooling and MCP-based workflows to socialize reusable AI-infrastructure patterns across teams.

Software Engineer, Viridien (formerly CGG Geophysics)

Jun 2018 — Jun 2021

U.S. Seismic Imaging Department · 3D subsurface imaging workflows for major Oil & Gas clients

  • Built signal-processing and seismic-imaging pipelines in Perl / Java / Python — Fourier transform, Tau-P transform, filter design — on petabyte-scale seismic data spanning 120+ km³ subsurface volume; improved image SNR by 5+ dB.
  • Developed tree-based classification algorithm in Java and released to production; improved workflow throughput, contributing to major proprietary client engagements.
03

Skills

AI / LLM Systems

multi-tenant LLM servingBedrock Guardrailsproduction evalschrF++ / COMET / LLM-as-judgeprompt rolloutMCP / FastMCPAWS BedrockSageMaker

Distributed Systems & Cloud

ECS/FargateLambdaDynamoDBAurora/RDSStep FunctionsCloudWatchCDKevent-driven architecturesmulti-regionobservabilityincident response

Languages

PythonJavaTypeScriptJavaScriptSQLPerlShell
04

Education

Rice University — M.S. in Geophysics

Jul 2016 — May 2018 · Houston, TX

Yangtze University — B.Eng.

Aug 2012 — Jun 2016 · Hubei, China

05

Research & Publications

  • Co-author, Geophysical Research Letters (Carlson et al., 2021) — “Impacts of engineered diversions and natural avulsions on delta-lobe stability.” doi:10.1029/2021GL092438
  • Presentations at American Geophysical Union (AGU) Fall Meeting (2019, 2021) on channel diversion characteristics and delta-lobe stability.

IV / Writing

Notes from
inside the system.

What failed, which boundary held, and what transfers beyond one codebase. Production AI, reliable agents, and human control.

  1. Why a self-improving agent's accept rate isn't a quality metric

    My eval gate scored a byte-identical file 0.167 better than itself and approved it. The number I trusted for months only recorded my own approvals.

  2. How I run a personal agent fleet

    Runtime-agnostic agents on Telegram — Claude Code, Hermes, Codex, Kimi as interchangeable labor — with a shared knowledge memory, cron-driven loops, and a rule that everything the fleet ships gets verified before it's claimed.

  3. A coherent virtual pet without an LLM

    Coherence in an ambient pet comes from explicit state, bounded choices, and reliable fallbacks — not from generating every line at runtime. The pattern: a two-axis mood lattice, an authored phrasebook with a strict fallback order, event-indexed selection, a conservative intent classifier, and a validator-gated LLM lane that can only ever audition.

  4. Why local pre-commit hooks can't stop an agent from writing outside its lane

    Local Git hooks catch honest mistakes, but an agent with shell access can bypass them; mandatory review requires isolation or a receiver-side gate.

  5. Valhalla: the product layer between agents and attention

    A product walkthrough of the personal operations layer I use to turn agent output into one ranked, privacy-aware decision surface, with its frontend and backend boundaries.

All writing 14 field notes
  1. Why I capped my AI approval queue at 5 decisions, not more

    Human approval is a capacity-constrained service, so I cap my remote AI decision docket at five and drain the backlog in focused review sessions.

  2. Why tmux is the wrong IPC layer for an agent fleet

    Ten times in eighteen days I pasted one AI agent's output into another agent's window. There is no wire between them. The wire is me.

  3. My AI writing pipeline now reviews its own drafts before I see them

    Generation instructions are not enforcement. I run independent persona and house-rules reviews over every fresh draft, then file findings as blocking comments before human review.

  4. One Telegram thread logs my meals, trades, and practice reps

    One Telegram thread logs meals, workouts, weight, guitar, trades, and practice reps through verb prefixes, deterministic state, and a strict separation between capture and dispatch.

  5. finance-os: a decision system, not a stock picker

    A personal investment platform that scores a ~70-name universe on 11 LLM-graded dimensions, blends probability-weighted scenarios, and treats the kill trigger as a first-class object — the design notes.

  6. Persona-routed agent tooling: one stdio server, every team's capabilities

    A semantic router that reads the task or todo list, routes to persona → skills → tools, and auto-loads team resource packages — one stdio binary that works with any CLI or agentic tooling, with team behavior living in its own JSON config.

  7. Three agent frameworks converged on a control-plane protocol this month. I run my fleet on tmux and chose not to adopt it.

    Three frameworks shipped the same control-plane idea in a month — external process control, capability negotiation, env-var hygiene. What converged, why my tmux fleet already has the failure modes it solves priced in, and the two concrete triggers that would make me adopt it.

  8. Anti-Engagement AI: Software You Can Walk Away From

    As AI makes infinite engagement easier, the better product bet may be software that respects absence.

  9. ThreadLang: a deterministic DSL for LLM workflows

    Most multi-step LLM code is prompt strings glued together in a Python function. ThreadLang makes the workflow the program — a grammar, an AST, and a structured trace you can run without a network call.