Chuyue Wang

LLM systems & agents. Penn '29.

I make LLM inference faster at Penn's Distributed Systems Lab, and test whether models can be trusted to review scientific papers at Wharton.

Now

steven’s thinking

I work on the parts of an agent that have to hold up when nobody is checking. Sparse attention that cuts KV-cache reads without trading away accuracy. A benchmark that asks whether a model can referee a paper it has never seen. A memory layer that lets an agent reuse what it worked out last week.

The hard part is never the idea. It is the latency budget, the stale state, and the instruction that only half specifies the job.

Selected Experience

Research and engineering, most recent first — open a row for the full account.

Jun 2026 —
Philadelphia, PA

Research Engineer, advised by Prof. Bingxin Zhao

Can a model referee a paper it has never seen? I built the post-cutoff benchmark that tries to answer it — 400 papers, close to 20,000 evaluations — and the causal studies that pull apart reasoning, memorization, and role-play. On anonymized papers it ranks citations correctly 82.5% of the time. The uncomfortable finding is elsewhere: what a model remembers about an author can outweigh what the paper in front of it actually says.

  • Python
  • LLM Eval
  • Benchmarks
May 2026 — Aug 2026
Nanjing, China

Research Engineer

Co-authored Traj2Mem, a procedural memory that mines an agent's past trajectories for the strategies that actually worked, then replays them when a new request is underspecified. No retraining. I owned the trajectory-processing, retrieval, and evaluation pipelines that keep the cross-model ablations reproducible. The results have since gone into the institute's technology-transfer base, which works closely with ByteDance, OPPO and other companies.

  • Python
  • Agent Memory
  • Retrieval
Mar 2026 — Apr 2026
San Francisco, CA

Agent Engineering Intern

Agent tests were flaky, because the payloads were encrypted and no two runs were alike. I shipped the Case Test Service — record once, replay deterministically, inject fixtures at runtime — and the 191 assertion pipelines that decide whether a replay actually passed. I also built the parallel evaluation harness on Redis and Postgres, and a context assembler that merges ranked vector search, SQLite FTS5, and live OS signals fast enough to sit in the request path.

  • Python
  • Redis
  • PostgreSQL
  • WebArena
Feb 2026 —
Philadelphia, PA

Research Assistant, advised by Prof. Vincent Liu

TreeSparseAttention parses a prompt into a semantic tree, then pages the KV cache by what the query actually needs. I wrote the scorer by hand in CUDA/C++ on cuBLASLt FP8, where it runs 20.9× faster at batch 128 and latency stays nearly flat as batch size climbs, which is where serving cost actually goes. Profiling Qwen3-VL on B200 and RTX 5060 Ti cut decode latency 31% and held 1.67× SGLang throughput at batch 4.

Before that, FullStackArena: 1,000+ browser-agent tasks across fintech, ride-sharing, and mapping apps, scored by LLM judges and checked against real DOM and API state. Under review at NeurIPS 2026.

  • CUDA/C++
  • FP8
  • SGLang
  • FlashInfer
Jan 2026 —
Philadelphia, PA

Research Software Engineer, advised by Prof. Hsiao-Wen Cheng

Eight hundred years of Song-dynasty writing, 2,700+ works, catalogued by hand one at a time. I built a Flask and PostgreSQL platform that pulls entities out with NLP and scores its own confidence before anything is committed, so a human only reviews what the model is unsure of, and about 70% of the hand cataloguing goes away. The Greater Philadelphia Asian Studies Consortium picked it as one of two projects from over 100 submissions.

  • Flask
  • PostgreSQL
  • NLP
Oct 2025 — Feb 2026
Philadelphia, PA

Founding Engineer

A networking agent that lives inside iMessage, with no app to install. LangGraph runs the orchestration; matching runs on hybrid vector and graph search over people and what they have worked on. I built the backend for the case where things go wrong: durable queues, isolated failures, backoff retries, and rate limits on FastAPI, Redis, and Postgres.

  • LangGraph
  • FastAPI
  • Redis
Mar 2024 — Jun 2024
Nanjing, China

Derivatives Valuation Intern

Implemented Gaussian Heath–Jarrow–Morton models for interest-rate swaption pricing, cutting pricing error about 15%. Then rewrote the exotic structured-equity valuation path the desk ran every day, taking a run from two days down to four hours.

  • Python
  • Numerical Methods
Publications

Under submission. Titles are withheld where double-blind review applies.

AAAI 2027
Under submission

A mysterious paper on Agent Memory Retrieval

Chuyue Wang, …

Title and co-authors withheld under double-blind review.

AAAI 2027
Under submission

A mysterious paper on 3D Gaussian Splatting and Reinforcement Learning

…, Chuyue Wang*, …

*Equal contribution. Title and co-authors withheld under double-blind review.

NeurIPS 2026
Under submission

FullStackArena: Evaluating Browser Agents in Dynamic and Temporally Evolving Full-Stack Environments

Jiaheng Lu, Xian Wang, Shrishti Roy, Colin Zhao, Sidharth Sankhe, Chuyue Wang, Xuting Liu, Spyros Pavlatos, Linh Phan, Vincent Liu

Selected Projects

Nights and weekends. All open source.

Visit SILKern. (opens in new tab)

Sparse-index localization kernels for context-parallel decode — deterministic, allocation-free, CUDA-graph-safe.

Hand-written CUDA kernels that localize sparse KV indices under context-parallel decode — deterministic, allocation-free, and CUDA-graph-safe, so they can sit inside a captured decode graph without ever touching the allocator.

  • CUDA
  • Python

Visit Township (opens in new tab)

AI residents deliberate civic questions in a living pixel town — a replayable, scenario-first simulation engine.

Pixel-art town from Township, where AI residents gather to deliberate

Put a civic question in a living pixel town and watch AI residents reason, talk, disagree, and change their minds. A replayable, scenario-first simulation engine — every run is recorded, every deliberation can be replayed.

  • Python
  • FastAPI
  • React
  • Phaser

Visit AutoPaperLab (opens in new tab)

Turns research briefs into auditable paper packages — verified citations, reproducible experiments.

A paper figure produced by AutoPaperLab — offline credit labeling feeding reranker training and decision-time selection

A research-to-paper pipeline built on one rule: every citation, number, and result has to trace back to something real, or the draft does not ship.

  • Python
  • LLM Agents
Index

Everything else.

Chuyue Wang

Philadelphia · wangcy07@sas.upenn.edu

Recognition