Profile a NEFF Executable
Capture and visualize execution traces from pre-compiled NEFF binaries using neuron-explorer.
Jifeng Wu's Personal Website
On the Threshold of Thirty
We are rapidly approaching the age of thirty. We have always felt as if our lives could end at any stage. This is not a morbid thought - it is a kind of alertness, a refusal to take tomorrow for grant
vLLM Platform System
A deep dive into vLLM's plugin-based platform architecture, Python entry points, auto-detection pipeline, and how to add a new out-of-tree hardware platform.
How the KV Cache Works in HuggingFace Transformers
Every token a Transformer generates forces it to re-read the entire conversation so far. The KV cache is what makes this tractable — it stores the key and value projections of every past token so they
Rust Crates and Python Packages
A side-by-side comparison of Rust's crate system and Python's package system — covering project structure, visibility, distribution, version resolution, import paths, and publishing.