2026-05 Financial Statement
2026-05 Financial Statement
Jifeng Wu's Personal Website
How the KV Cache Works in HuggingFace Transformers
Every token a Transformer generates forces it to re-read the entire conversation so far. The KV cache is what makes this tractable — it stores the key and value projections of every past token so they
Rust Crates and Python Packages
A side-by-side comparison of Rust's crate system and Python's package system — covering project structure, visibility, distribution, version resolution, import paths, and publishing.
Local CUDA vLLM Setup for Python-Only Development Using a Precompiled Wheel
How to run vLLM directly from a local clone with editable Python code while using precompiled native libraries from a nightly wheel — no full source compilation required.
Recording Audio on Linux with PulseAudio
A minimal, dependency-free recipe for capturing system output and microphone audio on Linux using only PulseAudio's built-in tools: pactl and parec.
Type Theory Concepts: A to Z
An introduction to type theory concepts using Python, C++, and layman's terms.
What is S3?
S3 is a giant distributed hashmap exposed as both a public HTTP server and an authenticated REST API.