39 posts in total
2026
Rust Crates and Python Packages
Local CUDA vLLM Setup for Python-Only Development Using a Precompiled Wheel
Compile NEFF Executables from NKI Kernels
Type Theory Concepts: A to Z
What is S3?
vLLM Internals — PagedAttention and Custom Accelerator Compilation
Hugging Face Models: Repositories, Serving, and the Inference Engine Landscape
Exporting Compute Graphs, LLM Shape Dynamics, and Serving Runtimes
Schedules in Machine Learning Computation: What They Are and Who Needs to Know About Them
Important Locations on Jailbroken iOS