https://gen-ai.fyi/one-layer-down/ Recent content in One Layer Down on Gen-AI Hugo -- gohugo.io en Sat, 29 Aug 2026 00:00:00 +0000 https://gen-ai.fyi/one-layer-down/first-gpu-backed-llm-run-colab/ Sat, 29 Aug 2026 00:00:00 +0000 https://gen-ai.fyi/one-layer-down/first-gpu-backed-llm-run-colab/ I have been reading plenty about inference systems: KV cache, PagedAttention, prefill, decode, batching, and disaggregated serving. But reading about the machinery is different from running it and watching the machine do work. This post is the first in the series that closes that gap. The goal was intentionally small: run one open-source model on a GPU, record what environment I actually got, generate 100 tokens, and capture enough numbers to make the next experiment less hand-wavy.