Labs
Interactive sandboxes and simulations written to accompany select posts. Everything runs client-side in your browser.
Attention budget
Interactive simulation of transformer attention allocation across an adjustable context window. Tweak prompt phrasing or context and observe how model attention distributes. Intended to provide intuition for better prompting strategies and the 'lost in the middle' phenomenon.