MemPalace - A Short Case Study in AI Systems Engineering »

Illustration: Milla Jovovich engineering in a sea of documents A short case study in AI systems engineering: Hollywood actress Milla Jovovich released an AI memory system with 12k+ stars on GitHub. MemPalace - A short case study in AI engineering and marketing. Yes, that Milla …


Moore's Law for AI? »

From Single-Core Limits to Multi-Agent Systems Moore’s Law [1] fueled decades of computing progress by predicting the doubling of transistor density approximately every two years. For a long time, this translated into rapid gains in CPU speed-until thermal limits and the …


The Four Paradigms of Prompting »

Introduction Large language models (LLMs) map sequences of text to other sequences of text. Given an input string, an LLM predicts the most probable continuation based on the statistical patterns it has learned during its training process. What makes LLMs remarkable is not merely …


uv - An Extremely Fast Python Package and Project Manager, Written in Rust »

There exist a broad selection of package managers that manage virtual environments and packages for us. Some of the most popular ones are conda, pip and virtualenv or virtualenvwrapper. They can almost all do the same things: Install packages Resolve dependencies Managing package …


How to Choose Tech for Production: The Default Heuristic »

Introduction During my time as a lead data engineer to build a predictive maintenance platform I came across the concept of the default heuristic. One of my tasks was to identify platform components that would allow us to scale storage and retrieval of time series sensory data to …


The Difference Between a Base LLM and an Instruction-Tuned LLM »

Introduction Large language models (LLMs) can behave very differently depending on how they were trained. BaseLLMs are trained purely on next-token prediction over a large corpus of text. Instruction-tuned LLMs, by contrast, are further trained to follow prompts in a more helpful …


Interview Series - Working with an SRE »

Preamble In this insightful interview, Paul Bütow, a Principal Site Reliability Engineer at Mimecast, shares over a decade of experience in the field. Paul highlights the role of an Embedded SRE, emphasizing the importance of automation, observability, and effective incident …

No posts match your filters.