AI Fundamentals: Dense Models vs MoE
The previous article covered NLP and NLU, the conceptual field behind language models. This last one closes the series by going back to architecture: the difference between dense models and MoE, which parameters are actually activated for each token, and why that changes the math on cost and memory, a topic that had already come up in the article on quantization and local use.
AI Fundamentals: NLP and NLU: What They Are, Differences, Uses and Practical Examples
In the previous articles the focus was on LLMs, prompts, agents and tools, that is, generative AI as it appears today. This article takes a step back to the broader field that underpins all of it: natural language processing. The idea is to tell NLP and NLU apart (plus PLN, the acronym you will see in Portuguese-language material), see where each one comes into play in practice, and understand why these concepts still hold even after LLMs.
AI Fundamentals: Prompts, Hallucination and Agents
So far we have seen what an LLM is, what it is made of and how it is trained and run. This article covers what happens at use time: how the prompt influences the answer, why the model hallucinates, and how agents and tools solve part of that problem, going beyond just generating text. At the end there is a mind map that recaps the terms from the first three articles.
AI Fundamentals: Training, Inference and Quantization
In the previous article, the idea was to understand what an LLM is, how it breaks text into tokens and what parameters and the context window mean. Here the focus shifts from “what the model is” to “how it runs”: the two main phases, training and inference, and quantization, which is what makes it feasible to fit larger models on limited hardware.
AI Fundamentals: AI, LLMs, Tokens and Parameters
Today, the most visible part of AI for developers is generative AI, especially LLMs, which process text as tokens, use a large number of parameters tuned during training, and generate outputs by predicting the most likely next unit of text given a context.





