Artificial Intelligence
AI Fundamentals: Dense Models vs MoE - Linky Systems

AI Fundamentals: Dense Models vs MoE - Linky Systems

AI Fundamentals: Dense Models vs MoE

The previous article covered NLP and NLU, the conceptual field behind language models. This last one closes the series by going back to architecture: the difference between dense models and MoE, which parameters are actually activated for each token, and why that changes the math on cost and memory, a topic that had already come up in the article on quantization and local use.

Artificial Intelligence
AI Fundamentals: NLP and NLU: What They Are, Differences, Uses and Practical Examples - Linky Systems

AI Fundamentals: NLP and NLU: What They Are, Differences, Uses and Practical Examples - Linky Systems

AI Fundamentals: NLP and NLU: What They Are, Differences, Uses and Practical Examples

In the previous articles the focus was on LLMs, prompts, agents and tools, that is, generative AI as it appears today. This article takes a step back to the broader field that underpins all of it: natural language processing. The idea is to tell NLP and NLU apart (plus PLN, the acronym you will see in Portuguese-language material), see where each one comes into play in practice, and understand why these concepts still hold even after LLMs.

Artificial Intelligence
AI Fundamentals: Prompts, Hallucination and Agents - Linky Systems

AI Fundamentals: Prompts, Hallucination and Agents - Linky Systems

AI Fundamentals: Prompts, Hallucination and Agents

So far we have seen what an LLM is, what it is made of and how it is trained and run. This article covers what happens at use time: how the prompt influences the answer, why the model hallucinates, and how agents and tools solve part of that problem, going beyond just generating text. At the end there is a mind map that recaps the terms from the first three articles.

Artificial Intelligence
AI Fundamentals: Training, Inference and Quantization - Linky Systems

AI Fundamentals: Training, Inference and Quantization - Linky Systems

AI Fundamentals: Training, Inference and Quantization

In the previous article, the idea was to understand what an LLM is, how it breaks text into tokens and what parameters and the context window mean. Here the focus shifts from “what the model is” to “how it runs”: the two main phases, training and inference, and quantization, which is what makes it feasible to fit larger models on limited hardware.