Before you write a single line of code, every machine learning problem starts with one question: what kind of information do you actually have, and what are you trying to do with it? The answer sorts your problem into one of a small number of categories, and that category determines which entire family of techniques applies. Get this categorization wrong, and you'll waste time forcing the wrong tool at a problem — this is one of the most common mistakes beginners make.
You have labeled examples — inputs paired with known correct answers — and you want the model to learn the relationship well enough to predict answers for new, unseen inputs.
Two flavors of supervised learning, depending on what kind of answer you're predicting:
You have data but no labeled answers — nobody has told the model what the "correct" output should be. Instead, the model finds structure or patterns hidden in the data on its own.
An agent takes actions in an environment and learns from rewards or penalties over time — closer to how a dog learns tricks through treats than to the example-based learning above. This is the framework behind game-playing AI (like AlphaGo) and is also the technique behind how modern chatbots get fine-tuned to be more helpful (RLHF — reinforcement learning from human feedback, which you'll meet again in Tier 4).
RL is covered in depth in Tier 3, Module 10 — it's a smaller part of this track than supervised learning, but it underlies some of the most impressive AI demonstrations you've likely seen (game-playing agents, robotics).
This is the newest category to become mainstream, and it's the one that quietly powers the entire LLM revolution. The idea: take unlabeled data (like all the text on the internet) and automatically generate the "labels" from the data itself — for example, hide a word in a sentence and train the model to predict it. No human ever had to label anything.
| Type | Has Labels? | Goal | Where in This Track |
|---|---|---|---|
| Supervised | Yes | Predict an answer for new inputs | Tier 1-2 (most of the course) |
| Unsupervised | No | Find hidden structure/patterns | Tier 2, Modules 4-5 |
| Reinforcement | Rewards instead | Learn good actions through trial and feedback | Tier 3, Module 10 |
| Self-Supervised | Auto-generated | Learn from unlabeled data at massive scale | Tier 4, Module 2 |