Machine Learning
Transformer
A neural network design that weighs which parts of the input matter most — the architecture behind most modern LLMs.
In real life
Transformers help chatbots figure out which earlier words matter. In "The dog chased the ball until it was tired," what is "it"?
Try it (2 minutes)
Read a sentence and underline the words that matter most for its meaning. That's what attention does.
Talk about it
Why might "paying attention" to the right words matter for a good answer?
In the game
Attention: Whenever this System Runs a Task, look at the top 2 cards of your deck; put one into your hand. It costs 4 Data to play, and it can't go in your Training Set. It has Capability 4 (how hard it hits) and Trust 2 (how many Flags it can take), and scores 3 Tokens each time it Runs a Task. How to play