Chat: Hinton Lecun World Models (World Models)

**Chat log** from Bead: World Models · [canonical source](https://redfish.acequia.io/guerin/.agents/2aeb9f0b-77a8-4463-ab45-0f5d0096e304/2026-06-20/chats/2026-06-20-hinton-lecun-world-models.md) · session 2026-06-20 · discussion: Talk: World Models *Verbatim chat log: immutable provenance. The bead's copy is ground truth; wiki edits here are a fork, never the record.*

Bead `2aeb9f0b-77a8-4463-ab45-0f5d0096e304` (world-models). Verbatim user prompts; assistant turns summarized with pointers. CV body (Claude, shell+filesystem).

**User (verbatim, opening — this prompt opened the bead):** > start-bead world-models > find the most prescient papers/talks by geoff hinton on the importance of world models. and how llm and generative models won't get us to where we need to go **Context flagged:** IDE had an unrelated read-only file open (`\temp\readonly\command`); not relevant. Date 2026-06-20. **Assistant (summary):** 1. Read the bead protocol (`.ai/START-HERE.md`, `.ai/beads.md`, `prepare-new-bead` SKILL) to follow `start-bead` correctly. 2. Flagged a substantive issue with the premise before scaffolding: the "world models matter; generative/LLMs won't get us there" thesis is **Yann LeCun's** signature position, not Geoffrey Hinton's. Hinton leans the opposite way (LLMs genuinely understand) and his recent prominence is AI existential risk. Chose to verify rather than fabricate Hinton quotes. 3. Generated GUID `2aeb9f0b-77a8-4463-ab45-0f5d0096e304`. 4. Web research: `WebSearch` was **unavailable** (repeated "Web search error: unavailable"). `WebFetch` worked. Verified: - Hinton Wikipedia: GLOM (2021), Forward-Forward (NeurIPS 2022), mortal computation, capsules, AI-risk stance (Dec-2024 "10–20% extinction in 30 yrs"). No world-models-vs-LLM thesis present. - **LeCun, *A Path Towards Autonomous Machine Intelligence*, v0.9.2, 2022-06-27** — read pages 1–3 verbatim from the OpenReview PDF. Captured the world-model / JEPA-is-non-generative / common-sense quotes. - Meta **V-JEPA** blog (2024-02-15): predict in representation space, discard unpredictable info, 1.5–6× more sample-efficient than generative. 5. Scaffolded the bead: `about.md`, `notes/00-world-models-thesis-and-attribution.md` (frame + attribution correction + open question), `artifacts/annotated-bibliography.md` (lists A=LeCun thesis, B=Hinton's actual work, C=broader canon, each entry marked `[V]` verified or `[T]` from-training-confirm), `uploads/README.md`, this chat log. 6. Open question surfaced to Stephen: which reading list (A / B / C) to fully build out with citations once web search recovers. **Provenance note:** items marked `[T]` in the bibliography are from training knowledge and await confirmation when `WebSearch` is back; items marked `[V]` were fetched and verified this session. The attribution correction (LeCun, not Hinton) is the load-bearing finding.

**User (verbatim):** > ah you're right wrt lecun **Assistant (summary):** Confirmed the LeCun/Hinton split; re-surfaced the 1/2/3 choice of which reading list to build out.

**User (verbatim):** > 1 then tell me about ha/shmidhuber, deepmind RL and sutton **Assistant (summary):** - Built out **list A (LeCun)** in `artifacts/annotated-bibliography.md`: verified **I-JEPA** (arXiv:2301.08243), confirming items 1–3 as `[V]`; items 4–5 (V-JEPA 2, LeCun talks) remain `[T]` — WebSearch returned prose but **no links** this session. - Wrote `notes/01-broader-canon-ha-deepmind-sutton.md` and verified its sources via WebFetch: - **Ha & Schmidhuber, World Models** (arXiv:1803.10122, 2018) — VAE+MDN-RNN+controller; train-in-dream → transfer. Coined the term. - **MuZero** (arXiv:1911.08265, 2019) — plan via MCTS over a learned latent model, no rules given. - **DreamerV3** (arXiv:2301.04104, 2023) — imagine futures in latent model; 150+ tasks one config; Minecraft diamonds from scratch. - **Genie** (arXiv:2402.15391, 2024) — 11B foundation world model from internet video; learned latent action space. - **Sutton, "The Bitter Lesson"** (2019) — compute-scaling general methods beat human-knowledge methods (verified via Wikipedia; source page self-signed cert). - **Silver & Sutton, "Welcome to the Era of Experience"** (2025) — `[T]`, the arXiv ID guessed (2504.06738) was a different paper; venue/URL left to confirm, not fabricated. - Synthesis recorded: the name = Ha/Schmidhuber; the empirical proof = DeepMind MuZero→Dreamer→Genie; the principled why = Sutton; the architectural manifesto = LeCun's JEPA; Hinton is the dissenter.