ai

Ilya's 30 Papers to Carmack: RNNs

Did you mean: recursion?

Jul 19 •

Tech Things: What on earth is going on with Grok?

Analyzing Grok's Latest Meltdown through xAI Public System Prompts

Jul 9 •

Tech Things: Meta spends $14b to hire a single guy

Sure, they kinda sorta acquired Scale AI too.

Jun 28 •

A Few Quick Thoughts on Apple's "Illusion of Thinking" LLM Paper

Illusions of illusions of thinking, or, "why Apple's "Illusions of Thinking" Paper Isn't Fair to LLMs"

Jun 9 •

Ilya's 30 Papers to Carmack: Deploying Big Models in 2015

This post is part of a series of paper reviews, covering the ~30 papers Ilya Sutskever sent to John Carmack to learn about AI.

Jun 2 •

Deep Learning is Applied Topology

Everything lives on a manifold

May 20 •

Tech Things: xAI screws up its system prompts, again

Once is coincidence, twice is enemy action. Also, you really should not be using LLMs as fact checkers.

May 17 •

Ilya's 30 Papers to Carmack: Neural Turing Machines

This post is part of a series of paper reviews, covering the ~30 papers Ilya Sutskever sent to John Carmack to learn about AI.

May 12 •

Ilya's 30 Papers to Carmack: Complextropy Redux

After reading this paper, I am beginning to see the sketches of an actual pseudo-quantifiable theory of model complexity.

Apr 26 •

Tech things: OpenAI buys Windsurf, Google retains its lead, and where the hell is Apple?

$3 billion seems high to me. Google is on a warpath. And Apple shoots itself in the foot, twice.

Apr 20 •

Tech Things: Gemini 2.5 and The Bull Case for Google

Google's ability to control its own destiny means it can pursue technical strategies that are simply out of scope for its competitors. This is…

Mar 29 •

Ilya's 30 Papers to Carmack: Relational Recurrent Neural Networks

This post is part of a series of paper reviews, covering the ~30 papers Ilya Sutskever sent to John Carmack to learn about AI.

Mar 13 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts