Every game is being decompiled
Every math problem is being solved
Everything is happening all at once
Think about the progress in the past year
Now imagine another year
And another year
@pavelsimo Gotta cover Kernel, Performance, and Inference Engineering Concepts. Cuda is just a part of Kernel so theres alot more to go.
For now tryna pull through this gem: youtube.com/playlist?list=…
GPU version: no loop at all.
I launch ~39,000 blocks × 256 threads. Every thread handles exactly one element:
id = blockIdx.x * blockDim.x + threadIdx.x
Ive always wondered what does an LLM know? Like what's stored in it's weights.
Extending from this thought, what ELSE does an LLM know as a consequence of what it knows?
I watch everything at 2x.
Somewhere along the way, I forgot how to sit through a 20-minute explanation.
So my resolution from now on is simple: every new topic, every YouTube video, at 1x.
Slow is fast. Anyone else's attention span cooked?
851 Followers 582 FollowingBuilding in public ⚙️ | AI, open source & developer tools
Shipping things on GitHub. Sharing what works, what breaks, and what I learn along the way.
21K Followers 570 Followinge/local-llm 🚀
Working on scaling local inference
LLM fine tuning | Harness optimization | Evals and Memory systems for Agents
(opinions my own)
104K Followers 397 FollowingAsst Prof of CS & EE @Stanford
Co-founder of Physical Intelligence @physical_int
PhD from @Berkeley_EECS, EECS BS from @MIT
9K Followers 367 FollowingHead Wadhwani School of Data Science and AI (@WSAI_IITM), Center for Responsible AI (@cerai_iitm), and Professor at IIT Madras (@iitmadras)
851 Followers 582 FollowingBuilding in public ⚙️ | AI, open source & developer tools
Shipping things on GitHub. Sharing what works, what breaks, and what I learn along the way.
851K Followers 50 FollowingOfficial X of Theoretical Physicist, Futurist, Bestselling Author, On-Air Personality, Professor of Physics, and Public Speaker.
29K Followers 380 FollowingMaking the physical world accessible to AI by building the real world web for robots and intelligent machines.
Links: https://t.co/KadwD6ZKnT
14K Followers 347 FollowingNeural Breakdown on YT | Read research with AI: https://t.co/Ef6m4nUpcZ | maker of videos, writer of articles, learner of things
132K Followers 568 FollowingPrinceton CS prof and Director @PrincetonCITP.
Coauthor of "AI Snake Oil" and "AI as Normal Technology". https://t.co/ZwebetjZ4n
Views mine.
151K Followers 99 FollowingSane + 🌶️ takes in an insane AI world... AI capabilities researcher: co-created RLHF/ChatGPT @ @openai now trying to right the wrong 🤭 (ceo @typesafeai)
44K Followers 322 FollowingBlogger primarily on AI and AI x-risk but also other things at Don't Worry About the Vase (SS/WP/LW), founding Balsa Research to fix policy.