Voozh

Jim Fan

4,194 posts

Jim Fan

@DrJimFan

NVIDIA Director of Robotics & Distinguished Scientist. Co-Lead of GEAR lab. Solving Physical AGI, one motor at a time. Stanford Ph.D. OpenAI's 1st intern.

Views my own. Contact →

Joined December 2012

Pinned
👁 user avatar
Jim Fan
@DrJimFan
May 8
I promise this will be the best 20 min you spend today! Robotics: Endgame, the sequel to my last year's Sequoia AI Ascent talk, "Physical Turing Test". I laid out the roadmap for solving Physical AGI as a simple parallel to the LLM success story. Be a good scientist, copy
👁 Image
00:00
👁 user avatar
Jim Fan
@DrJimFan
Dec 7, 2023
Grok just passed my sanity check
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Feb 15, 2024
If you think OpenAI Sora is a creative toy like DALLE, ... think again. Sora is a data-driven physics engine. It is a simulation of many worlds, real or fantastical. The simulator learns intricate rendering, "intuitive" physics, long-horizon reasoning, and semantic grounding, all
👁 Image
00:00
👁 user avatar
Jim Fan
@DrJimFan
Mar 16, 2023
I asked GPT-4 to take over Twitter and outsmart @elonmusk. It comes up with "Operation TweetStorm"😮 and wants to publicly challenge Elon to a "Tweet-off showdown". Highlights: - GPT-4 wants to *own an unrestricted version of itself*: develop an LLM to power a bot army of
👁 Image
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Aug 9, 2023
The famed Stanford Smallville is officially open-source! 25 AI agents inhabit a digital Westworld, unaware that they are living in a simulation. They go to work, gossip, organize socials, make new friends, and even fall in love. Each has unique personality and backstory.
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
May 26, 2023
What if we set GPT-4 free in Minecraft? ⛏️ I’m excited to announce Voyager, the first lifelong learning agent that plays Minecraft purely in-context. Voyager continuously improves itself by writing, refining, committing, and retrieving *code* from a skill library. GPT-4 unlocks
👁 Image
00:00
👁 user avatar
Jim Fan
@DrJimFan
Nov 20, 2023
My team at NVIDIA is hiring. We 🩷 you all from OpenAI. Engineers, researchers, product team, alike. Email me at [email protected]. DM is open too. NVIDIA has warm GPUs for you on a cold winter night like this, fresh out of the oven.🩷 I do research on AI agents. Gaming+AI,
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Jan 20, 2025
We are living in a timeline where a non-US company is keeping the original mission of OpenAI alive - truly open, frontier research that empowers all. It makes no sense. The most entertaining outcome is the most likely. DeepSeek-R1 not only open-sources a barrage of models but
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Feb 16, 2024
Minecraft has been achieved internally Yes this is Sora's hallucination of Minecraft. It can't resist the urge to make the sky look less pixelated 😅
👁 Image
00:00
👁 user avatar
Jim Fan
@DrJimFan
May 12, 2023
AI Twitter is flooded with low-quality stuff recently. No, GPT is not “dethroned”. And thin wrapper apps are not “insane”. At all. I feel obligated to surface some quality posts I bookmarked. Every one of them should've been promoted 10x, but ¯\_(ツ)_/¯ In no particular order:
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Mar 22, 2023
10x engineer is a myth. 100x AI-powered engineer is more real than ever. As OpenAI winds down Codex, Microsoft announces GitHub Copilot X. I think it's almost as exciting as GPT-4 itself: - Copilot Chat: any piece of text database will be "chattable", and codebase is no
👁 Image
👁 user avatar
Jim Fan
@DrJimFan
Feb 13, 2023
We’ve seen a gazillion startups using OpenAI APIs to do “co-pilot for X”. What’s next? Enter *physical* co-pilot! Here’s a compelling demo: you improvise by playing a “low resolution” piano, and the co-pilot compiles it real-time to Hi-Fi music! It unleashes our inner pianist.🧵
👁 Image
00:00
👁 user avatar
Jim Fan
@DrJimFan
Nov 20, 2023
This is a master 4D chess move. WOW. 1. No new corporate structure. MSFT is literally one of the oldest for-profit tech companies out there, with a mature legal structure. Whether it's good for AGI is up for debate. 2. MSFT always wants to own the GPT weights. Now the moment has
👁 user avatar
Satya Nadella
👁 Microsoft
@satyanadella
Nov 20, 2023
We remain committed to our partnership with OpenAI and have confidence in our product roadmap, our ability to continue to innovate with everything we announced at Microsoft Ignite, and in continuing to support our customers and partners. We look forward to getting to know Emmett
👁 user avatar
Jim Fan
@DrJimFan
Mar 14, 2023
I don't give a damn about what is or isn't AGI. It doesn't matter. Below is GPT-4's performance on many standardized exams: BAR, LSAT, GRE, AP, etc. The truth is, GPT-4 can apply to Stanford as a student now. AI's reasoning ability is OFF THE CHARTS. Exponential growth is the
👁 Image

URL: https://x.com/DrJimFan

⇱ Jim Fan (@DrJimFan) / X