Seeing a lot of cool applications of GPT 6 Astra so i gave it a go and it kinda blew my mind.
There has been a lot of amazing research recently for real2sim. Going from a single image/video to an interactive simulation environment unlocks evaluation and training capabilities easily (SimFoundry from NVIDIA is a great example, I was waiting for months for the code to be released lol).
I asked Astra to create an environment from a single image to see how good it would do 0 shot and i am 🤯. It even got the color of the liquid so close (although it couldn’t simulate the reaction).
There used to be whole research papers dedicated to getting remotely close to these abilities. Astra can do this 0 shot. Truly crazy times we live in.
Science
An interactive simulation environment built from one image, zero-shot
Parv Kapoor, a researcher at genrobotics_ai, asked GPT-6 Astra to turn a single image into an interactive simulation, a real2sim task that used to take whole research papers. It got the colour of the liquid nearly right, though it could not simulate the reaction.
297likes
38reposts
193saves
31Kviews
- Made with
- GPT-6 Astra
- Role
- Researcher at genrobotics_ai, formerly PhD at CMU
- Posted
