Watch how to combine Gemini 3 and Shaders to create a interactive, playable sci-fi world.
What will you code with Gemini 3?
- Try the demo in Google AI Studio: https://aistudio.google.com/apps/bundled/shader_pilot - Find out more about Gemini 3: https://deepmind.google/models/gemini/ - For more about the prompt sequence, see the video here:
https://youtu.be/cpsY9WQxh5U
or
https://x.com/pitaru/status/1990929204930883869?t=4A2sllLUxokzg7QnJHA9XA&s=19
___
Sample prompts to start building apps like this:
Start by asking Gemini to render your shader (you may need to ask AI Studio to fix it over a few prompts if the shader is missing elements): “Create a player that renders this shader for me. You may need to add helper functions for it: [add shader code here or describe the shader you want]”
Prompts like this will help you start playing with the various shader parameters inside your app: “Can you give me some sliders to play with the shader parameters?”
Now you can ask Gemini to create UI that lets you move inside the 3d space of the shader (note: not all shaders will support this): “Can you add d-pads so I can pilot around it? Make it like typical 3D game controllers”
Now you can start building an in-app editor to further sculpt your project: “Add a settings window with tabs: one for the sliders, one that lets me inverse the d-pad controls and set their sensitivity and smoothing”
Finally you can start filling these tabs with various new capabilities and control their settings: “Allow me to now fully sculpt this environment, including the ability to create a spaceship out of a shader, a full set of analog-style synths, a sequencer, and a dynamic mapping system that allows me to map every facet of our visuals and interactions to dynamics of the soundtrack. The little things matter, you’re helping me sculpt this from a tech demo to the specific taste I have in mind both visually and sonically.”
___
Subscribe to our channel https://www.youtube.com/@googledeepmind Find us on X https://twitter.com/GoogleDeepMind Follow us on Instagram https://instagram.com/googledeepmind Add us on Linkedin https://www.linkedin.com/company/deepmind/
