Engineering
Sounds and Videos as Prompts: A 107M Adapter That Lets EmbeddingGemma 2 Drive Qwen-Image and Iris, Retrained on Permissive Data
We replaced the 8B text encoder of Qwen-Image 2.1 with the 0.74B EmbeddingGemma 2 plus a small adapter, so a sound or a short video can be referenced in a prompt like an image. Then we threw away every non-commercial training item and retrained on CC0 / CC BY data only. The permissive adapter is better on text, the best we have on video, and the licensing surprise was not in the data.
October 21, 2026
11 min read
Read Story →