Tag: multimodal

Sounds and Videos as Prompts: A 107M Adapter That Lets EmbeddingGemma 2 Drive Qwen-Image and Iris, Retrained on Permissive Data

We replaced the 8B text encoder of Qwen-Image 2.1 with the 0.74B EmbeddingGemma 2 plus a small adapter, so a sound or a short video can be referenced in a prompt like an image. Then we threw away every non-commercial training item and retrained on CC0 / CC BY data only. The permissive adapter is better on text, the best we have on video, and the licensing surprise was not in the data.