← ALL TAGS

Tag: diffusion

Engineering

Sounds and Videos as Prompts: A 107M Adapter That Lets EmbeddingGemma 2 Drive Qwen-Image and Iris, Retrained on Permissive Data

We replaced the 8B text encoder of Qwen-Image 2.1 with the 0.74B EmbeddingGemma 2 plus a small adapter, so a sound or a short video can be referenced in a prompt like an image. Then we threw away every non-commercial training item and retrained on CC0 / CC BY data only. The permissive adapter is better on text, the best we have on video, and the licensing surprise was not in the data.

October 21, 2026 11 min read
Read Story →
Engineering

Porting ERNIE-Image-Turbo to Zig and Metal: An 8B Diffusion Transformer From Scratch on Apple Silicon

I rewrote the hot path of Baidu's 8B-parameter ERNIE-Image-Turbo (DiT + scheduler) from scratch in Zig with hand-written Metal kernels. 13.06s/step at 1024×1024 on M2 Max. The bug archaeology behind getting 36 layers numerically correct, plus the honest accounting of what still has Python in it.

April 23, 2026 18 min read
Read Story →