kandinskylab/kandinsky-5
Kandinsky 5.0: A family of diffusion models for Video & Image generation
What it solves
Kandinsky 5.0 提供一个高质量扩散模型家族，用于从文本提示或输入图像生成视频和图像。它特别针对高保真视觉生成的需求，并提供对英语和俄语两种语言及概念的强大支持。
How it works
该项目使用带有 Flow Matching 的潜在扩散管线。核心生成骨干是使用交叉注意力（cross‑attention）以 Qwen2.5‑VL 与 CLIP 提供的文本嵌入作为条件的 Diffusion Transformer（DiT）。在视频处理方面，采用 HunyuanVideo 3D VAE 将视频编码和解码到潜在空间。
Who it’s for
- Researchers and enthusiasts who can use the pretrain models for further fine-tuning.
- Content creators looking for high-definition video (up to 10 seconds) and image generation.
- Developers seeking lightweight, efficient models (like the 2B Video Lite version) for faster inference.
Highlights
- Diverse Model Family: Includes "Pro" (19B parameters) for maximum quality and "Lite" (2B for video, 6B for image) for efficiency.
- Multimodal Capabilities: Supports Text-to-Video (T2V), Image-to-Video (I2V), and Text-to-Image (T2I).
- Optimized Performance: Offers CFG-distilled and Diffusion-distilled variants for significantly lower latency (up to 6 faster).
- Language Support: Strong understanding of Russian concepts alongside English.
- Controllable Motion: Includes LoRAs for camera control in video generation.