LBH-123-AI/Comfyui_Minimax_h3_latent_Upscaler

Neural latent upscaler for Minimax H3 (24ch). Bypasses costly 5B-param VAE decode/encode. Upscale low-res latents directly, then refine. Accelerates high-res video gen, outperforms naive interp.

What it solves

This project provides a way to upscale video latents for the Minimax H3 model without the slow and computationally expensive process of decoding latents to pixels, upscaling them, and then re-encoding them back into latents. By performing the upscale directly in the latent space, it significantly accelerates high-resolution video generation and avoids common artifacts like ghosting or double-images caused by basic interpolation.

How it works

It introduces custom ComfyUI nodes that use trained neural networks to upscale 24-channel Minimax H3 VAE latents. It offers two primary neural upscaler variants:

  • 2D Upscaler: A lightweight ResBlock backbone with temporal 3D-Conv layers for spatial upscaling while maintaining temporal consistency.
  • 3D Upscaler: A fully 3D-convolution backbone that processes the spatiotemporal volume jointly for stronger coherence, supporting scaling by multiplier, target dimensions, or total megapixels.

Additionally, it includes the MMH3 Split Upscale combo, which is a tiled, "hires-fix" style re-sampling upscaler. Instead of a pre-trained network, it splits the AV latent into temporal chunks and spatial tiles, re-runs the diffusion sampler on each piece at a higher resolution, and stitches them back together using seam-denoise, two-level color matching, and temporal anchors to prevent flickering and seams.

Who it’s for

Users of ComfyUI and the Minimax H3 video generation model who want to generate high-resolution videos faster and with better visual quality and temporal stability.

Highlights

  • Neural Latent Upscaling: Uses trained networks instead of naive interpolation for sharper results.
  • Two Backbone Options: Choice between a fast 2D variant and a more coherent 3D variant.
  • Tiled Re-sampling: A decomposed and optimized tiling system (MMH3 Split Upscale) to handle high-res videos within VRAM limits.
  • Advanced Stitching: Features like seam-denoise, color matching, and triple temporal anchors to eliminate ghosting and inter-tile flicker.
  • Flexible Sizing: Supports scaling by multiplier, specific target dimensions, or megapixels with automatic pixel-grid alignment.

Related

  • Project
  • Dispatch
  • Project
  • Project
  • Project