VILA-Lab/Awesome-DLMs

The official GitHub repo for the survey paper "A Survey on Diffusion Language Models".

What it solves

This project addresses the need for a centralized, up-to-date repository of research and resources regarding Diffusion Language Models (DLMs). It helps researchers and developers navigate the rapidly evolving landscape of text generation models that use diffusion techniques, which differ from traditional autoregressive models.

How it works

It acts as a curated knowledge hub. It organizes academic papers, code implementations, and project demos into logical categories such as "Discrete DLMs," "Continuous DLMs," "Inference Optimization," and "Training Strategies." The repository tracks the evolution of the field through a timeline of milestones and provides direct links to arXiv papers, GitHub repositories, and interactive web demos.

Who it’s for

This collection is designed for AI researchers, machine learning engineers, and students who want to stay current with the latest advancements in diffusion-based text generation, ranging from foundational theory to state-of-the-art inference acceleration techniques.

Highlights

  • A comprehensive, frequently updated list of research papers and codebases.
  • Categorized sections covering foundations, training, inference, and multimodal applications.
  • A dedicated "Playground" section featuring live demos of various diffusion language models.
  • A visual timeline illustrating the shift from continuous to discrete diffusion models.
  • Inclusion of cutting-edge research like DARTree, which improves decoding speed and efficiency.

Related

  • Project
  • Project
  • Project
  • Project