Faster Text Generation with Self-Speculative Decoding
Hugging Face introduces self-speculative decoding via LayerSkip, a method that uses a single LLM's early layers for drafting and later layers for verification to increase generation speed and reduce memory overhead.
FlagEval Debate: A New Multilingual LLM Evaluation Framework
BAAI has launched FlagEval Debate, a dynamic evaluation platform where LLMs compete in multilingual debates to better assess reasoning, logic, and adversarial capabilities.
Hugging Face Judge Arena: Benchmarking LLMs as Evaluators
Hugging Face has launched Judge Arena, a crowdsourced platform that uses human voting to determine which LLMs are most effective as evaluators for grading other AI-generated responses.
Hugging Face Hub Dataset Sharing for Researchers
Hugging Face Hub provides a comprehensive platform for hosting and sharing large-scale ML datasets with integrated tools for exploration, security, and community engagement.
Hugging Face PyCharm Integration
Hugging Face has integrated its Hub directly into PyCharm Professional, allowing developers to discover, insert, and manage machine learning models without leaving their IDE.
Argilla 2.4 release notes / what's new
Argilla 2.4 introduces a no-code UI for importing Hugging Face Hub datasets to build fine-tuning and evaluation datasets through human feedback.
Universal Assisted Generation: Faster Decoding with Any Assistant Model
Hugging Face and Intel Labs introduced Universal Assisted Generation (UAG), a method that accelerates LLM inference by 1.5x-2.0x by allowing any small model to act as an assistant regardless of its tokenizer.
Digital Green Farmer.chat: Bolstering RAG with LLM-as-a-Judge
Digital Green implemented an LLM-as-a-judge evaluation framework for Farmer.chat, a RAG-based agricultural chatbot, to objectively measure RAG accuracy and optimize model selection across 340k queries.
Aya Expanse Release: Advancing Multilingual LLM Performance
Hugging Face and Cohere For AI have released Aya Expanse, a family of 8B and 32B open-weight models that set new state-of-the-art benchmarks for multilingual performance.
HUGS launch: zero‑configuration, hardware‑optimized inference for open LLMs
Hugging Face launched HUGS, a zero‑configuration, hardware‑optimized inference service for open‑source LLMs that runs on NVIDIA, AMD, and soon AWS Inferentia and Google TPUs, enabling enterprises to host models in‑house with an OpenAI‑compatible API.
CinePile 2.0 release: adversarial refinement boosts video QA dataset quality
CinePile 2.0 introduces an adversarial refinement pipeline that upgrades weak QA pairs into vision‑dependent questions, releasing both the improved dataset and the full code, and shows significant performance gains for commercial and open‑source video‑LLMs.
SynthID Text Integration in Transformers v4.46.0
Google DeepMind and Hugging Face have integrated SynthID Text into Transformers v4.46.0, providing a method to apply imperceptible watermarks to AI-generated text for detection via trained classifiers.
Deploying Speech-to-Speech on Hugging Face Inference Endpoints
Hugging Face provides a guide for deploying its Speech-to-Speech (S2S) pipeline using custom Docker images on Inference Endpoints to handle high computational demands and reduce latency.
Outlines-core 0.1.0 release notes / what's new
Hugging Face and dottxt have released outlines-core 0.1.0, a Rust port of the Outlines core algorithms for structured generation that improves index compilation speed and portability.
Stable Diffusion 3.5 Large Integration with Diffusers
Hugging Face has integrated Stable Diffusion 3.5 Large, an 8B parameter model available in standard and timestep-distilled versions, into the Diffusers library.
Hugging Face partners with Protect AI to add Guardian scanner for model security
Hugging Face partnered with Protect AI to embed the Guardian scanner into the Hub, automatically detecting dangerous model serialization exploits and improving security for the entire ML community.
Transformers.js v3 release adds WebGPU acceleration, expanded model support, and server‑side JavaScript compatibility
Transformers.js v3 adds WebGPU acceleration, new quantization formats, support for 120 model architectures, and Node.js/Deno/Bun compatibility, enabling fast, on‑device inference in browsers and JavaScript runtimes.
Llama 3.2 in Keras
Llama 3.2 is fully supported in Keras via keras-hub, allowing users to load Hugging Face checkpoints and run models across JAX, PyTorch, or TensorFlow backends.
Hugging Face Transformers Gradient Accumulation Fix
Hugging Face has updated the Transformers Trainer to ensure gradient accumulation is mathematically equivalent to full batch training by correcting how losses are averaged across batches.
Gradio 5 Security Review
Hugging Face conducted a comprehensive security audit of Gradio 5 with Trail of Bits, fixing all identified vulnerabilities to ensure machine learning applications are safe by default.
AMD EPYC Turin CPU delivers 2× LLM inference throughput over Genoa
AMD’s 5th‑gen EPYC Turin CPU delivers roughly double the LLM inference throughput of Genoa, enabling lower latency and higher throughput for Hugging Face workloads.
Scaling AI Data Processing with Hugging Face and Dask
Hugging Face and Dask enable the scaling of AI-based data processing from small local samples to hundreds of millions of rows using distributed computing and multi-GPU parallel inference.
Gradio 5 Release Notes
Hugging Face has released Gradio 5, a production-ready framework for building performant, scalable, and secure machine learning web applications using Python.
Hugging Face Transformers 4.45.0 Dynamic Speculative Decoding
Hugging Face and Intel Labs introduced dynamic speculative decoding in Transformers 4.45.0, accelerating text generation by up to 2.7x by dynamically adjusting the number of draft tokens based on model confidence.
Improving Parquet Deduplication on Hugging Face Hub
Hugging Face is optimizing its storage architecture to improve Parquet file deduplication, proposing content-defined row groups to reduce storage overhead during dataset updates.
Open FinLLM Leaderboard launch – comprehensive zero‑shot benchmark for financial language models
Hugging Face launched the Open FinLLM Leaderboard, a zero‑shot benchmark covering 40 finance‑specific tasks across seven categories to evaluate LLM readiness for real‑world financial applications.
Chinese AI Global Expansion Analysis
Chinese AI companies are accelerating international expansion due to domestic market saturation, intense price wars, and regulatory pressures, targeting Southeast Asia, the Middle East, and Western consumer markets.
BenCzechMark: A Comprehensive Evaluation Suite for Czech LLMs
Hugging Face and academic partners have released BenCzechMark, the first comprehensive evaluation suite for Czech language models, featuring 50 tasks across 9 categories and a novel duel-based scoring mechanism.
Converting Vertex-Colored Meshes to Textured Meshes
Hugging Face introduces a method and the InstantTexture library to convert vertex-colored 3D meshes into UV-mapped, textured meshes for better application compatibility.
Llama 3.2 Release Notes: Multimodal Vision and On-Device Small Language Models
Meta has released Llama 3.2, introducing multimodal vision capabilities in 11B and 90B sizes and lightweight 1B and 3B text-only models optimized for on-device deployment.
Hugging Face Daily Papers Features Guide
Hugging Face's Daily Papers page provides a community-curated hub for AI research, featuring tools for author claiming, paper submission, and direct interaction between researchers and developers.
FineVideo Dataset Release
Hugging Face has released FineVideo, a high-quality open video dataset containing 43k videos (3.4k hours) with rich, structured annotations for video understanding and generative AI training.
Optimizing and Deploying Hugging Face Models with Optimum-Intel and OpenVINO GenAI
Hugging Face and Intel provide a streamlined workflow using Optimum-Intel and OpenVINO GenAI to optimize and deploy Transformers models on Intel hardware, specifically targeting edge and client-side C++ and Python environments.
Fine-tuning LLMs to 1.58-bit: Extreme Quantization with BitNet
Hugging Face demonstrates that existing LLMs, such as Llama 3 8B, can be fine-tuned to 1.58-bit ternary precision using a dynamic warmup quantization strategy, significantly reducing memory and energy requirements while maintaining strong performance.
Hugging Face SQL Console for Datasets
Hugging Face has introduced a browser-based SQL Console powered by DuckDB WASM that allows users to query, filter, and transform datasets directly on the Hub without backend dependencies.
HuggingChat Community Tools Release
Hugging Face has introduced Community Tools on HuggingChat, allowing users to integrate any public Hugging Face Space as a tool for LLMs to use directly within the chat interface.
Accelerate 1.0.0 Release Candidate Announcement
Accelerate 1.0.0 release candidates add FP8, DeepSpeed multi‑model, torch.compile, and new data‑loader/pipeline features while stabilizing the API for large‑scale training and inference.
Hugging Face and TruffleHog Partnership for Secret Scanning
Hugging Face has partnered with Truffle Security to integrate TruffleHog's secret scanning capabilities into its automated pipeline and provide a native scanner for users to proactively scan their own account data.
LeRobotDataset video‑encoding format reduces robotics dataset size and speeds up training
Hugging Face released the LeRobotDataset video‑encoding format, shrinking robotics visual data to about 14 % of its original size while keeping loading speed and training performance intact.
Hugging Face blog post highlights five under‑rated Hub tools and a free semantic‑search use case
Hugging Face announced five under‑rated Hub tools—ZeroGPU, multi‑process Docker, Gradio API, webhooks, and Nomic Atlas—and showed how to combine them into a free, auto‑updating semantic‑search app for Reddit data.
Hugging Face Training Efficiency: Packing with Flash Attention 2
Hugging Face has introduced boundary-aware packing for instruction tuning examples, enabling up to 2x training throughput increase and 20% peak memory reduction when used with Flash Attention 2.
Deploying Meta Llama 3.1 405B on Google Cloud Vertex AI
Hugging Face provides a guide for programmatically deploying the FP8 quantized version of Meta Llama 3.1 405B on Google Cloud Vertex AI using Text Generation Inference (TGI) and A3 machine series.
Hugging Face Infini-Attention Reproduction Analysis
Hugging Face's attempt to reproduce Infini-Attention found that while gating convergence can be improved, the method's performance degrades with increased memory compression and remains less reliable than Ring Attention, YaRN, or RoPE scaling.
Introduction to ggml
ggml is a lightweight, C/C++ machine learning library optimized for Transformer inference and on-device LLM execution across diverse hardware backends.
Hugging Face Unified Tool Use API
Hugging Face has introduced a unified tool use API that allows developers to use the same code to implement tool calling across Mistral, Cohere, NousResearch, and Llama models.
Falcon Mamba 7B Release Notes
The Technology Innovation Institute (TII) has released Falcon Mamba 7B, the first large-scale pure State Space Language Model (SSLM) that matches the performance of state-of-the-art transformer models while eliminating attention-based memory scaling issues.
Hugging Face acquires XetHub to upgrade Hub storage and collaboration
Hugging Face acquired XetHub to replace Git LFS with a more efficient storage backend, enabling incremental updates, trillion‑parameter model support, and better collaboration on massive AI datasets.
Hugging Face TextImage Augmentation pipeline release
Hugging Face and Albumentations AI released a TextImage Augmentation pipeline that jointly modifies document images and their text, enabling realistic synthetic data generation and robust fine‑tuning of vision‑language models on limited document datasets.
Hugging Face 2024 Security Feature Highlights
Hugging Face has detailed its 2024 security landscape, introducing a suite of default protections for all users and advanced governance controls for Enterprise Hub users.
Google releases Gemma 2 2B, ShieldGemma, and Gemma Scope
Google released Gemma 2 2B, ShieldGemma safety classifiers, and Gemma Scope sparse autoencoders, expanding open‑source LLM capabilities, moderation tools, and interpretability resources.