401

Quanto quantization cuts memory for Transformer diffusion pipelines

Hugging Face quantization (Quanto) reduces GPU memory for Transformer diffusion models from ~12 GB to ~5 GB with minimal latency and quality impact.

402

Hugging Face NVIDIA NIM API (serverless) launch and deprecation

Hugging Face launched the NVIDIA NIM API (serverless) for Enterprise Hub users, enabling pay‑as‑you‑go, serverless inference of open‑source LLMs on NVIDIA DGX Cloud H100 GPUs via an OpenAI‑compatible API.

403

LAVE: Zero-shot VQA Evaluation on Docmatix with LLMs

Hugging Face introduces LAVE (LLM-Assisted VQA Evaluation) to address the rigidity of traditional VQA metrics, demonstrating a 50% accuracy gain in evaluating zero-shot performance on the Docmatix dataset.

404

Llama 3.1 Release Notes: Multilinguality, Long Context, and 405B Model

Meta has released Llama 3.1, featuring models in 8B, 70B, and 405B sizes with 128K context length, multilingual support for 8 languages, and a permissive license allowing synthetic data generation.

405

Running Mistral 7B with Core ML

Hugging Face demonstrates how to run Mistral 7B on Mac using new Core ML features from WWDC 24, achieving a model size reduction to under 4GB using 4-bit block-wise quantization.

406

Docmatix Dataset Release

Hugging Face has released Docmatix, a Document Visual Question Answering (DocVQA) dataset featuring 2.4 million images and 9.5 million Q/A pairs, providing a 240x increase in scale over previous datasets.

407

TGI Multi-LoRA: Deploy Once, Serve 30 Models

Hugging Face introduces Multi-LoRA serving in Text Generation Inference (TGI), allowing organizations to deploy a single base model and dynamically serve dozens of specialized fine-tuned adapters to reduce cost and operational complexity.

408

Argilla SDK Chatbot with distilabel – End‑to‑End Tutorial

Hugging Face released a tutorial showing how to build an Argilla 2.0 chatbot using distilabel‑generated synthetic data, fine‑tuned embeddings, lancedb vector storage, and a Gradio app deployed on Spaces.

409

SmolLM Release: High-Performance Small Language Models

Hugging Face introduces SmolLM, a family of state-of-the-art small language models (135M, 360M, and 1.7B parameters) trained on a meticulously curated high-quality dataset.

410

NuminaMath 7B TIR wins AIMO Progress Prize – technical recap

NuminaMath 7B TIR won the first AIMO Progress Prize by solving 29 of 50 hidden math problems, showcasing the power of a two-stage fine‑tuning recipe, large high‑quality math data, and a self‑consistency with tool‑integrated reasoning inference strategy.

411

Hugging Face PII Detection Experiment with Presidio

Hugging Face is experimenting with integrating Microsoft Presidio into the Dataset Hub to provide automatic PII detection reports, helping practitioners identify and mitigate privacy risks in ML datasets.

412

TRL adds Direct Preference Optimization support for Vision‑Language Models

Hugging Face added Direct Preference Optimization (DPO) support for Vision‑Language Models in the TRL library, enabling fine‑tuning of models like Idefics‑2 with preference data using bfloat16 quantization and LoRA to fit on a single GPU.

413

Hugging Face and KerasHub Integration

Hugging Face and KerasHub now share a model save format, allowing KerasHub users to directly load over 300,000 Transformers library models from the Hugging Face Hub.

414

Google Cloud TPUs on Hugging Face Inference Endpoints and Spaces

Hugging Face has integrated Google Cloud TPU v5e support into Inference Endpoints and Spaces, enabling users to deploy and scale AI models with cost-effective, high-performance hardware.

415

Banque des Territoires, Polyconseil, and Hugging Face Deploy Sovereign RAG Solution for EduRénov Program

Hugging Face, Polyconseil, and Banque des Territoires launched a sovereign, open‑source RAG system to automate email support for France's EduRénov school‑renovation program, ensuring data residency while scaling generative AI for public policy.

416

Hugging Face Dataset Hub Search Features Update

Hugging Face has introduced four new search filters—modality, size, format, and library compatibility—to improve the discoverability of over 180,000 public datasets on the Dataset Hub.

417

Accelerating Protein Language Model ProtST on Intel Gaudi 2

Intel and MILA have optimized the ProtST multi-modal protein language model for Intel Gaudi 2 accelerators, achieving up to 2.92x faster fine-tuning compared to NVIDIA A100 GPUs.

418

Hugging Face Transformers Code Agent GAIA Benchmark Results

Hugging Face achieved a top ranking on the GAIA benchmark using a Code Agent built with the transformers.agents library, demonstrating that code-based actions are more efficient and effective than JSON-based tool calling.

419

Google Gemma 2 Release Notes

Google has released Gemma 2, a family of open-weight LLMs available in 9B and 27B parameter sizes, featuring technical advances in distillation and attention mechanisms to improve performance.

420

XLSCOUT ParaEmbed 2.0 Release

XLSCOUT has released ParaEmbed 2.0, a proprietary embedding model fine-tuned on expert-curated patent data that achieves a 23% increase in accuracy over ParaEmbed 1.0.

421

Hugging Face Ethics and Society Newsletter #6: The Importance of Data Quality

Hugging Face outlines a holistic, responsible approach to data quality, emphasizing that high-quality data must be fit for its intended purpose to ensure AI model performance, fairness, and scientific reproducibility.

422

Fine-tuning Microsoft Florence-2 for DocVQA

Hugging Face demonstrates how to fine-tune Microsoft's Florence-2 vision-language model on the DocVQA dataset, improving validation similarity from 0 to 57.0 after seven epochs.

423

Hugging Face Data Is Better Together Initiative

Hugging Face and Argilla launched the Data Is Better Together (DIBT) initiative to empower the open-source community to collectively create high-quality, diverse, and inclusive datasets for machine learning.

424

Prezi Case Study: Accelerating ML Roadmap with Hugging Face Expert Support

Prezi is leveraging the Hugging Face Expert Support Program and Inference Endpoints to integrate efficient open-source multimodal models into its Prezi AI presentation generation tool.

425

BigCodeBench: A New Benchmark for Complex Python Code Generation

Hugging Face has released BigCodeBench, a benchmark of 1,140 function-level tasks designed to evaluate LLMs on practical programming and diverse library usage, addressing the simplicity and contamination issues of HumanEval.

426

Hugging Face Accelerate: Harmonizing DeepSpeed and FSDP Precision

Hugging Face Accelerate 0.30.0 introduces automatic upcasting for PyTorch FSDP to align its precision handling with DeepSpeed, enabling seamless switching between the two backends without loss of convergence.

427

Stable Diffusion 3 Medium Integration with Diffusers

Hugging Face has integrated Stable Diffusion 3 Medium (2B parameters) into the Diffusers library, introducing a Multimodal Diffusion Transformer (MMDiT) and rectified flow-matching for improved text-to-image synthesis.

428

Hugging Face TRL RLOO Trainer Release

Hugging Face has introduced the RLOO (REINFORCE Leave One-Out) Trainer in TRL, an online RLHF algorithm that uses 50-70% less vRAM and converges up to 3x faster than PPO while remaining competitive in performance.

429

Hugging Face Embedding Container for Amazon SageMaker Release

Hugging Face has released a general availability (GA) Embedding Container for Amazon SageMaker, powered by Text Embedding Inference (TEI) for high-performance deployment of open embedding models.

430

Hugging Face Transformers Documentation Redesign

Hugging Face is redesigning the Transformers documentation to move from a rigid, incremental structure to a code-first, integrated experience tailored for product developers.

431

Artificial Analysis Text to Image Leaderboard and Arena Launch

Hugging Face has launched the Artificial Analysis Text to Image Leaderboard and Arena, using human preference data from over 45,000 votes to rank open-source and proprietary image generation models.

432

Hugging Face NPC-Playground: Integrating LLM-Powered NPCs in 3D Environments

Hugging Face introduces NPC-Playground, a 3D demo utilizing Cubzh and Gigax to enable realistic, LLM-driven NPC interactions through function calling and Lua scripting.

433

Intel Gaudi Assisted Generation Support

Hugging Face has integrated assisted generation (speculative sampling) into Optimum Habana, enabling up to 2x speedups for large transformer-based models on Intel Gaudi processors.

434

Hugging Face Spaces Secrets Security Update

Hugging Face disclosed a security incident involving unauthorized access to a subset of Spaces secrets, leading to the revocation of affected tokens and a transition to fine-grained access tokens.

435

Benchmarking Text Generation Inference

Hugging Face introduces a benchmarking tool for Text Generation Inference (TGI) to help developers profile throughput and latency trade-offs to optimize LLM deployment costs and performance.

436

Training and Finetuning Embedding Models with Sentence Transformers

Hugging Face provides a comprehensive guide on using the Sentence Transformers library to train and finetune embedding models for tasks like semantic search and RAG, introducing the new SentenceTransformerTrainer.

437

Falcon 2 11B Release Notes

TII has released Falcon 2 11B, a series of smaller, high-performance models including a pretrained LLM and a Vision-Language Model (VLM) trained on over 5,000 billion tokens.

438

CyberSecEval 2: Evaluating Cybersecurity Risks in Large Language Models

Hugging Face and Meta have introduced CyberSecEval 2, a comprehensive framework to evaluate LLM susceptibility to code interpreter abuse, offensive cybersecurity capabilities, and prompt injection attacks.

439

Hugging Face AWS Inferentia2 Integration

Hugging Face has expanded support for AWS Inferentia2, enabling the deployment of over 100,000 models via Amazon SageMaker and introducing new Inf2 instance options for Hugging Face Inference Endpoints.

440

Hugging Face and Microsoft Strategic Collaboration Update May 2024

Hugging Face and Microsoft have expanded their strategic partnership to integrate popular open models into the Azure Model Catalog, enable AMD MI300X GPU support on Azure, and introduce a VS Code integration for Hugging Face Spaces.

441

Hugging Face Integration for AMD Instinct MI300 GPU

Hugging Face has enabled first-class integration for the AMD Instinct MI300 GPU, delivering up to 3x faster inference and 2x faster fine-tuning for Llama 3 70B compared to the MI250.

442

Dell Enterprise Hub: On-Premise AI Deployment and Training

Hugging Face and Dell have launched the Dell Enterprise Hub, a platform that simplifies the on-premise training and deployment of open-source large language models on Dell hardware.

443

Hugging Face Spaces Dev Mode Release

Hugging Face has introduced Spaces Dev Mode, allowing PRO subscribers to connect via VS Code or SSH for real-time code editing without requiring git pushes for every change.

444

Hugging Face KV Cache Quantization

Hugging Face has introduced KV Cache Quantization in the Transformers library to reduce memory usage for long-context text generation with minimal impact on model quality.

445

Introducing the Open Arabic LLM Leaderboard

Hugging Face and the Technology Innovation Institute have launched the Open Arabic LLM Leaderboard (OALL) to provide a specialized, open evaluation platform for Arabic Large Language Models.

446

PaliGemma Vision Language Model Release

Google has released PaliGemma, a family of open vision-language models combining SigLIP-So400m and Gemma-2B to enable tasks like image captioning, visual question answering, and object detection.

447

Hugging Face and LangChain Launch langchain_huggingface Partner Package

Hugging Face and LangChain have released langchain_huggingface, a jointly maintained partner package to streamline the integration of Hugging Face models into the LangChain ecosystem.

448

Transformers Agents 2.0 release notes / what's new

Hugging Face introduces Transformers Agents 2.0, a modular agent framework featuring iterative problem-solving agents and high performance on the GAIA benchmark using Llama-3-70B-Instruct.

449

Building Cost-Efficient Enterprise RAG Applications with Intel Gaudi 2 and Intel Xeon

Hugging Face demonstrates how combining Intel Gaudi 2 accelerators and Intel Xeon CPUs via the OPEA framework allows enterprises to build RAG applications with superior performance-per-dollar compared to H100-based systems.

450

Hugging Face Enterprise Hub now available on AWS Marketplace

Hugging Face has integrated Enterprise Hub with the AWS Marketplace, allowing organizations to upgrade their accounts and manage billing directly through their AWS accounts.