Train 400x faster Static Embedding Models with Sentence Transformers
Hugging Face introduces a method to train static embedding models that run 100x–400x faster on CPU while retaining at least 85% of the quality of models like all‑mpnet‑base‑v2, releasing two models (static‑retrieval‑mrl‑en‑v1 and static‑similarity‑mrl‑multilingual‑v1) with training scripts and evaluation results.
Adebayo Ogunlesi Joins OpenAI Board of Directors
Adebayo Ogunlesi, CEO of Global Infrastructure Partners and Senior Managing Director at BlackRock, has joined OpenAI's Board of Directors to provide expertise in infrastructure investment and global market strategy.
Qwen2.5-Math-PRM and ProcessBench Release
Qwen has released Qwen2.5-Math-PRM-7B and 72B, state-of-the-art Process Reward Models designed to identify intermediate reasoning errors in mathematical problem solving, alongside ProcessBench, a new step-level evaluation benchmark.
Hugging Face AI Agents Ethics and Framework Analysis
Hugging Face provides a comprehensive framework for understanding AI agents, arguing that risks increase with autonomy and recommending against the development of fully autonomous agents.
Hugging Face releases vdr-2b-multi-v1 multilingual visual document retrieval model
Hugging Face has introduced vdr-2b-multi-v1, a multilingual embedding model for visual document retrieval that enables searching complex documents without OCR by encoding page screenshots into dense vectors.
Hugging Face Open LLM Leaderboard: CO₂ Emissions and Model Performance Analysis
Hugging Face reveals that community fine-tuned models often exhibit higher carbon efficiency than official releases due to increased conciseness and improved instruction following.
Hugging Face smolagents Release
Hugging Face has launched smolagents, a lightweight library that enables LLMs to perform complex tasks by writing actions as executable code rather than JSON, improving composability and generality.
OpenAI Corporate Structure Evolution
OpenAI is planning to transition its for-profit arm into a Delaware Public Benefit Corporation to better attract capital and sustain its non-profit mission of ensuring AGI benefits humanity.
QVQ-72B-Preview Release
Qwen has released QVQ-72B-Preview, an open-weight multimodal reasoning model based on Qwen2-VL-72B that achieves a score of 70.3 on the MMMU benchmark.
Visualize and understand GPU memory in PyTorch – Hugging Face Blog Summary
Hugging Face’s blog post explains how to visualize GPU memory usage in PyTorch using torch.cuda.memory tools, breaks down memory components during model training, and provides formulas to estimate total memory requirements.
NVIDIA LogitsProcessorZoo: Controlling Language Model Generation with Modular Logits Processors
NVIDIA's LogitsProcessorZoo provides modular logits processors for Hugging Face Transformers that let developers control generation length, enforce phrase inclusion, cite prompt content, and restrict outputs to multiple-choice choices.
Deliberative alignment: reasoning enables safer language models
OpenAI introduces deliberative alignment, a training paradigm that teaches o-series models to reason over explicit safety specifications, improving safety and reducing both under‑ and over‑refusals compared to prior models.
Big Bench Audio Release
Artificial Analysis has released Big Bench Audio, a dataset of 1,000 audio questions designed to evaluate the reasoning capabilities of audio language models, revealing a significant performance gap between text and speech reasoning.
ModernBERT Release Notes
Hugging Face, Answer.AI, and LightOn have released ModernBERT, a state-of-the-art encoder-only model family that improves upon BERT's speed, accuracy, and context length to 8,192 tokens.
Bamba-9B: Inference-Efficient Hybrid Mamba2 Model
Bamba-9B, a hybrid Mamba2 model from IBM, Princeton, CMU, and UIUC trained on 2.2T open tokens, achieves 2.5x throughput and 2x latency improvements over Llama 3.1 8B in vLLM and is immediately usable in transformers, vLLM, TRL, and llama.cpp.
Benchmarking Language Model Performance on 5th Gen Xeon at GCP
Hugging Face benchmarked text embedding and generation on Google Cloud's C4 (5th‑gen Xeon) and N2 (3rd‑gen Xeon) instances, finding C4 delivers 10‑24× higher embedding throughput and 2.3‑3.6× higher generation throughput, yielding 7‑19× and 1.7‑2.9× total‑cost‑of‑ownership advantages respectively.
Falcon 3 release notes / what's new
Technology Innovation Institute (TII) has released Falcon 3, a family of decoder-only large language models under 10 billion parameters designed for high efficiency and enhanced science, math, and coding capabilities.
OpenAI o1 and Developer Tooling Updates December 2024
OpenAI has released the production-ready o1 reasoning model in the API, introduced Preference Fine-Tuning via DPO, and updated the Realtime API with WebRTC support and significant price reductions.
Hugging Face Synthetic Data Generator
Hugging Face has introduced the Synthetic Data Generator, a no-code application that allows users to create custom text classification and chat datasets using natural language prompts.
OpenAI Timeline: Elon Musk's Proposed For-Profit Structure and Departure
OpenAI released a detailed timeline and internal communications revealing that Elon Musk actively sought to transition OpenAI into a for-profit entity under his own absolute control in 2017.
LeMaterial v1.0: LeMat-Bulk dataset release
LeMaterial v1.0 launches as an open-source initiative releasing the LeMat-Bulk dataset, which unifies 6.7M entries from Materials Project, Alexandria, and OQMD into a standardized format with seven properties to accelerate materials discovery.
Sora is here – OpenAI releases video generation model Sora Turbo with new interface and subscription access
OpenAI announced the release of Sora Turbo, a faster video generation model available as a standalone product for ChatGPT Plus and Pro users, featuring a new interface, up to 1080p resolution and 20‑second clips, and built‑in safety measures.
Hugging Face Open Preference Dataset for Text-to-Image Generation
The Data is Better Together community has released an Apache 2.0 licensed open preference dataset for text-to-image generation to address the lack of open-source preference data for model alignment.
Hugging Face Models in Amazon Bedrock Marketplace
Hugging Face has integrated 83 open models into the Amazon Bedrock Marketplace, allowing AWS customers to deploy open models on managed infrastructure while maintaining compatibility with Bedrock APIs.
OpenAI Sora: Creative Workflow Integration for Animator Lyndon Barrois
Animator Lyndon Barrois uses OpenAI Sora to bypass traditional studio production pipelines, enabling the direct translation of imagination into high-fidelity video content.
Vallée Duhamel and Sora
OpenAI highlights the artistic perspective of Vallée Duhamel on the Sora video generation model, though the product is noted as no longer available as of April 26, 2026.
OpenAI Sora System Card
OpenAI has released a system card for Sora, its video generation model capable of producing videos up to 20 seconds at 1080p resolution using a diffusion-transformer architecture.
Minne Atairu and Sora
Interdisciplinary artist Minne Atairu utilizes OpenAI's Sora to challenge patriarchal imagery and redefine cultural icons.
OpenAI Product Team AI Integration
OpenAI has released a webinar and guidance on integrating AI into product team workflows to enhance productivity and product development.
ChatGPT Pro Release
OpenAI has launched ChatGPT Pro, a $200 monthly subscription plan providing unlimited access to o1, o1-mini, GPT-4o, and a high-compute 'o1 pro mode' for complex problem solving.
OpenAI o1 System Card
OpenAI released the o1 system card detailing its chain-of-thought reasoning model, its safety evaluations, and its Preparedness Framework ratings of medium risk for persuasion and CBRN, low for cybersecurity and model autonomy.
PaliGemma 2 Release Notes
Google has released PaliGemma 2, a new family of vision language models that combine the SigLIP image encoder with the Gemma 2 text decoder across three parameter sizes and multiple input resolutions.
How good are LLMs at fixing their mistakes? A chatbot arena experiment with Keras and TPUs
Hugging Face tested several sub‑10B LLMs on a simple calendar‑API task and found that Gemma 2 9B consistently fixed mistakes with minimal prompting, while smaller and older models struggled or required many corrective turns.
OpenAI and Future Strategic Partnership for Specialist Content
OpenAI and Future have partnered to integrate content from Future's 200-plus specialist media brands into ChatGPT, providing users with reliable, expert information and expanding the publisher's distribution reach.
Morgan Stanley AI Integration and Evaluation Framework
Morgan Stanley collaborated with OpenAI to deploy GPT-4 and Whisper powered tools, achieving 98% advisor adoption through a rigorous evaluation framework focused on reliability and compliance.
AraGen Benchmark and Leaderboard: Introducing 3C3H Evaluation for Arabic LLMs
Hugging Face introduced AraGen, a dynamic benchmark and leaderboard for Arabic LLMs that uses the 3C3H measure to evaluate correctness, completeness, conciseness, helpfulness, honesty, and harmlessness.
Hugging Face CFM Case Study: Fine-tuning Small Models with LLM Insights
Capital Fund Management (CFM) improved financial Named Entity Recognition (NER) accuracy by up to 6.4% and reduced inference costs by up to 80x by using Llama 3.1 to assist in labeling data for fine-tuning compact models like GLiNER and SpanMarker.
Open Source Developers Guide to the EU AI Act
The Hugging Face guide explains how the EU AI Act applies to open source AI developers, outlining obligations for limited‑risk AI systems and non‑systemic‑risk general purpose AI models and pointing to tools for compliance.
QwQ-32B-Preview: Exploring Deep Reasoning Capabilities
Qwen has introduced QwQ-32B-Preview, a model designed for deep reasoning and complex problem-solving through an internal chain-of-thought process.
Hugging Face Hub Storage Rearchitecture
Hugging Face is redesigning its upload and download architecture by introducing a content-addressed store (CAS) to enable byte-level deduplication and improve global transfer speeds for massive AI models.
SmolVLM release notes / what's new
Hugging Face introduces SmolVLM, a 2B parameter Vision Language Model (VLM) that is fully open-source and optimized for low memory footprints and high throughput on edge devices.
You could have designed state of the art positional encoding
The Hugging Face blog post walks through an iterative design of positional encoding for transformers, showing how sinusoidal encoding leads to Rotary Positional Encoding (RoPE) and why it matters for modeling token relationships.
Advancing red teaming with people and AI – OpenAI's approach and application to the o1 family
OpenAI published a white paper detailing its external red teaming process for AI models and applied it to prepare the OpenAI o1 family for public release.
Grab GPT-4o Vision Fine-Tuning for GrabMaps
Grab has implemented GPT-4o vision fine-tuning to automate the localization of traffic signs and lane counting for GrabMaps, improving speed limit sign localization by 13% and lane count accuracy by 20%.
Hugging Face and LLM-jp Launch Open Japanese LLM Leaderboard
Hugging Face and LLM-jp have introduced the Open Japanese LLM Leaderboard, a transparent evaluation platform featuring over 20 datasets to benchmark the performance of Japanese large language models.
Hugging Face Introduces Content-Defined Chunking to Improve Storage Efficiency
Hugging Face announced a content-defined chunking storage approach via its Xet team that reduces storage and transfer costs for large model and dataset files by only uploading modified chunks.
Faster Text Generation with Self-Speculative Decoding
Hugging Face introduces self-speculative decoding via LayerSkip, a method that uses a single LLM's early layers for drafting and later layers for verification to increase generation speed and reduce memory overhead.
FlagEval Debate: A New Multilingual LLM Evaluation Framework
BAAI has launched FlagEval Debate, a dynamic evaluation platform where LLMs compete in multilingual debates to better assess reasoning, logic, and adversarial capabilities.
Rox Revenue Platform Integration with OpenAI
Rox has launched an AI-powered revenue management platform using OpenAI's API to automate data unification, sales workflows, and account monitoring through a system of AI agent swarms.
Hugging Face Judge Arena: Benchmarking LLMs as Evaluators
Hugging Face has launched Judge Arena, a crowdsourced platform that uses human voting to determine which LLMs are most effective as evaluators for grading other AI-generated responses.