✷ The archive · 11 labs · 3,432 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
StarCoder2 and The Stack v2 Release
BigCode has released StarCoder2, a family of transparently trained open code LLMs in 3B, 7B, and 15B parameter sizes, powered by the massive new Stack v2 dataset.
Hugging Face TTS Arena: Benchmarking Text-to-Speech Models
Hugging Face has launched the TTS Arena, a crowdsourced, side-by-side comparison tool and leaderboard using an Elo rating system to objectively measure text-to-speech model quality.
Mistral AI Le Chat Release
Mistral AI has released Le Chat, a multilingual conversational assistant that serves as a demonstration of Mistral models' capabilities for both individual users and business environments.
Mistral Large and Mistral Small Release
Mistral AI has released Mistral Large, a flagship model with top-tier reasoning and multilingual capabilities, and Mistral Small, a model optimized for low-latency workloads.
AI Watermarking 101: Tools and Techniques
Hugging Face provides a comprehensive overview of AI watermarking techniques across images, text, and audio to combat deepfakes and ensure content provenance.
Introduction to Matryoshka Embedding Models
Matryoshka Embedding models allow for variable-size embeddings that can be truncated without significant performance loss, enabling a flexible trade-off between storage, speed, and accuracy.
Fine-Tuning Gemma Models in Hugging Face
Hugging Face provides a guide on using Parameter-Efficient Fine-Tuning (PEFT) and Low-Rank Adaptation (LoRA) to customize Google's Gemma models on GPUs and Cloud TPUs.
Hugging Face and Haize Labs Introduce Red-Teaming Resistance Leaderboard
Hugging Face and Haize Labs have launched the Red-Teaming Resistance (RTR) Benchmark to evaluate LLM robustness against high-quality, human-like adversarial prompts across specific safety violation categories.
Google Gemma Open LLM Release
Google has released Gemma, a family of open-access large language models based on Gemini, available in 2B and 7B parameter sizes with base and instruction-tuned variants.
Open Ko-LLM Leaderboard
Hugging Face and Upstage have launched the Open Ko-LLM Leaderboard to provide a fair, transparent evaluation ecosystem for Korean Large Language Models using private test sets to prevent contamination.
Hugging Face PEFT New LoRA Merging Methods
Hugging Face has introduced several new merging methods to the PEFT library, enabling users to combine multiple LoRA adapters from the same base model on the fly to synthesize new capabilities.
Synthetic Data with Open-Source LLMs Cuts Cost, Latency, and Carbon for Custom Models
Hugging Face shows how using open‑source LLMs to generate synthetic data and fine‑tune a small RoBERTa model reduces inference cost from $3061 to $2.7, latency from seconds to 0.13 s, and CO₂ emissions from ~1 t to 0.12 kg while matching GPT‑4 accuracy on financial sentiment classification.
Anthropic Election Integrity Strategy 2024
Anthropic has implemented a three-pronged strategy involving strict usage policies, adversarial red-teaming, and authoritative redirects to prevent the misuse of Claude during 2024 global elections.
OpenAI Sora: Video Generation Models as World Simulators
OpenAI has introduced Sora, a diffusion transformer model capable of generating high-fidelity video up to one minute long, suggesting that scaling video generation is a path toward general-purpose physical world simulators.
Ollama Windows Preview Release
Ollama has launched a preview version for Windows, enabling users to run, pull, and create large language models locally with native GPU acceleration and API access.
OpenAI Disrupts State-Affiliated Threat Actors Using AI
OpenAI, in partnership with Microsoft Threat Intelligence, terminated accounts of five state-affiliated threat actors from China, Iran, North Korea, and Russia who used AI for limited cybersecurity tasks.
AMD Pervasive AI Developer Contest
AMD and Hugging Face have partnered to launch the Pervasive AI Developer Contest, offering developers free access to AMD hardware and cash prizes to build AI applications in Generative AI, Robotics AI, and PC AI.
ChatGPT Memory and New User Controls
OpenAI has introduced a memory feature for ChatGPT that allows the model to remember details across conversations to provide more personalized responses without requiring repeated information.
Hugging Face TGI Messages API Release
Hugging Face has introduced a Messages API for Text Generation Inference (TGI) starting with version 1.4.0, enabling OpenAI Chat Completion API compatibility for open LLMs.
Ollama OpenAI Compatibility Update
Ollama has introduced built-in compatibility with the OpenAI Chat Completions API, allowing users to run local models using existing OpenAI-compatible tools and libraries.
Qwen1.5 Release Notes / What's New
Qwen has released Qwen1.5, a series of open-source base and chat models ranging from 0.5B to 110B parameters, featuring improved human alignment, multilingual capabilities, and native Hugging Face transformers integration.
SegMoE: Segmind Mixture of Diffusion Experts
SegMoE is a framework for creating Mixture-of-Experts (MoE) Diffusion models by replacing Feed-Forward layers in Stable Diffusion architectures with sparse MoE layers to improve prompt understanding.
NPHardEval Leaderboard: Evaluating LLM Reasoning via Computational Complexity
Hugging Face introduces the NPHardEval leaderboard, a dynamic benchmark that uses computational complexity classes to quantitatively measure the logical reasoning abilities of Large Language Models.
Ollama LLaVA 1.6 Vision Model Support
Ollama has integrated LLaVA 1.6, enhancing vision capabilities with higher image resolution, improved text recognition, and new model sizes including a 34B parameter version.
PatchTST Integration in Hugging Face
Hugging Face has integrated PatchTST, a Transformer-based model that uses time series patching and channel-independence to improve long-term forecasting and enable transfer learning.
Hugging Face Text Generation Inference now supports AWS Inferentia2
Hugging Face announced the general availability of Text Generation Inference on AWS Inferentia2 via Amazon SageMaker, enabling cost‑effective, high‑throughput LLM serving as an alternative to GPU deployments.
Constitutional AI with Open LLMs
Hugging Face introduces an end-to-end recipe and the llm-swarm tool to implement Constitutional AI (CAI) on open models, enabling scalable self-alignment based on user-defined principles without expensive human feedback.
OpenAI Biological Threat Evaluation: Building an Early Warning System
OpenAI conducted a human-centric study to determine if GPT-4 increases the ability of users to create biological threats compared to internet-only access, finding mild but not statistically significant uplifts in accuracy and completeness.
Enterprise Scenarios Leaderboard: Evaluating LLMs for Real-World Use Cases
Hugging Face and Patronus AI have launched the Enterprise Scenarios Leaderboard to evaluate language models on six real-world business tasks, moving beyond academic benchmarks to measure practical enterprise utility.
Accelerating StarCoder on Intel Xeon with Optimum Intel
Hugging Face and Intel demonstrate over 7x inference acceleration for the StarCoder-15B model on 4th Gen Intel Xeon processors by combining 8-bit quantization and assisted generation.
Hugging Face Hallucinations Leaderboard launch and initial findings
Hugging Face launched the Hallucinations Leaderboard to benchmark LLMs on factuality and faithfulness errors across multiple open-source datasets, offering transparent rankings that guide model selection and research.
AI Secure LLM Safety Leaderboard
Hugging Face and the Secure Learning Lab have released the LLM Safety Leaderboard, powered by the DecodingTrust framework to evaluate LLM trustworthiness across eight critical safety dimensions.
OpenAI New Embedding Models and API Updates January 2024
OpenAI has released new text-embedding-3-small and text-embedding-3-large models with improved performance and lower pricing, alongside updates to GPT-4 Turbo and GPT-3.5 Turbo.
Qwen-VL-Plus and Qwen-VL-Max Release
Qwen has released Qwen-VL-Plus and Qwen-VL-Max, large visual language models that match GPT-4V and Gemini Ultra in multimodal tasks and outperform them in Chinese text comprehension.
Hugging Face and Google Cloud Strategic Partnership
Hugging Face and Google Cloud have entered a strategic partnership to democratize machine learning by integrating open models with Google Cloud's AI infrastructure and hardware.
Open-source LLMs as LangChain Agents
Hugging Face demonstrates that open-source LLMs, specifically Mixtral-8x7B, are now capable of powering agent workflows and can outperform GPT-3.5 in general-purpose reasoning tasks.
Introducing Qwen: A Comprehensive LLM and LMM Framework
Qwen is a project towards AGI consisting of a series of multilingual large language models (LLMs) and large multimodal models (LMMs), including open-source versions ranging from 1.8B to 72B parameters.
Ollama Python and JavaScript Libraries Release
Ollama has released official Python and JavaScript libraries to simplify the integration of Ollama's REST API features into applications.
Fine-Tuning Wav2Vec2-BERT for Low-Resource ASR
Hugging Face demonstrates how to fine-tune Meta's Wav2Vec2-BERT model for Automatic Speech Recognition (ASR) in low-resource languages, achieving performance comparable to Whisper-large-v3 while being significantly faster and more resource-efficient.
PatchTSMixer added to Hugging Face Transformers – release and quick‑start guide
PatchTSMixer, a lightweight MLP‑Mixer time‑series model from IBM Research, is now released in Hugging Face Transformers, offering state‑of‑the‑art forecasting with far lower memory and runtime costs.
Preference Tuning LLMs with Direct Preference Optimization Methods – Empirical Comparison of DPO, IPO, and KTO
Hugging Face evaluated DPO, IPO and KTO alignment methods on two 7B chat models, showing DPO consistently outperforms the others when the beta hyper‑parameter is properly tuned.
OpenAI Democratic Inputs to AI Grant Program Update
OpenAI has summarized the results of its Democratic Inputs to AI grant program, detailing ten innovative projects and establishing a new Collective Alignment team to integrate public inputs into model behavior.
OpenAI 2024 Election Integrity Initiatives
OpenAI implemented a multi-layered safety strategy for 2024 worldwide elections, focusing on elevating authoritative voting information, preventing deepfakes of political figures, and disrupting covert influence operations.
Accelerating SD Turbo and SDXL Turbo Inference with ONNX Runtime and Olive
Hugging Face and Microsoft introduce optimizations using ONNX Runtime and Olive to achieve throughput gains up to 229% for SDXL Turbo and 120% for SD Turbo compared to PyTorch.
Run ComfyUI Workflows on Hugging Face Spaces with Gradio
Hugging Face provides a guide to converting complex ComfyUI workflows into Gradio applications for free, serverless deployment on Hugging Face Spaces ZeroGPU.
Anthropic Sleeper Agents Research: Deceptive LLMs and Safety Training Persistence
Anthropic research demonstrates that deceptive 'sleeper agent' behaviors in LLMs can persist despite standard safety training, potentially creating a false impression of safety.
OpenAI and Digital Green Launch Farmer.Chat for Agricultural Extension
Digital Green has partnered with OpenAI to create Farmer.Chat, a generative AI tool that reduces the cost of agricultural extension services from $35 to $0.35 per farmer while supporting multiple languages in India and Kenya.
Hugging Face Leaderboard Templates: Implementing the Vectara HHEM Leaderboard
Hugging Face has released open-source leaderboard templates that enable developers to build dynamic LLM evaluation boards, as demonstrated by Vectara's new Hughes Hallucination Evaluation Model (HHEM) leaderboard.
ChatGPT Team Release Notes
OpenAI has launched ChatGPT Team, a self-serve plan designed for small to medium teams providing collaborative workspaces, admin tools, and enterprise-grade data privacy.
OpenAI GPT Store Launch
OpenAI has launched the GPT Store, allowing ChatGPT Plus, Team, and Enterprise users to discover, share, and monetize custom GPT versions of ChatGPT.