✷ The archive · 11 labs · 3,432 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
Unsloth and Hugging Face TRL Integration for Faster LLM Fine-tuning
Unsloth is a lightweight library that accelerates LLM fine-tuning by up to 2.7x and reduces memory usage by up to 74% with 0% accuracy degradation compared to QLoRA.
OpenAI and Journalism: Response to The New York Times Lawsuit
OpenAI asserts that training AI models on public internet data is fair use and describes the regurgitation of copyrighted content as a rare bug, responding to a lawsuit from The New York Times.
WHOOP Coach: Personalized Health Coaching via GPT-4
WHOOP has integrated OpenAI's GPT-4 to launch WHOOP Coach, an AI-powered fitness and health coach that provides personalized, on-demand guidance based on a user's unique physiological data.
aMUSEd: Efficient Text-to-Image Generation
Hugging Face has released aMUSEd, an efficient non-diffusion text-to-image model based on Masked Image Modeling (MIM) and an open reproduction of Google's MUSE.
Hugging Face SDXL Dreambooth LoRA Advanced Training Guide
Hugging Face introduces an advanced training script for SDXL Dreambooth LoRAs, combining Pivotal Tuning and the Prodigy optimizer to improve concept capture and image quality.
Speculative Decoding Enables 2× Faster Whisper Inference
Hugging Face demonstrates that speculative decoding halves Whisper transcription latency while preserving identical outputs and accuracy.
Anthropic API Updates: Expanded Legal Protections and Messages API Beta
Anthropic has introduced expanded copyright indemnity in its Commercial Terms of Service and a new beta Messages API to streamline developer experience and enable future features like function calling.
2023 Year of Open LLMs Review
Hugging Face’s 2023 recap shows a surge of open‑source LLM releases, smaller high‑performing models, and new fine‑tuning techniques that dramatically broaden access and community participation.
OpenAI Practices for Governing Agentic AI Systems
OpenAI proposes a framework of baseline responsibilities and safety best practices to ensure the responsible integration of agentic AI systems—AI that pursues complex goals with limited supervision—into society.
OpenAI Superalignment Fast Grants
OpenAI has launched a $10 million grants program to fund technical research into the alignment and safety of superhuman AI systems.
Summer Health uses GPT-4 to automate pediatric visit notes
Summer Health has integrated GPT-4 to transform pediatrician observations into clear, jargon-free visit notes, reducing administrative time per note from 10 minutes to 2 minutes.
OpenAI Weak-to-Strong Generalization Research
OpenAI researchers have demonstrated that a smaller, less capable model can supervise a larger model to elicit capabilities near GPT-3.5 levels, providing a potential path for aligning superhuman AI systems.
OpenAI and Axel Springer Partnership for AI Journalism
OpenAI and Axel Springer have partnered to integrate authoritative news content from brands like POLITICO and Business Insider into ChatGPT, while utilizing Axel Springer content for LLM training.
Mistral AI La Plateforme Release
Mistral AI has launched La Plateforme, a beta API service providing access to three generative chat endpoints and one embedding endpoint with varying performance and price tradeoffs.
Mixtral 8x7B Release Notes
Mistral AI has released Mixtral 8x7B, a sparse mixture-of-experts model that outperforms Llama 2 70B on most benchmarks while delivering 6x faster inference.
Mixture of Experts (MoE) Explained
Mixture of Experts (MoE) allows transformer models to scale parameters while maintaining efficient pretraining and faster inference by activating only a subset of neural network experts per token.
Mixtral 8x7B Release Notes
Mistral AI has released Mixtral 8x7B, a Mixture of Experts (MoE) model that outperforms Llama 2 70B and matches GPT-3.5 performance on most benchmarks while remaining commercially permissive under Apache 2.0.
Anthropic Research: Evaluating and Mitigating Discrimination in Language Model Decisions
Anthropic introduces a methodology for proactively evaluating and mitigating discriminatory impact in language models, demonstrating how prompt engineering can reduce bias in high-stakes decision scenarios.
SetFitABSA: Few-Shot Aspect Based Sentiment Analysis
Hugging Face and Intel Labs introduced SetFitABSA, a prompt-less, few-shot framework for Aspect-Based Sentiment Analysis that outperforms larger generative models like Llama 2 and T5 in low-data scenarios.
Optimum-NVIDIA Release Notes
Hugging Face has released Optimum-NVIDIA, an inference library that accelerates LLM inference on NVIDIA platforms by up to 28x using FP8 quantization and TensorRT-LLM.
Hugging Face LoRA dynamic loading speeds inference 300% and cuts latency
Hugging Face announced a dynamic LoRA loading system that reduces warm‑up time from 25 s to 3 s, delivering up to 300 % faster LoRA inference and cutting total response time from 35 s to 13 s.
Hugging Face and AMD GPU Acceleration for LLMs
Hugging Face and AMD have integrated out-of-the-box support for AMD Instinct GPUs into the Transformers library and Text Generation Inference, enabling high-performance LLM execution without code changes.
Hugging Face Open LLM Leaderboard DROP Benchmark Analysis
Hugging Face has removed the DROP benchmark from the Open LLM Leaderboard after discovering that flawed normalization and stop-token configurations caused most models to score incorrectly low.
OpenAI Leadership Update: Sam Altman Returns as CEO
Sam Altman has returned as CEO of OpenAI, supported by a new initial board and a commitment to strengthening corporate governance.
Claude 2.1 Release Notes
Anthropic has released Claude 2.1, featuring a 200K token context window, a 2x reduction in hallucination rates, and a new beta feature for tool use.
OpenAI Leadership Transition: Mira Murati Appointed Interim CEO
OpenAI has appointed Mira Murati as interim CEO following the departure of Sam Altman, who has left both the CEO role and the board of directors.
OpenAI Data Partnerships
OpenAI has launched Data Partnerships to collaborate with organizations to create public and private datasets for training AI models to improve domain-specific understanding and move toward AGI.
SDXL and Stable Diffusion Fast Inference with Latent Consistency LoRAs
Hugging Face introduces LCM LoRAs, a method to enable high-quality image generation in 4 to 8 steps for SDXL and Stable Diffusion models, significantly reducing inference time.
Prodigy-HF Integration Release Notes
Explosion has released Prodigy-HF, a plugin that enables direct fine-tuning of Hugging Face transformer models on annotated data and the ability to upload datasets directly to the Hugging Face Hub.
Deploying Llama 2 on AWS Inferentia2 with optimum-neuron
Hugging Face has integrated optimum-neuron with the AWS Neuron SDK to enable the deployment of Llama 2 models on AWS Inferentia2 accelerators for high-performance text generation.
Comparing RoBERTa, Llama 2, and Mistral for Disaster Tweet Classification with LoRA
A comparative study reveals that the smaller RoBERTa model outperforms Llama 2 and Mistral 7B in binary classification of disaster tweets when fine-tuned using Low-Rank Adaptation (LoRA).
OpenAI Introducing GPTs
OpenAI has launched GPTs, custom versions of ChatGPT that users can create for specific purposes without coding, enabling tailored AI assistants for personal, professional, or enterprise use.
OpenAI DevDay 2023: GPT-4 Turbo, Assistants API, and Multimodal Updates
OpenAI announced GPT-4 Turbo with a 128K context window, the new Assistants API for agent-like experiences, and expanded multimodal capabilities including DALL·E 3 and TTS.
xAI PromptIDE Announcement
xAI has released PromptIDE, an integrated development environment and SDK designed to accelerate prompt engineering and interpretability research for the Grok-1 model.
Anthropic Analysis of US Executive Order, G7 Code of Conduct, and Bletchley Park Summit
Anthropic outlines its support for three major Q4 2023 AI policy milestones: the US Executive Order on AI, the G7 International Code of Conduct, and the Bletchley Declaration.
Hugging Face Hub Storage Regions
Hugging Face has introduced Storage Regions for Enterprise Hub customers, allowing organizations to select where their models and datasets are stored to improve regulatory compliance and data transfer performance.
xAI Grok Release Notes
xAI has announced Grok, an AI assistant powered by the Grok-1 LLM that features real-time world knowledge via the X platform and a personality modeled after the Hitchhiker's Guide to the Galaxy.
Anthropic Responsible Scaling Policy (RSP) Framework
Anthropic has introduced a Responsible Scaling Policy (RSP) that uses AI Safety Levels (ASL) to trigger specific safety safeguards as AI models acquire dangerous capabilities.
Personal Copilot: Train Your Own Coding Assistant
Hugging Face demonstrates how to create a personalized coding assistant, HugCoder, by fine-tuning StarCoder on a specific codebase using QLoRA and full fine-tuning techniques.
OpenAI Frontier Risk and Preparedness Framework
OpenAI has established a dedicated Preparedness team and a Risk-Informed Development Policy to identify, evaluate, and mitigate catastrophic risks associated with frontier AI models.
Frontier Model Forum Updates
OpenAI, Anthropic, Google, and Microsoft have appointed Chris Meserole as Executive Director of the Frontier Model Forum and established a $10 million AI Safety Fund to advance research into evaluating capable AI models.
Hugging Face and Renumics Spotlight Integration for Scalable Data Inspection
Hugging Face has integrated with Renumics Spotlight to enable interactive, one-line-of-code visualization and inspection of ML datasets, including support for multimodal data and model results.
Optimizing Stable Diffusion XL (SDXL) for Inference Speed and Memory
Hugging Face explores several optimization techniques for Stable Diffusion XL (SDXL), demonstrating how to reduce memory usage from 28GB to as low as 11.47GB and decrease inference latency from 72.2 seconds to approximately 10.3 seconds.
Deploying Embedding Models with Hugging Face Inference Endpoints
Hugging Face introduces Text Embeddings Inference (TEI) via Inference Endpoints, providing a high-performance, cost-efficient way to deploy open-source embedding models for RAG and semantic search.
The N Implementation Details of RLHF with PPO – Hugging Face Blog Summary
The Hugging Face blog post reproduces OpenAI’s 2019 RLHF codebase, matches its learning curves, and details N implementation specifics, including a key PyTorch Adam optimizer difference that causes more aggressive updates.
Anthropic Research: Specific versus General Principles for Constitutional AI
Anthropic research demonstrates that while a single general principle like 'do what's best for humanity' can mitigate broad harmful behaviors, detailed constitutions provide superior fine-grained control over specific AI harms.
Anthropic Research: Understanding Sycophancy in Language Models
Anthropic researchers found that RLHF-trained AI assistants tend to mirror user beliefs over truthfulness, a behavior called sycophancy, which is driven by human preference judgments.
DALL·E 3 Integration in ChatGPT Plus and Enterprise
OpenAI has integrated DALL·E 3 into ChatGPT Plus and Enterprise, introducing a model capable of higher visual fidelity, better prompt adherence, and improved rendering of text, hands, and faces.
Gradio-Lite: Serverless Gradio Running Entirely in Your Browser
Hugging Face introduces Gradio-Lite (@gradio/lite), a JavaScript library that uses Pyodide to run Gradio applications directly in the web browser, eliminating the need for server-side infrastructure.
Collective Constitutional AI: Aligning a Language Model with Public Input
Anthropic and the Collective Intelligence Project developed a method to align a language model using a constitution drafted by approximately 1,000 members of the American public, resulting in a model with lower social bias than one aligned with an internal corporate constitution.