✷ The archive · 11 labs · 3,432 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
Hugging Face AutoGPTQ and Transformers Integration
Hugging Face has integrated the AutoGPTQ library into Transformers, enabling the quantization of LLMs to 8, 4, 3, or 2-bit precision to reduce memory requirements with negligible accuracy loss at 4-bit.
GPT-3.5 Turbo Fine-Tuning and API Updates
OpenAI has released fine-tuning capabilities for GPT-3.5 Turbo, allowing developers to customize model performance, improve output reliability, and reduce prompt costs.
IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model
Hugging Face has released IDEFICS, an open-access visual language model based on the Flamingo architecture that supports interleaved image and text inputs in 9B and 80B parameter sizes.
Hugging Face SafeCoder Announcement
Hugging Face has introduced SafeCoder, a self-hosted, enterprise-grade code assistant solution that allows companies to build and deploy proprietary Code LLMs within their own secure infrastructure.
OpenAI acquires Global Illumination
OpenAI has acquired Global Illumination, a creative tools and infrastructure company, to integrate its team into the development of core products including ChatGPT.
Using GPT-4 for Content Moderation
OpenAI is utilizing GPT-4 to accelerate content moderation by automating policy application and refinement, reducing the time to develop custom policies from months to hours.
Anthropic and SK Telecom Partnership Announcement
Anthropic and SK Telecom (SKT) have entered a commercial partnership and strategic investment to develop a customized LLM for the telecommunications industry.
Hugging Face Hub on AWS Marketplace
Hugging Face has integrated its Hub with the AWS Marketplace, allowing organizations to pay for managed services like Inference Endpoints and AutoTrain directly through their AWS accounts.
Deploying DeepFloyd IF with BentoML
Hugging Face demonstrates how to use BentoML to deploy the DeepFloyd IF text-to-image model, enabling independent scaling of its multi-stage pixel diffusion architecture across multiple GPUs.
Optimizing Bark using 🤗 Transformers
Hugging Face demonstrates how to reduce the memory footprint and improve inference speed of the Bark text-to-speech model using Better Transformer, half-precision (fp16), and CPU offload.
Claude Instant 1.2 Release Notes
Anthropic has released Claude Instant 1.2, a faster and lower-priced model that improves upon version 1.1 in math, coding, reasoning, and safety.
Swift Transformers Release: Run On-Device LLMs on Apple Devices
Hugging Face released the alpha swift-transformers Swift package, swift-chat demo app, updated exporters and transformers-to-coreml tools, and Core ML versions of Llama 2 7B and Falcon 7B, enabling developers to run LLMs on-device in Apple apps.
Fine-tuning Llama 2 with Direct Preference Optimization (DPO) via TRL
Hugging Face has integrated Direct Preference Optimization (DPO) into the TRL library, enabling the alignment of Llama 2 and other LLMs using a simplified binary cross-entropy loss instead of complex RLHF pipelines.
Studying Large Language Model Generalization with Influence Functions
Anthropic researchers use the EK-FAC approximation to scale influence functions to LLMs with up to 52 billion parameters, enabling the identification of specific training examples that drive model behavior.
Anthropic Research: Tracing Model Outputs to Training Data using Influence Functions
Anthropic researchers scaled influence functions to LLMs up to 52 billion parameters, discovering that model generalization becomes more abstract and conceptually driven as model scale increases.
Deploying MusicGen via Hugging Face Inference Endpoints
Hugging Face demonstrates how to deploy MusicGen, a text-to-music generation model, as an API using Inference Endpoints and custom handlers for models not supported by standard pipelines.
Towards Encrypted Large Language Models with FHE
Hugging Face and Zama demonstrate how Fully Homomorphic Encryption (FHE) can enable Large Language Models to process encrypted user data while protecting the model owner's intellectual property.
Huggy Lingo: Improving Hugging Face Hub Language Metadata with ML
Hugging Face is using the fastText language identification model and Librarian-Bots to automatically detect and suggest language metadata for datasets that currently lack it.
Confidence-Building Measures for Artificial Intelligence
OpenAI and the Berkeley Risk and Security Lab propose six confidence-building measures (CBMs) to mitigate international security risks introduced by foundation models.
Practical 3D Asset Generation Guide
Hugging Face provides a step-by-step workflow for creating low-fidelity, PS1-style 3D assets by combining OpenAI's Shap-E model with Blender and Dream Textures.
Segmind SD-Small and SD-Tiny Knowledge Distillation Release
Segmind open-sourced the code and pretrained weights for SD‑Small and SD‑Tiny, two diffusion models that are 35% and 55% smaller than Stable Diffusion while delivering up to 2× faster inference.
Running Uncensored Llama 2 Models Locally with Ollama
Ollama enables users to run uncensored versions of Llama 2 and other models locally, removing the alignment constraints that often lead to overly cautious or refusals in standard models.
Stable Diffusion XL on Mac with Advanced Core ML Quantization
Hugging Face and Apple have ported Stable Diffusion XL to Core ML, introducing mixed-bit palettization to reduce the UNet size by 71% while maintaining image quality on Apple Silicon Macs.
Frontier Model Forum Announcement
OpenAI, Google, Microsoft, and Anthropic have launched the Frontier Model Forum to coordinate safety standards, research, and information sharing for the development of frontier AI models.
Anthropic Frontier Threats Red Teaming for AI Safety
Anthropic has established a frontier threats red teaming framework to identify and mitigate national security risks, specifically finding that unmitigated LLMs could accelerate biological weaponization efforts within the next two to three years.
Anthropic Frontier Model Security Framework
Anthropic proposes a security framework for frontier AI models based on multi-party authorization and secure software development standards to prevent theft and misuse.
Agents.js Release: Give Tools to LLMs using JavaScript
Hugging Face has released Agents.js, a JavaScript library that enables LLMs to access and execute tools in the browser or on a server.
Hugging Face and Partners Outline Open ML Considerations for the EU AI Act
Hugging Face, in coalition with Creative Commons, Eleuther AI, GitHub, LAION, and Open Future, has proposed five key recommendations to ensure the EU AI Act supports open-source machine learning development.
OpenAI AI Governance Commitments
OpenAI has committed to a framework of internal and external red-teaming, information sharing, AI-generated content identification, and transparent reporting on model capabilities and societal risks.
Hugging Face Open Source AI Game Jam Results
Hugging Face hosted its first Open Source AI Game Jam, resulting in 88 game submissions that integrated open-source AI tools for assets, coding, and gameplay mechanics.
ChatGPT Custom Instructions Release
OpenAI has introduced custom instructions for ChatGPT, allowing users to set persistent preferences and requirements that the model considers across all future conversations.
Hugging Face Diffusers First Anniversary Overview
Hugging Face celebrates the first anniversary of the Diffusers library, highlighting its evolution into a modular toolbox for text-to-image, video, 3D, and audio generation.
OpenAI and American Journalism Project Partnership for Local News
OpenAI has partnered with the American Journalism Project (AJP) through a $10 million commitment in funding and API credits to explore how AI can enhance local journalism and counter misinformation.
Llama 2 Release and Hugging Face Integration
Meta has released Llama 2, a family of open-access large language models available for commercial use, with full integration into the Hugging Face ecosystem.
Anthropic Shows Question Decomposition Boosts Faithfulness of Model-Generated Reasoning
Anthropic announced that decomposing questions into subquestions markedly improves the faithfulness of large language model reasoning compared to standard chain‑of‑thought prompting.
Anthropic Study on Faithfulness of Chain-of-Thought Reasoning
Anthropic found that larger language models often generate unfaithful chain-of-thought explanations, with faithfulness varying widely across tasks and model sizes.
Hugging Face AI WebTV: Building an Automated Video and Music Synthesis Stream
Hugging Face developed AI WebTV, an experimental demo that uses Zeroscope and MusicGen to automatically synthesize video and music streams from LLM-generated prompts.
Open-Source Text Generation & LLM Ecosystem at Hugging Face
Hugging Face’s 2023 blog post surveys the open‑source text generation and LLM ecosystem, covering model backgrounds, licensing, serving tools, and parameter‑efficient fine‑tuning.
Fine-tuning Stable Diffusion on Intel Sapphire Rapids CPUs using Hugging Face Diffusers
Hugging Face shows how to fine-tune a Stable Diffusion model on Intel Sapphire Rapids CPUs using textual inversion with just five example images, demonstrating CPU‑based fine‑tuning via Intel Extension for PyTorch and oneCCL.
Claude 2 Release Notes
Anthropic has released Claude 2, featuring a 100K token context window, improved performance in coding and reasoning, and enhanced safety compared to Claude 1.3.
Analyzing Large Scale Qualitative Data with Viable and GPT-4
Viable leverages fine-tuned GPT-4 models to move beyond simple summarization to provide accurate, large-scale qualitative data analysis for business insights.
OpenAI Frontier AI Regulation Proposal
OpenAI and a multidisciplinary group of researchers propose a regulatory framework for frontier AI models to manage public safety risks through standard-setting, registration, and compliance mechanisms.
Making ML-powered web games with Transformers.js
Hugging Face demonstrates how to create Doodle Dash, a real-time sketch detection game that runs entirely in the browser using Transformers.js and a finetuned MobileViT model.
Deploying LLMs with Hugging Face Inference Endpoints
Hugging Face Inference Endpoints is a managed SaaS solution that allows developers to deploy open-source LLMs as production-ready APIs with features like autoscaling, scale-to-zero, and enterprise-grade security.
Hugging Face: Making a Web App Generator with Open ML Models
Hugging Face demonstrates how to build a text-to-webapp generator using NodeJS, the WizardCoder-15B model, and the Hugging Face Inference Endpoints API.
Leveraging Hugging Face for Complex Generative AI Use Cases: Writer Case Study
Hugging Face highlights its partnership with Writer, demonstrating how the company evolved from a user to a customer and open-source contributor while utilizing the Hugging Face Expert Acceleration Program for scalable LLM production.
OpenAI Global Conversations: Insights and Strategic Focus Areas
OpenAI conducted a global listening tour across 25 cities and 6 continents to gather feedback from users, developers, and policymakers to refine its AI development and deployment strategies.
Accelerating Vision-Language Models: BridgeTower on Habana Gaudi2
Hugging Face demonstrates that fine‑tuning the BridgeTower vision‑language model on Habana Gaudi2 with Optimum Habana yields up to 2.5× speed‑over Nvidia A100 and 1.4× over H100 by using more dataloader workers and hardware‑accelerated image decoding.
Anthropic Introduces GlobalOpinionQA Framework to Measure Subjective Global Opinion Representation in LLMs
Anthropic released GlobalOpinionQA, a dataset and quantitative framework that reveals large language models often mirror US and certain European opinions, and shows how prompting or translation can shift but not fully correct these biases.
OpenAI London Office Opening
OpenAI has opened its first international office in London to expand its research and development footprint and attract global talent for the development of safe AGI.