✷ The archive · 11 labs · 3,062 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
ChatGPT Plugins Release
OpenAI has introduced plugins for ChatGPT, allowing the model to access real-time information, perform computations, and integrate with third-party services to expand its utility and reduce hallucinations.
Hugging Face Hub Improved Jupyter Notebook Support
Hugging Face has introduced human-readable rendering for Jupyter notebooks hosted on the Hub, improving reproducibility and accessibility for machine learning practitioners.
GPTs are GPTs: Labor Market Impact of Large Language Models
OpenAI research indicates that approximately 80% of the U.S. workforce could have at least 10% of their work tasks affected by Large Language Models, positioning them as general-purpose technologies.
Anthropic Reveals Privileged Bases in Transformer Residual Streams
Anthropic discovered that transformer residual stream dimensions are not arbitrary but align with privileged bases, likely due to Adam's per-dimension normalizers, challenging prior theoretical assumptions.
OpenAI GPT-4 announcement and capabilities overview
OpenAI announced GPT-4, a large multimodal model that achieves human‑level performance on many professional benchmarks and is now available via ChatGPT, API waitlist, and open‑source evaluation tools.
OpenAI announces GPT‑4 powered Virtual Volunteer for Be My Eyes
OpenAI integrated GPT‑4’s visual input into the Be My Eyes app, creating a Virtual Volunteer that can describe, analyze, and converse about images, dramatically expanding visual accessibility for blind and low‑vision users.
Stripe GPT-4 Integration Case Study
Stripe integrated GPT-4 across its platform to automate business summaries, enhance developer support via documentation analysis, and improve fraud detection on community forums.
Duolingo Integrates GPT-4 for Advanced Language Learning
Duolingo has launched Duolingo Max, a new subscription tier featuring GPT-4 powered Role Play and Explain my Answer to provide immersive conversation practice and contextual grammar feedback.
Khan Academy Integrates GPT-4 to Power Khanmigo AI Assistant
Khan Academy is piloting Khanmigo, an AI-powered tutor and teacher assistant powered by GPT-4, to provide individualized learning and instructional support.
OpenAI and Government of Iceland Partnership for Icelandic Language Preservation
OpenAI has partnered with the Government of Iceland and private industry to use GPT-4 and Reinforcement Learning from Human Feedback (RLHF) to preserve the Icelandic language in the digital age.
Introducing Claude
Anthropic has released Claude, a next-generation AI assistant designed to be helpful, honest, and harmless, available in high-performance and fast, lightweight versions.
OpenAI GPT-4 Release
OpenAI has released GPT-4, a large language model that demonstrates advanced reasoning, higher accuracy in problem solving, and improved safety and factual reliability compared to GPT-3.5.
Multivariate Probabilistic Time Series Forecasting with Informer
Hugging Face has integrated the Informer model into the Transformers library to enable efficient multivariate probabilistic time series forecasting with reduced computational and memory complexity.
Fine-tuning 20B LLMs with RLHF on a 24GB Consumer GPU
Hugging Face released an integration of TRL and PEFT that enables reinforcement learning fine‑tuning of 20‑billion‑parameter language models on a single 24 GB GPU using 8‑bit quantization and low‑rank adapters.
Anthropic's Core Views on AI Safety
Anthropic outlines an empirically-driven, portfolio-based approach to AI safety to mitigate catastrophic risks associated with the rapid scaling of transformative AI systems.
Kakao Brain ViT and ALIGN Models Release with COYO 700M Dataset
Kakao Brain and Hugging Face released open‑source ViT and ALIGN visual‑language models trained on the new 700 M image‑text COYO dataset, providing the first publicly available ALIGN model and ViT models with reproducible training data.
ControlNet in Diffusers
Hugging Face has integrated ControlNet into the Diffusers library, enabling precise spatial control over Stable Diffusion image generation using conditionings like Canny edges, depth maps, and human poses.
Using Machine Learning for Disaster Response: The afetharita Project
Hugging Face describes how volunteers used the Hugging Face ecosystem to rapidly deploy ML models for OCR, NER, and remote sensing to aid survivors of the February 2023 Turkey earthquakes.
Hugging Face Diffusers Ethical Guidelines
Hugging Face has introduced an ethical framework for the Diffusers library to guide technical decisions and community contributions while mitigating the potential societal risks of diffusion models.
Hugging Face Expert Acceleration Program: Witty Works Case Study
Witty Works utilized the Hugging Face Expert Acceleration Program and SetFit to build a context-dependent inclusive language classifier with high accuracy using minimal labeled data.
OpenAI Planning for AGI and Beyond
OpenAI outlines a strategy for the gradual deployment of AI systems to allow society to adapt, emphasizing the need for increased alignment research, global governance, and a cautious approach to existential risks.
Swift Diffusers for Mac 1.1 Release
Hugging Face has released Diffusers for Mac version 1.1, a native open-source app that leverages Core ML to accelerate Stable Diffusion on Apple Silicon, offering up to 2x faster generation on certain hardware configurations.
Red-Teaming Large Language Models
Hugging Face outlines the critical role of red-teaming in identifying LLM vulnerabilities to prevent harmful outputs, emphasizing the need for collaborative, adaptive evaluation methods.
Fetch AI Infrastructure Migration: Consolidating Tools with Hugging Face and AWS
Fetch reduced development time by 30% and processing latency by 50% by migrating from a third-party AI 'black box' to an in-house ML pipeline powered by Hugging Face and AWS.
Hugging Face and AWS Strategic Partnership for AI Accessibility
Hugging Face and AWS have expanded their strategic partnership to democratize generative AI by integrating Hugging Face models with AWS infrastructure and purpose-built ML accelerators.
OpenAI AI System Behavior and Governance Framework
OpenAI outlines a two-step training process to shape ChatGPT's behavior and a three-pillar strategy to improve defaults, enable user customization, and integrate public input into AI governance.
Hugging Face Inference Endpoints Case Study
Hugging Face is migrating its CPU-based ML models from AWS ECS/Fargate to Hugging Face Inference Endpoints to reduce operational complexity and improve latency.
BLIP-2: Zero-Shot Image-to-Text Generation
BLIP-2 is a visual-language model from Salesforce Research that uses a Querying Transformer (Q-Former) to bridge frozen image encoders and frozen large language models for efficient zero-shot image-to-text generation.
Anthropic Research: The Capacity for Moral Self-Correction in LLMs
Anthropic research demonstrates that Large Language Models (LLMs) trained with RLHF can morally self-correct to avoid harmful outputs when instructed, a capability that emerges at 22B parameters.
🤗 PEFT library release enables parameter-efficient fine-tuning of billion‑scale models
Hugging Face announced the 🤗 PEFT library, which lets users fine‑tune billion‑parameter models on low‑resource hardware by training only a tiny fraction of parameters.
SpeechT5: Unified-Modal Encoder-Decoder for Speech Processing
Hugging Face has integrated SpeechT5, a unified Transformer-based model capable of text-to-speech, speech-to-speech, and speech-to-text tasks through a shared encoder-decoder backbone.
Hugging Face AI vs. AI: Multi-Agent Reinforcement Learning Competition System
Hugging Face has introduced AI vs. AI, an open-source system for ranking deep reinforcement learning models through continuous multi-agent competitions using an ELO rating system.
Hugging Face AI for Game Development: Generating Stories
Hugging Face outlines a workflow for using Large Language Models (LLMs) like ChatGPT to generate game stories and content, while highlighting critical limitations regarding originality, legal risks, and long-term coherence.
Accelerating PyTorch Transformers with Intel Sapphire Rapids
Hugging Face demonstrates that combining Intel Sapphire Rapids CPUs with the Optimum Intel library can accelerate PyTorch transformer inference by up to 3x compared to previous Xeon generations.
A Dive into Vision-Language Models
Hugging Face provides a technical overview of vision-language models, detailing five primary pre-training strategies and their integration into the Transformers library for tasks like VQA and image segmentation.
Anthropic Partners with Google Cloud for AI Infrastructure
Anthropic has selected Google Cloud as its cloud provider to leverage GPU and TPU clusters for training, scaling, and deploying its AI systems, including the Claude assistant.
ChatGPT Plus launch
OpenAI announced ChatGPT Plus, a $20/month subscription that guarantees access during peak times, faster responses, and priority feature rollouts, expanding its availability worldwide.
OpenAI AI Text Classifier Release (January 2023)
OpenAI released a public AI text classifier in January 2023 that flags likely AI‑generated English text, but it is unreliable—identifying only 26% of AI text and mislabeling 9% of human text.
The State of Computer Vision at Hugging Face
Hugging Face has expanded its ecosystem to support 8 core computer vision tasks, over 3,000 models, and 100+ datasets, integrating both Transformer and convolutional architectures.
Hugging Face 2D Asset Generation for Game Development
Hugging Face demonstrates how to integrate Stable Diffusion's Image2Image capability into a collaborative 2D game asset workflow to create production-ready icons efficiently.
Using LoRA for Efficient Stable Diffusion Fine-Tuning
Hugging Face has integrated Low-Rank Adaptation (LoRA) into the diffusers library, enabling faster Stable Diffusion fine-tuning with significantly lower VRAM requirements and model weights as small as 3 MB.
Hugging Face Optimum and ONNX Runtime Training Integration
Hugging Face and Microsoft have integrated ONNX Runtime into the Optimum library to reduce training times for transformer-based models by 35% or more.
What Makes a Dialog Agent Useful? Technical Analysis
Hugging Face analyzes the key techniques—including Instruction Fine-Tuning (IFT), Supervised Fine-Tuning (SFT), Reinforcement Learning from Human Feedback (RLHF), and Chain-of-Thought (CoT)—that transform base language models into useful conversational agents.
OpenAI and Microsoft Extend Strategic Partnership
OpenAI and Microsoft have extended their multi-year, multi-billion dollar partnership to accelerate independent AI research and expand the deployment of AI models via Azure.
Hugging Face AI for Game Development: 3D Asset Generation
Hugging Face explores the current state of text-to-3D AI, concluding that while tools like DreamFusion and Point-E exist, they are not yet practically applicable for rapid game development workflows.
Mask2Former and OneFormer: Universal Image Segmentation Models in 🤗 Transformers
Hugging Face released Mask2Former and OneFormer in the Transformers library, providing universal architectures that handle instance, semantic, and panoptic segmentation with a single model.
PaddlePaddle Integration with Hugging Face Hub
Hugging Face has partnered with PaddlePaddle to integrate its deep learning platform and libraries, starting with PaddleNLP, into the Hugging Face Hub for improved accessibility and sharing.
Image Similarity with Hugging Face Datasets and Transformers
Hugging Face demonstrates how to build an image similarity system using the Transformers and Datasets libraries by computing dense vector embeddings and measuring cosine similarity.
Forecasting Misuse of Language Models for Disinformation Campaigns
OpenAI, Georgetown University, and the Stanford Internet Observatory released a report analyzing how large language models could lower the cost and increase the scale of disinformation campaigns, proposing a four-stage framework for mitigation.
AI for Game Development: Using LLMs for Game Design
Hugging Face demonstrates how Large Language Models like ChatGPT can be used as brainstorming and acceleration tools for game design, specifically for defining core features of a farming game.