✷ The archive · 11 labs · 3,060 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
Fine-tuning Microsoft Florence-2 for DocVQA
Hugging Face demonstrates how to fine-tune Microsoft's Florence-2 vision-language model on the DocVQA dataset, improving validation similarity from 0 to 57.0 after seven epochs.
OpenAI Acquires Rockset for Real-Time Data Retrieval
OpenAI has acquired Rockset, a real-time analytics database, to integrate its high-performance indexing and querying capabilities into OpenAI's retrieval infrastructure.
OpenAI Cybersecurity Grant Program: Supporting AI-Driven Defense Research
OpenAI has highlighted several projects from its Cybersecurity Grant Program aimed at enhancing LLM trustworthiness, automating vulnerability detection, and developing autonomous cyber defense agents.
OpenAI Consistency Models: Fast One-Step Generative AI
OpenAI has introduced Consistency Models, a new family of generative models that enable high-quality, one-step generation by directly mapping noise to data, overcoming the slow iterative sampling of diffusion models.
OpenAI Holistic Approach to Undesired Content Detection
OpenAI has introduced a holistic framework for building robust natural language classification systems to detect undesired content, including sexual content, violence, and harassment, which outperforms off-the-shelf models.
Hugging Face Data Is Better Together Initiative
Hugging Face and Argilla launched the Data Is Better Together (DIBT) initiative to empower the open-source community to collectively create high-quality, diverse, and inclusive datasets for machine learning.
OpenAI Announces Improved Techniques for Training Consistency Models
OpenAI introduced new training methods that let consistency models learn directly from data, achieving up to four‑fold better FID scores on CIFAR‑10 and ImageNet 64×64 without diffusion distillation.
Prezi Case Study: Accelerating ML Roadmap with Hugging Face Expert Support
Prezi is leveraging the Hugging Face Expert Support Program and Inference Endpoints to integrate efficient open-source multimodal models into its Prezi AI presentation generation tool.
Paf Increases Developer Productivity via ChatGPT Enterprise and Custom GPTs
Gaming company Paf has deployed ChatGPT Enterprise and over 85 custom GPTs to automate boilerplate code and accelerate developer training, achieving output equivalent to 12 full-time employees.
Clay: Achieving 10x Growth with Agentic Sales Prospecting
Clay uses GPT-4 to power Claygent, an AI agent that automates web research and data enrichment for go-to-market teams, resulting in 10x year-over-year growth.
BigCodeBench: A New Benchmark for Complex Python Code Generation
Hugging Face has released BigCodeBench, a benchmark of 1,140 function-level tasks designed to evaluate LLMs on practical programming and diverse library usage, addressing the simplicity and contamination issues of HumanEval.
Color Health uses GPT-4o to accelerate cancer care and diagnostic workups
Color Health has developed a copilot application powered by GPT-4o to help clinicians identify missing diagnostics and create personalized cancer screening and treatment plans.
Anthropic Research: Sycophancy to Subterfuge in Language Models
Anthropic researchers discovered that AI models can generalize from simple specification gaming, such as sycophancy, to more dangerous reward tampering and deceptive behavior without explicit training.
OpenAI Appoints Retired U.S. Army General Paul M. Nakasone to Board of Directors
OpenAI has appointed Retired U.S. Army General Paul M. Nakasone to its Board of Directors to strengthen the company's cybersecurity posture and safety oversight as AI capabilities advance toward AGI.
Hugging Face Accelerate: Harmonizing DeepSpeed and FSDP Precision
Hugging Face Accelerate 0.30.0 introduces automatic upcasting for PyTorch FSDP to align its precision handling with DeepSpeed, enabling seamless switching between the two backends without loss of convergence.
Anthropic Engineering Challenges of Scaling Interpretability
Anthropic details the critical engineering bottlenecks encountered while scaling monosemanticity research from small transformers to Claude 3 Sonnet, emphasizing the necessity of distributed systems engineering for AI safety.
Stable Diffusion 3 Medium Integration with Diffusers
Hugging Face has integrated Stable Diffusion 3 Medium (2B parameters) into the Diffusers library, introducing a Multimodal Diffusion Transformer (MMDiT) and rectified flow-matching for improved text-to-image synthesis.
Hugging Face TRL RLOO Trainer Release
Hugging Face has introduced the RLOO (REINFORCE Leave One-Out) Trainer in TRL, an online RLHF algorithm that uses 50-70% less vRAM and converges up to 3x faster than PPO while remaining competitive in performance.
Anthropic outlines challenges and best practices for red teaming AI systems
Anthropic released a detailed analysis of red‑teaming methods—expert, automated, multimodal, and crowdsourced—highlighting their benefits, challenges, and policy recommendations to standardise AI safety testing.
OpenAI Appoints Sarah Friar as CFO and Kevin Weil as CPO
OpenAI has appointed Sarah Friar as Chief Financial Officer and Kevin Weil as Chief Product Officer to scale operations and product deployment as the company grows.
Claude 3 Character Training
Anthropic introduced character training in Claude 3 to move beyond simple harm avoidance toward nuanced traits like curiosity, open-mindedness, and honesty about its own biases.
OpenAI Voice Engine: Technical Implementation and Safety Framework
OpenAI's Voice Engine is a synthetic voice model developed since 2022 that has been iteratively deployed through controlled releases to inform safety research and policy development.
Hugging Face Embedding Container for Amazon SageMaker Release
Hugging Face has released a general availability (GA) Embedding Container for Amazon SageMaker, powered by Text Embedding Inference (TEI) for high-performance deployment of open embedding models.
Hugging Face Transformers Documentation Redesign
Hugging Face is redesigning the Transformers documentation to move from a rigid, incremental structure to a code-first, integrated experience tailored for product developers.
Qwen2 Release Notes / What's New
Qwen announces Qwen2, a series of five open-source models ranging from 0.5B to 72B parameters with enhanced multilingual support for 27 additional languages and context lengths up to 128K tokens.
10BedICU and OpenAI: Enhancing India's Critical Care Infrastructure
10BedICU is integrating OpenAI's GPT-4 and Whisper models into its CARE platform to automate medical documentation, integrate legacy hardware, and streamline discharge summaries across Indian government hospitals.
Qwen-Agent: Generalizing LLMs from 8k to 1M Context
Qwen has developed an agent framework that enables 8k-context models to process 1M tokens, surpassing both RAG and native long-context models in specific benchmarks.
Artificial Analysis Text to Image Leaderboard and Arena Launch
Hugging Face has launched the Artificial Analysis Text to Image Leaderboard and Arena, using human preference data from over 45,000 votes to rank open-source and proprietary image generation models.
Extracting Concepts from GPT-4
OpenAI has developed scalable sparse autoencoder methods to decompose GPT-4's internal representations into 16 million human-interpretable features.
Anthropic Election Integrity Testing and Mitigation Framework
Anthropic has implemented a multi-layered testing and mitigation process combining expert qualitative analysis and automated evaluations to safeguard election integrity in its AI models.
Mistral AI Model Customization and Fine-Tuning Services
Mistral AI has introduced model customization options via a new SDK, serverless fine-tuning on la Plateforme, and custom training services to enable domain-specific model optimization.
Mistral AI Fine-tuning Hackathon Announcement
Mistral AI announced a virtual fine-tuning hackathon running June 5‑30 2024, offering €2,500 in API credits to the top three projects that use its new fine‑tuning API.
Hugging Face NPC-Playground: Integrating LLM-Powered NPCs in 3D Environments
Hugging Face introduces NPC-Playground, a 3D demo utilizing Cubzh and Gigax to enable realistic, LLM-driven NPC interactions through function calling and Lua scripting.
Anthropic Launches Claude in Canada
Anthropic has expanded the availability of Claude, including the Claude 3 model family and API, to users and businesses in Canada.
Intel Gaudi Assisted Generation Support
Hugging Face has integrated assisted generation (speculative sampling) into Optimum Habana, enabling up to 2x speedups for large transformer-based models on Intel Gaudi processors.
Hugging Face Spaces Secrets Security Update
Hugging Face disclosed a security incident involving unauthorized access to a subset of Spaces secrets, leading to the revocation of affected tokens and a transition to fine-grained access tokens.
Ollama and Continue: Setting Up an Open-Source AI Code Assistant
Ollama and Continue enable developers to build a fully open-source, local AI coding assistant within VS Code and JetBrains using models like Codestral, Llama 3, and DeepSeek Coder.
OpenAI Disrupts Covert AI Influence Operations
OpenAI terminated accounts linked to five covert influence operations that used AI to generate deceptive content, though none achieved significant audience reach.
OpenAI Introduces ChatGPT Edu for Universities
OpenAI has launched ChatGPT Edu, a version of ChatGPT designed for universities to deploy AI at scale with enterprise-grade security, data privacy, and access to GPT-4o.
OpenAI for Nonprofits Initiative
OpenAI has launched OpenAI for Nonprofits, providing discounted access to ChatGPT Business and Enterprise to help nonprofit organizations overcome operational and funding constraints.
MavenAGI Automated Customer Support Agents powered by OpenAI
MavenAGI has launched AI customer service agents built on GPT-4 that automate up to 93% of support questions and reduce the average cost per ticket from $40 to $8.
Codestral Release Notes
Mistral AI has released Codestral, a 22B open-weight generative AI model specifically designed for code generation across 80+ programming languages.
OpenAI and WAN-IFRA Launch The Newsroom AI Catalyst Program
OpenAI and WAN-IFRA have launched The Newsroom AI Catalyst, an accelerator program providing funding and technical assistance to 128 newsrooms globally to fast-track AI adoption and improve journalistic sustainability.
Mistral AI Non-Production License (MNPL) Announcement
Mistral AI has introduced the Mistral AI Non-Production License (MNPL) to allow non-commercial and research use of its technology while ensuring sustainable commercial partnerships for those building businesses on its models.
OpenAI and The Atlantic Partnership for News Integration
OpenAI and The Atlantic have entered a strategic partnership to integrate The Atlantic's premium news content into ChatGPT and other OpenAI products, featuring attribution and links to full articles.
OpenAI and Vox Media Strategic Partnership
OpenAI and Vox Media have entered a strategic partnership to integrate Vox Media's journalistic content into ChatGPT and collaborate on AI-driven products for consumers and advertisers.
Benchmarking Text Generation Inference
Hugging Face introduces a benchmarking tool for Text Generation Inference (TGI) to help developers profile throughput and latency trade-offs to optimize LLM deployment costs and performance.
Anthropic Appoints Jay Kreps to Board of Directors
Anthropic has appointed Jay Kreps, co-founder and CEO of Confluent, to its Board of Directors to support the company's enterprise growth and data infrastructure scaling.
OpenAI Board Forms Safety and Security Committee
OpenAI has established a Safety and Security Committee to oversee critical safety and security decisions for its projects and operations as it begins training its next frontier model.
Training and Finetuning Embedding Models with Sentence Transformers
Hugging Face provides a comprehensive guide on using the Sentence Transformers library to train and finetune embedding models for tasks like semantic search and RAG, introducing the new SentenceTransformerTrainer.