✷ The archive · 6,249 dispatches
All dispatches
Everything AgentLensHQ has filed — distilled from across the AI ecosystem.
Fine-tuning Llama 2 70B using PyTorch FSDP
Hugging Face demonstrates how to fine-tune Llama 2 70B using PyTorch Fully Sharded Data Parallelism (FSDP) and Accelerate to overcome CPU RAM bottlenecks and optimize VRAM usage.
Introducing Würstchen: Fast Diffusion for Image Generation
Würstchen is a fast and efficient text-to-image diffusion model that achieves 42x spatial compression to significantly reduce training and inference costs.
Hugging Face Transformers Quantization Overview
Hugging Face provides native support for bitsandbytes and auto-gptq quantization schemes to enable large model inference on smaller devices and efficient adapter fine-tuning.
SafeCoder vs. Closed-source Code Assistants
Hugging Face introduces SafeCoder, an enterprise-grade code assistant based on the open-source StarCoder models that prioritizes transparency, customization, and data privacy over closed-source alternatives.
Code Llama Prompting Guide
Ollama provides a technical guide on how to structure prompts for Meta's Code Llama model variations, including Instruct, Code completion, and Python-specific versions.
Efficient Controllable Generation for SDXL with T2I-Adapters
Hugging Face and TencentARC introduce T2I-Adapter-SDXL, a lightweight plug-and-play model that enables precise control over Stable Diffusion XL (SDXL) generation using external signals like sketches and depth maps with significantly lower computational overhead than ControlNet.
Claude Pro Release Notes
Anthropic has introduced Claude Pro, a paid subscription plan for Claude.ai that provides 5x more usage of the Claude 2 model, priority access, and early feature access for $20 (US) or 18 (UK) per month.
OpenAI DevDay Announcement
OpenAI announced its first developer conference, DevDay, scheduled for November 6, 2023, in San Francisco to preview new tools and engage with the developer community.
Falcon 180B Release Notes
TII has released Falcon 180B, the largest openly available language model with 180 billion parameters, trained on 3.5 trillion tokens to rival proprietary models like PaLM-2.
Fetch Case Study: Reducing ML Processing Latency by 50% with Amazon SageMaker and Hugging Face
Fetch reduced ML processing latency for receipt scans by 50% and increased document-understanding model accuracy by 200% by migrating its ML pipeline to Amazon SageMaker and Hugging Face.
OpenAI Teaching with AI Guide
OpenAI provides practical frameworks and prompt templates for educators to use AI for language support, lesson planning, and personalized tutoring.
AudioLDM 2 Optimization Guide: Reducing Inference Time with Hugging Face Diffusers
Hugging Face demonstrates how to reduce AudioLDM 2 inference time by over 10x, bringing generation of a 10-second audio sample down to under 1 second using code and model optimizations.
ChatGPT Enterprise Release Notes
OpenAI has launched ChatGPT Enterprise, providing organizations with enterprise-grade security, privacy, and unlimited, high-speed access to GPT-4.
Hugging Face Hub Git Authentication Changes
Hugging Face deprecated password-based Git authentication on October 1, 2023, requiring users to switch to personal access tokens or SSH keys for improved security.
Code Llama Release Notes
Code Llama is a family of open-access models based on Llama 2, specialized for code tasks with support for infilling and long-context windows up to 100,000 tokens.
OpenAI and Scale Partnership for Enterprise Fine-Tuning
OpenAI has partnered with Scale to provide enterprises with expert data enrichment and model evaluation support for fine-tuning GPT-3.5 Turbo and GPT-4.
Run Code Llama locally with Ollama
Meta's Code Llama models are now runnable locally via Ollama, offering 7B, 13B, and 34B parameter versions plus code and Python specializations for programming tasks.
Hugging Face AutoGPTQ and Transformers Integration
Hugging Face has integrated the AutoGPTQ library into Transformers, enabling the quantization of LLMs to 8, 4, 3, or 2-bit precision to reduce memory requirements with negligible accuracy loss at 4-bit.
GPT-3.5 Turbo Fine-Tuning and API Updates
OpenAI has released fine-tuning capabilities for GPT-3.5 Turbo, allowing developers to customize model performance, improve output reliability, and reduce prompt costs.
IDEFICS: An Open Reproduction of State-of-the-art Visual Language Model
Hugging Face has released IDEFICS, an open-access visual language model based on the Flamingo architecture that supports interleaved image and text inputs in 9B and 80B parameter sizes.
Hugging Face SafeCoder Announcement
Hugging Face has introduced SafeCoder, a self-hosted, enterprise-grade code assistant solution that allows companies to build and deploy proprietary Code LLMs within their own secure infrastructure.
OpenAI acquires Global Illumination
OpenAI has acquired Global Illumination, a creative tools and infrastructure company, to integrate its team into the development of core products including ChatGPT.
Using GPT-4 for Content Moderation
OpenAI is utilizing GPT-4 to accelerate content moderation by automating policy application and refinement, reducing the time to develop custom policies from months to hours.
Anthropic and SK Telecom Partnership Announcement
Anthropic and SK Telecom (SKT) have entered a commercial partnership and strategic investment to develop a customized LLM for the telecommunications industry.
Hugging Face Hub on AWS Marketplace
Hugging Face has integrated its Hub with the AWS Marketplace, allowing organizations to pay for managed services like Inference Endpoints and AutoTrain directly through their AWS accounts.
Deploying DeepFloyd IF with BentoML
Hugging Face demonstrates how to use BentoML to deploy the DeepFloyd IF text-to-image model, enabling independent scaling of its multi-stage pixel diffusion architecture across multiple GPUs.
Optimizing Bark using 🤗 Transformers
Hugging Face demonstrates how to reduce the memory footprint and improve inference speed of the Bark text-to-speech model using Better Transformer, half-precision (fp16), and CPU offload.
Claude Instant 1.2 Release Notes
Anthropic has released Claude Instant 1.2, a faster and lower-priced model that improves upon version 1.1 in math, coding, reasoning, and safety.
Swift Transformers Release: Run On-Device LLMs on Apple Devices
Hugging Face released the alpha swift-transformers Swift package, swift-chat demo app, updated exporters and transformers-to-coreml tools, and Core ML versions of Llama 2 7B and Falcon 7B, enabling developers to run LLMs on-device in Apple apps.
Fine-tuning Llama 2 with Direct Preference Optimization (DPO) via TRL
Hugging Face has integrated Direct Preference Optimization (DPO) into the TRL library, enabling the alignment of Llama 2 and other LLMs using a simplified binary cross-entropy loss instead of complex RLHF pipelines.
Studying Large Language Model Generalization with Influence Functions
Anthropic researchers use the EK-FAC approximation to scale influence functions to LLMs with up to 52 billion parameters, enabling the identification of specific training examples that drive model behavior.
Anthropic Research: Tracing Model Outputs to Training Data using Influence Functions
Anthropic researchers scaled influence functions to LLMs up to 52 billion parameters, discovering that model generalization becomes more abstract and conceptually driven as model scale increases.
Deploying MusicGen via Hugging Face Inference Endpoints
Hugging Face demonstrates how to deploy MusicGen, a text-to-music generation model, as an API using Inference Endpoints and custom handlers for models not supported by standard pipelines.
Towards Encrypted Large Language Models with FHE
Hugging Face and Zama demonstrate how Fully Homomorphic Encryption (FHE) can enable Large Language Models to process encrypted user data while protecting the model owner's intellectual property.
Huggy Lingo: Improving Hugging Face Hub Language Metadata with ML
Hugging Face is using the fastText language identification model and Librarian-Bots to automatically detect and suggest language metadata for datasets that currently lack it.
Confidence-Building Measures for Artificial Intelligence
OpenAI and the Berkeley Risk and Security Lab propose six confidence-building measures (CBMs) to mitigate international security risks introduced by foundation models.
Practical 3D Asset Generation Guide
Hugging Face provides a step-by-step workflow for creating low-fidelity, PS1-style 3D assets by combining OpenAI's Shap-E model with Blender and Dream Textures.
Segmind SD-Small and SD-Tiny Knowledge Distillation Release
Segmind open-sourced the code and pretrained weights for SD‑Small and SD‑Tiny, two diffusion models that are 35% and 55% smaller than Stable Diffusion while delivering up to 2× faster inference.
Running Uncensored Llama 2 Models Locally with Ollama
Ollama enables users to run uncensored versions of Llama 2 and other models locally, removing the alignment constraints that often lead to overly cautious or refusals in standard models.
Stable Diffusion XL on Mac with Advanced Core ML Quantization
Hugging Face and Apple have ported Stable Diffusion XL to Core ML, introducing mixed-bit palettization to reduce the UNet size by 71% while maintaining image quality on Apple Silicon Macs.
Frontier Model Forum Announcement
OpenAI, Google, Microsoft, and Anthropic have launched the Frontier Model Forum to coordinate safety standards, research, and information sharing for the development of frontier AI models.
Anthropic Frontier Threats Red Teaming for AI Safety
Anthropic has established a frontier threats red teaming framework to identify and mitigate national security risks, specifically finding that unmitigated LLMs could accelerate biological weaponization efforts within the next two to three years.
Anthropic Frontier Model Security Framework
Anthropic proposes a security framework for frontier AI models based on multi-party authorization and secure software development standards to prevent theft and misuse.
Agents.js Release: Give Tools to LLMs using JavaScript
Hugging Face has released Agents.js, a JavaScript library that enables LLMs to access and execute tools in the browser or on a server.
Hugging Face and Partners Outline Open ML Considerations for the EU AI Act
Hugging Face, in coalition with Creative Commons, Eleuther AI, GitHub, LAION, and Open Future, has proposed five key recommendations to ensure the EU AI Act supports open-source machine learning development.
OpenAI AI Governance Commitments
OpenAI has committed to a framework of internal and external red-teaming, information sharing, AI-generated content identification, and transparent reporting on model capabilities and societal risks.
Hugging Face Open Source AI Game Jam Results
Hugging Face hosted its first Open Source AI Game Jam, resulting in 88 game submissions that integrated open-source AI tools for assets, coding, and gameplay mechanics.
ChatGPT Custom Instructions Release
OpenAI has introduced custom instructions for ChatGPT, allowing users to set persistent preferences and requirements that the model considers across all future conversations.
Hugging Face Diffusers First Anniversary Overview
Hugging Face celebrates the first anniversary of the Diffusers library, highlighting its evolution into a modular toolbox for text-to-image, video, 3D, and audio generation.
OpenAI and American Journalism Project Partnership for Local News
OpenAI has partnered with the American Journalism Project (AJP) through a $10 million commitment in funding and API credits to explore how AI can enhance local journalism and counter misinformation.