✷ The archive · 11 labs · 3,432 dispatches
The labs
No more opening a dozen official blogs every morning. First-hand releases from OpenAI, Anthropic, DeepMind and the rest, each with its substance pulled out.
Building LLM-Powered Web Apps with Client-Side Technology
Ollama explores the feasibility of building fully local Retrieval-Augmented Generation (RAG) web applications using a combination of browser-based tools and Ollama for local LLM execution.
Typeform Formless: AI-Powered Conversational Data Collection
Typeform has launched Formless, an AI-powered platform built on GPT-3.5 Turbo and GPT-4 that replaces traditional form structures with dynamic, two-way conversational experiences.
Ironclad AI Assist integration with GPT-4
Ironclad has integrated GPT-4 into its contract lifecycle management platform via AI Assist, reducing initial contract redlining time from 40 minutes to two minutes.
Retool AI Integration with GPT-4
Retool has launched Retool AI, a suite of capabilities powered by GPT-4 that allows businesses to build custom AI-powered applications and workflows using a visual canvas.
Anthropic Research: Decomposing Language Models With Dictionary Learning
Anthropic researchers have developed a method using dictionary learning to decompose language model layers into monosemantic features, allowing for the interpretation of complex neural network activations that are otherwise invisible at the individual neuron level.
Anthropic Decomposing Language Models Into Understandable Components
Anthropic researchers have developed a method using dictionary learning to decompose neural network activations into interpretable features, moving beyond the limitation of uninterpretable individual neurons.
Ollama Official Docker Image Release
Ollama has released an official Docker sponsored open-source image to simplify the deployment of large language models locally.
Accelerating Hugging Face Models with ONNX Runtime
Hugging Face and ONNX Runtime enable performance acceleration for over 130,000 models, including a latency reduction of up to 74.30% for the whisper-tiny model compared to PyTorch.
Anthropic: Challenges in Evaluating AI Systems
Anthropic outlines the technical and operational difficulties in building robust AI evaluations, arguing that effective AI governance depends on overcoming these measurement challenges.
DALL·E 3 System Card
OpenAI released the DALL·E 3 system card, detailing improvements in caption fidelity and image quality over DALL·E 2, alongside extensive safety evaluations and risk mitigations.
Hugging Face Chat Templates
Hugging Face introduced chat templates as a Jinja-based system to ensure chat models receive inputs formatted exactly as they were during training, preventing silent performance degradation.
Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e
Hugging Face Diffusers now supports serving Stable Diffusion XL (SDXL) using JAX on Cloud TPU v5e, delivering up to 2.4x greater performance per dollar compared to TPU v4.
Deploying AI Comic Factory via Hugging Face Inference API
Hugging Face provides a guide on deploying a private instance of the AI Comic Factory using the Inference API, leveraging Llama-2 and SDXL 1.0 models.
Finetuning Stable Diffusion with DDPO via TRL
Hugging Face has integrated Denoising Diffusion Policy Optimization (DDPO) into the TRL library, enabling the alignment of Stable Diffusion models with human preferences using reinforcement learning.
Hugging Face Ethics and Society Update Summer 2023
Hugging Face detailed its Summer 2023 efforts to influence AI regulation in the US, EU, and UK, while advancing open-source ethics through public advocacy and technical research.
Hugging Face Guide: Training a LLaMA 2 Chatbot Without Code
Hugging Face provides a no-code workflow using Spaces, AutoTrain, and ChatUI to allow non-engineers to fine-tune LLaMA 2 and deploy it as a functional chat application.
Mistral AI: Bringing Open AI Models to the Frontier
Mistral AI has launched to spearhead the revolution of open-weight generative AI models, beginning with the release of Mistral 7B, a model that outperforms other open models up to 13B parameters.
Mistral 7B Release Notes
Mistral AI has released Mistral 7B, a 7.3B parameter language model that outperforms Llama 2 13B across all benchmarks and is available under the Apache 2.0 license.
Llama 2 on Amazon SageMaker Benchmark
Hugging Face analyzed 60 deployment configurations for Llama 2 on Amazon SageMaker to identify optimal setups for cost, throughput, and latency.
GPT-4V(ision) System Card
OpenAI has introduced GPT-4V(ision), a multimodal expansion of GPT-4 that allows the model to analyze and process image inputs to solve new tasks and provide novel user experiences.
ChatGPT Voice and Image Capabilities Update
OpenAI has introduced multimodal capabilities to ChatGPT, enabling Plus and Enterprise users to engage in voice conversations and share images for analysis.
Anthropic Announces $4 Billion Amazon Investment and Expanded Claude 2 Access via AWS Bedrock
Anthropic announced a up‑to‑$4 billion investment from Amazon, making AWS the primary cloud for its models and expanding Claude 2 availability on Amazon Bedrock to bring safer, high‑performing AI to enterprises.
Anthropic Prompt Engineering Guide for Claude's 100k Token Context Window
Anthropic released a quantitative study showing that extracting reference quotes and providing multiple in-context examples dramatically improve Claude's recall on 70‑95k token documents.
Hugging Face Inference for PROs
Hugging Face has introduced Inference for PRO users, providing accelerated API endpoints for curated state-of-the-art models and increased rate limits for the free Inference API.
Integrating Local LLMs with Obsidian Notes via Ollama
Ollama demonstrates how to build an Obsidian plugin that uses Llama Index and local LLMs to enable conceptual search and conversational interaction with personal notes.
OpenAI Red Teaming Network
OpenAI has launched the Red Teaming Network, a formal community of global domain experts tasked with rigorously evaluating AI models to identify risks and improve safety throughout the development lifecycle.
Rocket Money x Hugging Face: Scaling Volatile ML Models in Production
Rocket Money scaled its transaction classification system to over a billion transactions per month using Hugging Face's Inference API to replace a legacy regex-based system.
Anthropic Responsible Scaling Policy
Anthropic has introduced a Responsible Scaling Policy (RSP) that uses AI Safety Levels (ASL) to mandate stricter safety and security protocols as AI models increase in capability and catastrophic risk.
Introduction to 3D Gaussian Splatting
3D Gaussian Splatting is a rasterization technique that enables real-time rendering of photorealistic 3D scenes learned from a small set of images.
Hugging Face Object Detection Leaderboard
Hugging Face released an Object Detection Leaderboard that ranks open-source models using COCO-style metrics and published a blog explaining how Average Precision and Average Recall are computed and what factors can influence the results.
Optimizing LLMs in Production: Precision, Attention, and Architecture
Hugging Face outlines key techniques for efficient LLM deployment, focusing on lower precision quantization, Flash Attention for memory efficiency, and architectural optimizations like RoPE, ALiBi, MQA, and GQA.
Anthropic and BCG Partnership for Enterprise AI Deployment
Anthropic has partnered with Boston Consulting Group (BCG) to integrate Claude AI into enterprise strategic offerings, focusing on the deployment of safe and responsible generative AI solutions.
OpenAI Establishes European Presence with New Dublin Office
OpenAI has opened a new office in Dublin, Ireland, to expand its European operations, trust and safety, security engineering, and legal functions.
Fine-tuning Llama 2 70B using PyTorch FSDP
Hugging Face demonstrates how to fine-tune Llama 2 70B using PyTorch Fully Sharded Data Parallelism (FSDP) and Accelerate to overcome CPU RAM bottlenecks and optimize VRAM usage.
Introducing Würstchen: Fast Diffusion for Image Generation
Würstchen is a fast and efficient text-to-image diffusion model that achieves 42x spatial compression to significantly reduce training and inference costs.
Hugging Face Transformers Quantization Overview
Hugging Face provides native support for bitsandbytes and auto-gptq quantization schemes to enable large model inference on smaller devices and efficient adapter fine-tuning.
SafeCoder vs. Closed-source Code Assistants
Hugging Face introduces SafeCoder, an enterprise-grade code assistant based on the open-source StarCoder models that prioritizes transparency, customization, and data privacy over closed-source alternatives.
Code Llama Prompting Guide
Ollama provides a technical guide on how to structure prompts for Meta's Code Llama model variations, including Instruct, Code completion, and Python-specific versions.
Efficient Controllable Generation for SDXL with T2I-Adapters
Hugging Face and TencentARC introduce T2I-Adapter-SDXL, a lightweight plug-and-play model that enables precise control over Stable Diffusion XL (SDXL) generation using external signals like sketches and depth maps with significantly lower computational overhead than ControlNet.
Claude Pro Release Notes
Anthropic has introduced Claude Pro, a paid subscription plan for Claude.ai that provides 5x more usage of the Claude 2 model, priority access, and early feature access for $20 (US) or 18 (UK) per month.
OpenAI DevDay Announcement
OpenAI announced its first developer conference, DevDay, scheduled for November 6, 2023, in San Francisco to preview new tools and engage with the developer community.
Falcon 180B Release Notes
TII has released Falcon 180B, the largest openly available language model with 180 billion parameters, trained on 3.5 trillion tokens to rival proprietary models like PaLM-2.
Fetch Case Study: Reducing ML Processing Latency by 50% with Amazon SageMaker and Hugging Face
Fetch reduced ML processing latency for receipt scans by 50% and increased document-understanding model accuracy by 200% by migrating its ML pipeline to Amazon SageMaker and Hugging Face.
OpenAI Teaching with AI Guide
OpenAI provides practical frameworks and prompt templates for educators to use AI for language support, lesson planning, and personalized tutoring.
AudioLDM 2 Optimization Guide: Reducing Inference Time with Hugging Face Diffusers
Hugging Face demonstrates how to reduce AudioLDM 2 inference time by over 10x, bringing generation of a 10-second audio sample down to under 1 second using code and model optimizations.
ChatGPT Enterprise Release Notes
OpenAI has launched ChatGPT Enterprise, providing organizations with enterprise-grade security, privacy, and unlimited, high-speed access to GPT-4.
Hugging Face Hub Git Authentication Changes
Hugging Face deprecated password-based Git authentication on October 1, 2023, requiring users to switch to personal access tokens or SSH keys for improved security.
Code Llama Release Notes
Code Llama is a family of open-access models based on Llama 2, specialized for code tasks with support for infilling and long-context windows up to 100,000 tokens.
OpenAI and Scale Partnership for Enterprise Fine-Tuning
OpenAI has partnered with Scale to provide enterprises with expert data enrichment and model evaluation support for fine-tuning GPT-3.5 Turbo and GPT-4.
Run Code Llama locally with Ollama
Meta's Code Llama models are now runnable locally via Ollama, offering 7B, 13B, and 34B parameter versions plus code and Python specializations for programming tasks.