Comparing RoBERTa, Llama 2, and Mistral for Disaster Tweet Classification with LoRA
A comparative study reveals that the smaller RoBERTa model outperforms Llama 2 and Mistral 7B in binary classification of disaster tweets when fine-tuned using Low-Rank Adaptation (LoRA).
OpenAI Introducing GPTs
OpenAI has launched GPTs, custom versions of ChatGPT that users can create for specific purposes without coding, enabling tailored AI assistants for personal, professional, or enterprise use.
OpenAI DevDay 2023: GPT-4 Turbo, Assistants API, and Multimodal Updates
OpenAI announced GPT-4 Turbo with a 128K context window, the new Assistants API for agent-like experiences, and expanded multimodal capabilities including DALL·E 3 and TTS.
Hugging Face Hub Storage Regions
Hugging Face has introduced Storage Regions for Enterprise Hub customers, allowing organizations to select where their models and datasets are stored to improve regulatory compliance and data transfer performance.
Personal Copilot: Train Your Own Coding Assistant
Hugging Face demonstrates how to create a personalized coding assistant, HugCoder, by fine-tuning StarCoder on a specific codebase using QLoRA and full fine-tuning techniques.
OpenAI Frontier Risk and Preparedness Framework
OpenAI has established a dedicated Preparedness team and a Risk-Informed Development Policy to identify, evaluate, and mitigate catastrophic risks associated with frontier AI models.
Frontier Model Forum Updates
OpenAI, Anthropic, Google, and Microsoft have appointed Chris Meserole as Executive Director of the Frontier Model Forum and established a $10 million AI Safety Fund to advance research into evaluating capable AI models.
Hugging Face and Renumics Spotlight Integration for Scalable Data Inspection
Hugging Face has integrated with Renumics Spotlight to enable interactive, one-line-of-code visualization and inspection of ML datasets, including support for multimodal data and model results.
Optimizing Stable Diffusion XL (SDXL) for Inference Speed and Memory
Hugging Face explores several optimization techniques for Stable Diffusion XL (SDXL), demonstrating how to reduce memory usage from 28GB to as low as 11.47GB and decrease inference latency from 72.2 seconds to approximately 10.3 seconds.
Deploying Embedding Models with Hugging Face Inference Endpoints
Hugging Face introduces Text Embeddings Inference (TEI) via Inference Endpoints, providing a high-performance, cost-efficient way to deploy open-source embedding models for RAG and semantic search.
The N Implementation Details of RLHF with PPO – Hugging Face Blog Summary
The Hugging Face blog post reproduces OpenAI’s 2019 RLHF codebase, matches its learning curves, and details N implementation specifics, including a key PyTorch Adam optimizer difference that causes more aggressive updates.
DALL·E 3 Integration in ChatGPT Plus and Enterprise
OpenAI has integrated DALL·E 3 into ChatGPT Plus and Enterprise, introducing a model capable of higher visual fidelity, better prompt adherence, and improved rendering of text, hands, and faces.
Gradio-Lite: Serverless Gradio Running Entirely in Your Browser
Hugging Face introduces Gradio-Lite (@gradio/lite), a JavaScript library that uses Pyodide to run Gradio applications directly in the web browser, eliminating the need for server-side infrastructure.
Typeform Formless: AI-Powered Conversational Data Collection
Typeform has launched Formless, an AI-powered platform built on GPT-3.5 Turbo and GPT-4 that replaces traditional form structures with dynamic, two-way conversational experiences.
Ironclad AI Assist integration with GPT-4
Ironclad has integrated GPT-4 into its contract lifecycle management platform via AI Assist, reducing initial contract redlining time from 40 minutes to two minutes.
Retool AI Integration with GPT-4
Retool has launched Retool AI, a suite of capabilities powered by GPT-4 that allows businesses to build custom AI-powered applications and workflows using a visual canvas.
Accelerating Hugging Face Models with ONNX Runtime
Hugging Face and ONNX Runtime enable performance acceleration for over 130,000 models, including a latency reduction of up to 74.30% for the whisper-tiny model compared to PyTorch.
DALL·E 3 System Card
OpenAI released the DALL·E 3 system card, detailing improvements in caption fidelity and image quality over DALL·E 2, alongside extensive safety evaluations and risk mitigations.
Hugging Face Chat Templates
Hugging Face introduced chat templates as a Jinja-based system to ensure chat models receive inputs formatted exactly as they were during training, preventing silent performance degradation.
Accelerating Stable Diffusion XL Inference with JAX on Cloud TPU v5e
Hugging Face Diffusers now supports serving Stable Diffusion XL (SDXL) using JAX on Cloud TPU v5e, delivering up to 2.4x greater performance per dollar compared to TPU v4.
Deploying AI Comic Factory via Hugging Face Inference API
Hugging Face provides a guide on deploying a private instance of the AI Comic Factory using the Inference API, leveraging Llama-2 and SDXL 1.0 models.
Finetuning Stable Diffusion with DDPO via TRL
Hugging Face has integrated Denoising Diffusion Policy Optimization (DDPO) into the TRL library, enabling the alignment of Stable Diffusion models with human preferences using reinforcement learning.
Hugging Face Ethics and Society Update Summer 2023
Hugging Face detailed its Summer 2023 efforts to influence AI regulation in the US, EU, and UK, while advancing open-source ethics through public advocacy and technical research.
Hugging Face Guide: Training a LLaMA 2 Chatbot Without Code
Hugging Face provides a no-code workflow using Spaces, AutoTrain, and ChatUI to allow non-engineers to fine-tune LLaMA 2 and deploy it as a functional chat application.
Llama 2 on Amazon SageMaker Benchmark
Hugging Face analyzed 60 deployment configurations for Llama 2 on Amazon SageMaker to identify optimal setups for cost, throughput, and latency.
GPT-4V(ision) System Card
OpenAI has introduced GPT-4V(ision), a multimodal expansion of GPT-4 that allows the model to analyze and process image inputs to solve new tasks and provide novel user experiences.
ChatGPT Voice and Image Capabilities Update
OpenAI has introduced multimodal capabilities to ChatGPT, enabling Plus and Enterprise users to engage in voice conversations and share images for analysis.
Hugging Face Inference for PROs
Hugging Face has introduced Inference for PRO users, providing accelerated API endpoints for curated state-of-the-art models and increased rate limits for the free Inference API.
OpenAI Red Teaming Network
OpenAI has launched the Red Teaming Network, a formal community of global domain experts tasked with rigorously evaluating AI models to identify risks and improve safety throughout the development lifecycle.
Rocket Money x Hugging Face: Scaling Volatile ML Models in Production
Rocket Money scaled its transaction classification system to over a billion transactions per month using Hugging Face's Inference API to replace a legacy regex-based system.
Introduction to 3D Gaussian Splatting
3D Gaussian Splatting is a rasterization technique that enables real-time rendering of photorealistic 3D scenes learned from a small set of images.
Hugging Face Object Detection Leaderboard
Hugging Face released an Object Detection Leaderboard that ranks open-source models using COCO-style metrics and published a blog explaining how Average Precision and Average Recall are computed and what factors can influence the results.
Optimizing LLMs in Production: Precision, Attention, and Architecture
Hugging Face outlines key techniques for efficient LLM deployment, focusing on lower precision quantization, Flash Attention for memory efficiency, and architectural optimizations like RoPE, ALiBi, MQA, and GQA.
OpenAI Establishes European Presence with New Dublin Office
OpenAI has opened a new office in Dublin, Ireland, to expand its European operations, trust and safety, security engineering, and legal functions.
Fine-tuning Llama 2 70B using PyTorch FSDP
Hugging Face demonstrates how to fine-tune Llama 2 70B using PyTorch Fully Sharded Data Parallelism (FSDP) and Accelerate to overcome CPU RAM bottlenecks and optimize VRAM usage.
Introducing Würstchen: Fast Diffusion for Image Generation
Würstchen is a fast and efficient text-to-image diffusion model that achieves 42x spatial compression to significantly reduce training and inference costs.
Hugging Face Transformers Quantization Overview
Hugging Face provides native support for bitsandbytes and auto-gptq quantization schemes to enable large model inference on smaller devices and efficient adapter fine-tuning.
SafeCoder vs. Closed-source Code Assistants
Hugging Face introduces SafeCoder, an enterprise-grade code assistant based on the open-source StarCoder models that prioritizes transparency, customization, and data privacy over closed-source alternatives.
Efficient Controllable Generation for SDXL with T2I-Adapters
Hugging Face and TencentARC introduce T2I-Adapter-SDXL, a lightweight plug-and-play model that enables precise control over Stable Diffusion XL (SDXL) generation using external signals like sketches and depth maps with significantly lower computational overhead than ControlNet.
OpenAI DevDay Announcement
OpenAI announced its first developer conference, DevDay, scheduled for November 6, 2023, in San Francisco to preview new tools and engage with the developer community.
Falcon 180B Release Notes
TII has released Falcon 180B, the largest openly available language model with 180 billion parameters, trained on 3.5 trillion tokens to rival proprietary models like PaLM-2.
Fetch Case Study: Reducing ML Processing Latency by 50% with Amazon SageMaker and Hugging Face
Fetch reduced ML processing latency for receipt scans by 50% and increased document-understanding model accuracy by 200% by migrating its ML pipeline to Amazon SageMaker and Hugging Face.
OpenAI Teaching with AI Guide
OpenAI provides practical frameworks and prompt templates for educators to use AI for language support, lesson planning, and personalized tutoring.
AudioLDM 2 Optimization Guide: Reducing Inference Time with Hugging Face Diffusers
Hugging Face demonstrates how to reduce AudioLDM 2 inference time by over 10x, bringing generation of a 10-second audio sample down to under 1 second using code and model optimizations.
ChatGPT Enterprise Release Notes
OpenAI has launched ChatGPT Enterprise, providing organizations with enterprise-grade security, privacy, and unlimited, high-speed access to GPT-4.
Hugging Face Hub Git Authentication Changes
Hugging Face deprecated password-based Git authentication on October 1, 2023, requiring users to switch to personal access tokens or SSH keys for improved security.
Code Llama Release Notes
Code Llama is a family of open-access models based on Llama 2, specialized for code tasks with support for infilling and long-context windows up to 100,000 tokens.
OpenAI and Scale Partnership for Enterprise Fine-Tuning
OpenAI has partnered with Scale to provide enterprises with expert data enrichment and model evaluation support for fine-tuning GPT-3.5 Turbo and GPT-4.
Hugging Face AutoGPTQ and Transformers Integration
Hugging Face has integrated the AutoGPTQ library into Transformers, enabling the quantization of LLMs to 8, 4, 3, or 2-bit precision to reduce memory requirements with negligible accuracy loss at 4-bit.
GPT-3.5 Turbo Fine-Tuning and API Updates
OpenAI has released fine-tuning capabilities for GPT-3.5 Turbo, allowing developers to customize model performance, improve output reliability, and reduce prompt costs.