oxylabs/oxylabs-ai-studio-py

What it solves

This SDK provides a simplified interface for developers to interact with the Oxylabs AI Studio API, enabling the automated extraction of structured data from the web using AI-powered tools. It eliminates the need to write complex custom scrapers for every website, replacing manual rule-based scraping with natural language prompts and AI-driven discovery.

How it works

The SDK wraps several AI-driven data extraction services:

• AI Crawler: Uses natural language prompts to find and extract data from multiple pages across a site.
• AI Scraper: Extracts specific data points from a single page, with the ability to generate JSON schemas for structured output.
• AI Browser Agent: An agentic tool that can interact with a website (e.g., using a search bar) to find and extract specific information.
• AI Search: Performs web searches and returns content in a format suitable for AI processing.
• AI Map: Maps the structure of a website to identify specific types of URLs based on keywords or prompts.

Who it’s for

Developers building AI agents, RAG pipelines, or data collection pipelines that require high-quality, structured web data from dynamic websites.

Highlights

• Natural Language Extraction: Use plain English prompts to guide what data should be extracted.
• Structured Output: Support for JSON, CSV, and Markdown formats, with built-in schema generation.
• Agentic Browsing: Ability to perform browser actions (clicks, inputs) to find data.
• Geo-Targeting: Support for proxy locations to extract region-specific content.
• JS Rendering: Built-in support for rendering JavaScript to handle modern dynamic web pages.