Skip to content

Files

Latest commit

bcb9b0b Β· Feb 3, 2025

History

History
91 lines (64 loc) Β· 3.57 KB

README.md

File metadata and controls

91 lines (64 loc) Β· 3.57 KB

🌐 ScrapeGraph AI SDKs

License Python SDK JavaScript SDK Documentation

ScrapeGraph API Banner

Official SDKs for the ScrapeGraph AI API - Intelligent web scraping and search powered by AI. Extract structured data from any webpage or perform AI-powered web searches with natural language prompts.

Get your API key!

πŸš€ Quick Links

πŸ“¦ Installation

Python

pip install scrapegraph-py

JavaScript

npm install scrapegraph-js

🎯 Core Features

  • πŸ€– AI-Powered Extraction & Search: Use natural language to extract data or search the web
  • πŸ“Š Structured Output: Get clean, structured data with optional schema validation
  • πŸ”„ Multiple Formats: Extract data as JSON, Markdown, or custom schemas
  • ⚑ High Performance: Concurrent processing and automatic retries
  • πŸ”’ Enterprise Ready: Production-grade security and rate limiting

πŸ› οΈ Available Endpoints

πŸ€– SmartScraper

Using AI to extract structured data from any webpage or HTML content with natural language prompts.

πŸ” SearchScraper

Perform AI-powered web searches with structured results and reference URLs.

πŸ“ Markdownify

Convert any webpage into clean, formatted markdown.

🌟 Key Benefits

  • πŸ“ Natural Language Queries: No complex selectors or XPath needed
  • 🎯 Precise Extraction: AI understands context and structure
  • πŸ”„ Adaptive Processing: Works with both web content and direct HTML
  • πŸ“Š Schema Validation: Ensure data consistency with Pydantic/TypeScript
  • ⚑ Async Support: Handle multiple requests efficiently
  • πŸ” Source Attribution: Get reference URLs for search results

πŸ’‘ Use Cases

  • 🏒 Business Intelligence: Extract company information and contacts
  • πŸ“Š Market Research: Gather product data and pricing
  • πŸ“° Content Aggregation: Convert articles to structured formats
  • πŸ” Data Mining: Extract specific information from multiple sources
  • πŸ“± App Integration: Feed clean data into your applications
  • 🌐 Web Research: Perform AI-powered searches with structured results

πŸ“– Documentation

For detailed documentation and examples, visit:

πŸ’¬ Support & Feedback

πŸ“„ License

This project is licensed under the MIT License - see the LICENSE file for details.


Made with ❀️ by ScrapeGraph AI