License Python SDK JavaScript SDK Documentation
Official SDKs for the ScrapeGraph AI API - Intelligent web scraping and search powered by AI. Extract structured data from any webpage or perform AI-powered web searches with natural language prompts.
Get your API key!
- π€ SmartScraper: Extract structured data from webpages using natural language prompts
- π SearchScraper: AI-powered web search with structured results and reference URLs
- π Markdownify: Convert any webpage into clean, formatted markdown
- π·οΈ SmartCrawler: Intelligently crawl and extract data from multiple pages
- π€ AgenticScraper: Perform automated browser actions with AI-powered session management
- π Scrape: Convert webpages to HTML with JavaScript rendering and custom headers
- β° Scheduled Jobs: Create and manage automated scraping workflows with cron scheduling
- π³ Credits Management: Monitor API usage and credit balance
- π¬ Feedback System: Provide ratings and feedback to improve service quality
ScrapeGraphAI offers seamless integration with popular frameworks and tools to enhance your scraping capabilities. Whether you're building with Python or Node.js, using LLM frameworks, or working with no-code platforms, we've got you covered with our comprehensive integration options..
You can find more informations at the following link
Integrations:
- API: Documentation
- SDKs: Python, Node
- LLM Frameworks: Langchain, Llama Index, Crew.ai, CamelAI
- Low-code Frameworks: Pipedream, Bubble, Zapier, n8n, LangFlow
- MCP server: Link
pip install scrapegraph-py
npm install scrapegraph-js
- π€ AI-Powered Extraction & Search: Use natural language to extract data or search the web
- π Structured Output: Get clean, structured data with optional schema validation
- π Multiple Formats: Extract data as JSON, Markdown, or custom schemas
- β‘ High Performance: Concurrent processing and automatic retries
- π Enterprise Ready: Production-grade security and rate limiting
Using AI to extract structured data from any webpage or HTML content with natural language prompts.
Perform AI-powered web searches with structured results and reference URLs.
Convert any webpage into clean, formatted markdown.
Intelligently crawl and extract data from multiple pages with configurable depth and batch processing.
Perform automated browser actions on webpages using AI-powered agentic scraping with session management.
Convert webpages into HTML format with optional JavaScript rendering and custom headers.
Create, manage, and monitor scheduled scraping jobs with cron expressions and execution history.
Check your API credit balance and usage.
Send feedback and ratings for scraping requests to help improve the service.
- π Natural Language Queries: No complex selectors or XPath needed
- π― Precise Extraction: AI understands context and structure
- π Adaptive Processing: Works with both web content and direct HTML
- π Schema Validation: Ensure data consistency with Pydantic/TypeScript
- β‘ Async Support: Handle multiple requests efficiently
- π Source Attribution: Get reference URLs for search results
- π’ Business Intelligence: Extract company information and contacts
- π Market Research: Gather product data and pricing
- π° Content Aggregation: Convert articles to structured formats
- π Data Mining: Extract specific information from multiple sources
- π± App Integration: Feed clean data into your applications
- π Web Research: Perform AI-powered searches with structured results
For detailed documentation and examples, visit:
- π§ Email: support@scrapegraphai.com
- π» GitHub Issues: Create an issue
- π Feature Requests: Request a feature
This project is licensed under the MIT License - see the LICENSE file for details.
Made with β€οΈ by ScrapeGraph AI