Scraping & Extraction

Fetch Xiaohongshu note details, engagement and comments by note ID

Search Xiaohongshu notes by keyword with engagement stats and covers

Search Xiaohongshu notes with full body text, media and engagement fields

Fetch Xiaohongshu user profiles and their published notes by user ID

Extract YouTube video metrics and channel info from keyword searches

Extract transcripts and metadata for many YouTube videos in one batch

Extract channel data from YouTube search results for creator research

Extract YouTube video lists and comments for viewer sentiment analysis

Extract structured YouTube search results, including Shorts, by keyword

Extract a YouTube channel's video list with latest and top uploads

Extract Zhihu articles and full text by topic for trend tracking

Fetch and parse web pages with Scrapling, including session logins and bulk runs

Extract data from chart, table and screenshot images with vision captions and export CSV

Extract clean Markdown from web pages for notes and knowledge bases

Read and parse URLs, documents, audio and video through the Cue Omni Reader tools

Scrape public profiles, posts and comments from 27+ social platforms via API

Download and archive the web pages and social posts from links you already have

Batch export WeChat official account articles, metrics and comments to local files

Extract the main content of a web page as Markdown with Chromium on-device ML

Fetch a URL with Playwright and convert the page to Markdown

Build sourced JSON dossiers on people, companies or topics from many sites

Scrape websites, LinkedIn, GitHub, X and YouTube through DeepAPI endpoints

Fetch HTML or JSON from static URLs without starting a full browser

Fetch a product's price, stock and rating from retailer pages as typed fields

Extract editable text from PDFs, scans and images with OCR

Extract X tweets, followers and trends and monitor accounts with webhooks

Archive and triage your tweets, DMs, likes and mentions in a local workspace

Archive Discord messages and threads locally and search them with full-text queries

Archive Slack messages, threads and channels from APIs or export ZIP files

Search and export WhatsApp Desktop chat history from a local read-only archive

Pull Slack conversations and users out of Slackdump archive files

Explain the different Slackdump source types and how their structure differs

Convert JavaScript-rendered web pages to clean Markdown with a local CLI

Convert any URL to clean markdown through Chrome, with YouTube transcripts

Search and fetch posts from Twitter/X, Reddit and Hacker News

Scrape Instagram, TikTok, LinkedIn, Google Maps and 15+ other platforms with Apify

Extract structured data from images, PDFs and Word or Excel files into a database

Fetch WeChat Official Account articles and convert them to Markdown

Convert WeChat Official Account articles into Markdown with local images

Parse PDFs and images into Markdown with tables, formulas and heading levels

Migrate an ArcGIS Hub open data site into a PortalJS portal end to end

Harvest datasets from CKAN, DCAT, Socrata or ArcGIS into a PortalJS catalog

Run Apify scraping actors, track costs and diff results across scrapes locally

Pull website intelligence, brand data, screenshots and crawls from Context.dev

Run Firecrawl web scraping and crawling jobs through its API from the command line

Pull creator profiles, ads, comments and transcripts across 28 social platforms

Scrape Google search results and track keyword rank with a scrape.do credit governor

Scrape Instagram, TikTok, YouTube and Google data with Apify actors into JSON or CSV

Parse scanned documents and extract structured text with PaddleOCR-VL