Scraping & Extraction

Extract text from PNG, JPEG, TIFF and BMP images with Tesseract OCR

Search The Pirate Bay through its JSON API and extract magnet links

Install and run the MediaCrawler client to collect Douyin, Bilibili and Weibo data

Collect Bilibili videos, comments and creator evidence for topic and audience research

Collect Douyin keyword search, video detail and comments for trend research

Collect Kuaishou videos, comments and creator profiles for trend research

Collect Baidu Tieba threads and replies to study community pain points

Collect Weibo posts, comments and creator IDs for discourse and trend research

Collect Zhihu answers, articles and comments for expert discourse research

Extract text from images and scanned documents with Tesseract OCR

Decode EBCDIC overpunch sign letters in mainframe fixed-width amount fields

Extract text from images with Tesseract OCR in Python

Parse structured text input files reliably into usable records

Download and parse VCF, h5ad, BAM and SDF files when no tool covers the source

Turn any web page into clean Markdown for reading, saving or reuse

Scrape BOSS Zhipin job listings and salaries via Chrome CDP into JSON or CSV

Build a daily digest from 90 tech blogs, scored and filtered by AI into Markdown

Generate and validate web scraper scripts using verified page selectors

Scrape listings, tables and feeds into data with a reusable Playwright script

Fetch Bilibili video stats, tags and danmaku text as citable source data

Extract page HTML, Markdown or text with the Scrapling CLI, static or browser-backed

Fetch an X or Twitter post with its text, metrics and images as Markdown

Fetch an external URL and turn its content into readable text

Search tweets, user profiles and follower events on Twitter/X through the 6551 API

Reverse engineer JavaScript signatures to collect data from authorized web APIs

Mimic browser HTTP/2 settings and header order to get past bot detection

Spoof TLS ClientHello and JA4 fingerprints to look like a real browser

Get watermark-free Douyin video links and extract speech transcripts from them

Extract text from PDFs and scanned documents with pymupdf or marker OCR

Extract web page data from plain-language prompts with ScrapeGraph

Scrape blog posts from RSS feeds and track competitor blogs by keyword

Pull structured fields from any web page into a clean schema

Search Hacker News stories and comments through the free Algolia API

Pull Instagram profiles, posts and reels into structured data

Scrape LinkedIn and Indeed job postings with titles, salaries and apply links

Scrape LinkedIn job postings into a pipeline with the JobSpy Python library

Scrape recent LinkedIn posts from chosen profiles to track founder activity

Pull LinkedIn profiles, company pages and posts into structured data

Scrape Product Hunt trending launches with Apify to track competitors

Search and scrape Reddit posts by keyword, subreddit and time range with Apify

Scrape G2, Capterra and Trustpilot reviews to track competitors and sentiment

Pull G2, Capterra and Trustpilot product reviews to watch competitor sentiment

Collect social profiles, posts, comments and ad library data via ScrapeCreators

Scrape social profiles, posts and ads through the ScrapeCreators API

Scrape websites into a schema you define, returning clean structured records

Search TikTok for profiles, videos, hashtags and trending content

Search X and Twitter posts by date and keyword to track brand mentions

Look up Twitter and X profiles for bio, followers, tweets and engagement

Search the Wayback Machine for archived pages and recover lost customer lists