🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
-
Updated
Nov 15, 2024 - TypeScript
🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.
Scrapoxy is a super proxy aggregator, allowing you to manage all proxies in one place 🎯, rather than spreading it across multiple scrapers 🕸️. It also smartly handles traffic routing 🔀 to minimize bans and increase success rates 🚀.
Dive into web scraping and build a Next.js 13 eCommerce price tracker within a single video that teaches you data scraping, cron jobs, sending emails, deployment, and more.
➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are completely removed. Crawl and convert any website into LLM-ready markdown.
Animos - Clean and minimal Anime-streaming desktop application without any ads.
🔍 Data pipeline for crawling PDFs from the Web and transforming their contents into structured data using AWS textract. Built with AWS CDK + TypeScript
📚 This is an adapted version of Jina AI's Reader for local deployment using Docker. Convert any URL to an LLM-friendly input with a simple prefix http://127.0.0.1:3000/https://website-to-scrape.com/
📑 A way to automatically sync data with your kindle, such as RSS feeds, manga, and too much more.
API for Arknights
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
단 몇줄의 코드로 다양한 쇼핑 플랫폼에서 결제 내역을 긁어오자!
Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless
Scrapeium is a powerful query language for scraping the web
SDK to access ZenRows API directly from Node.js. We handle proxies rotation, headless browsers and CAPTCHAs for you.
A fun 𝗱𝗶𝘀𝗰𝗼𝗿𝗱 𝗯𝗼𝘁 🤖 that displays a 𝒓𝒂𝒏𝒅𝒐𝒎 𝒊𝒎𝒂𝒈𝒆 from your Google Photos album every 12 𝒉𝒐𝒖𝒓𝒔 🖼️ 📸 Surprise your server with a random image twice a day 🤗
Web Scraping with Deno: DOM + GraphQL
A Node.js scraper library for UVic Course and Schedule Information
Request distributor for web scraping
Dive into web scraping and build a Next.js 14 eCommerce price tracker within one project that teaches you data scraping, cron jobs, sending emails, deployment, and more.
Add a description, image, and links to the webscraping topic page so that developers can more easily learn about it.
To associate your repository with the webscraping topic, visit your repo's landing page and select "manage topics."