List of libraries, tools and APIs for web scraping and data processing.
-
Updated
Jun 8, 2024 - Makefile
List of libraries, tools and APIs for web scraping and data processing.
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
Web crawling & scraping framework for Node.js on top of headless Chrome browser
By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use
🕷️ Easily scrap the web for torrent and media files.
Selenium automatic test that visits every article on WordPress site.
A spam spider which is targeting 'Untitled' spam pages from the Google search results.
Tourist is a simple tool that allows you to collect console messages, errors, unsuccessful requests of all your pages after the DOM loading with authentication support.
Firetastic - a tool for automating interaction with FireTV apps
Firetastic - a tool for automating interaction with FireTV apps
📱 A tool to download android apps from Google Play Store and Xiaomi App Store (the famous Chinese Store).
A Website Spider/Crawler, Python 3.x
A web Crowler design , basic setup c++
This python script crawls course title, ratings, description and instructors from coursera.org
Add a description, image, and links to the crawling-tool topic page so that developers can more easily learn about it.
To associate your repository with the crawling-tool topic, visit your repo's landing page and select "manage topics."