Best Python automation repositories

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Matched: python, web, scraping

Scrapy, a fast high-level web crawling & scraping framework for Python.

Matched: python, web, scraping

Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.

Matched: python, web, scraping

Web mining module for Python, with tools for scraping, natural language processing, machine learning, network analysis and visualization.

Matched: python, web, scraping

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

Matched: python, web, scraping

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

Matched: python, web, scraping

Do you want to LEARN NEW STUFF for FREE? Don't worry, with the power of web-scraping and automation, this script will find the necessary Udemy coupons & enroll you for PAID UDEMY COURSES, ABSOLUTELY FREE!

Matched: python, web, scraping

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Studio python SDK for intelligent web data gathering.

Matched: python, web, scraping

Web Scraping Framework

Matched: python, web, scraping

Async Python 3.6+ web scraping micro-framework based on asyncio

Matched: python, web, scraping