3 projects
Playwright is a cross-browser automation and end-to-end testing framework that drives Chromium, Firefox, and WebKit through a single API. It pairs a full-featured test runner (auto-waiting, resilient locators, tracing, parallel isolated contexts) with a browser-automation library, plus CLI and MCP integrations for AI agents.
Scrapling is a Python web scraping framework whose parser can "adaptively" relocate elements when a site's HTML changes, paired with stealth fetchers that bypass anti-bot systems like Cloudflare Turnstile and a Scrapy-style spider engine for concurrent, resumable, proxy-rotating crawls.
Scrapy is a mature Python framework for building web crawlers and scrapers, offering an asynchronous engine, built-in support for following links, extracting structured data via selectors, and exporting results through configurable pipelines.