Crawlers

900 (<1)
browser-kit v4.1.5 — The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
Similar HTML/DOM Symfony Crawlers
1561 (<1)
dom-crawler v4.1.5 — The DomCrawler component eases DOM navigation for HTML and XML documents.
Similar HTML/DOM Symfony Crawlers xml
1047 (<1)
php-spider — A configurable and extensible PHP web spider
Similar Crawlers
2954 (<1)
snappy — PHP library allowing thumbnail, snapshot or PDF generation from a url or a html page. Wrapper for wkhtmltopdf/wkhtmltoimage
Similar Applications Crawlers
830 (<1)
crawler 4.1.7 — An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
Similar Nice! Concurrency Crawlers
720 (<1)
Crawler-Detect v1.2.70 — CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Similar Browser detection Crawlers
805 (<1)
instagram-php-scraper v0.8.24 — Instagram PHP Scraper. Get account information, photos, videos, stories and comments.
Similar External APIs Instagram Crawlers
12 (<1)
weblabyrinth — A system that creates a bogus web structure to entrap and delay web scanners
Similar Crawlers
179 (<1)
ultimate-web-scraper — A PHP library/toolkit designed to handle all of your web scraping needs under a MIT or LGPL license. Also has web server and WebSocket server classes for building custom servers.
Similar WebSockets Crawlers Browser Emulator
74 (<1)
getIPIntel — IP Intelligence is a free Proxy VPN TOR and Bad IP detection tool to prevent Fraud, stolen content, and malicious users. Block proxies, VPN connections, web host IPs, TOR IPs, and compromised systems with a simple API. GeoIP lookup available.
Similar Crawlers

Events

    1 month ago
    Sn1per (Reached 2000 ⭐)
    Automated Pentest Recon Scanner
    2 months ago
    spiderling (Reached 50 ⭐)
    Browse html pages with php, selenium and phantomjs
    weblabyrinth (Reached 10 ⭐)
    A system that creates a bogus web structure to entrap and delay web scanners
    3 months ago
    image-hashtag-feed (Reached 25 ⭐)
    WordPress plugin to get Instagram hashtag feeds working again by bypassing the API.
    PHP-HTTP-Tarpit (Reached 10 ⭐)
    Confuse and waste bot scanners time.
    instagram-parser (Reached 25 ⭐)
    :camera: Crawl the Instagram website tags and users like if it was a simple API client.
    4 months ago
    php-spider (Reached 1000 ⭐)
    A configurable and extensible PHP web spider
    5 months ago
    browser-kit (Reached 500 ⭐)
    The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
    dom-crawler (Reached 1000 ⭐)
    The DomCrawler component eases DOM navigation for HTML and XML documents.

Once a week...

... I send out a list of most interesting PHP libraries and apps.
Want to get it?