Crawlers

6848
Goutte v3.2.3 — Goutte, a simple PHP Web Scraper
Similar Crawlers
3013
snappy v1.0.4 — PHP library allowing thumbnail, snapshot or PDF generation from a url or a html page. Wrapper for wkhtmltopdf/wkhtmltoimage
Similar Applications Crawlers
2119
Sn1per — Automated pentest framework for offensive security experts
Similar Security Crawlers
1724
dom-crawler v4.2.0 — The DomCrawler component eases DOM navigation for HTML and XML documents.
Similar HTML/DOM Symfony Crawlers xml
1066
php-spider — A configurable and extensible PHP web spider
Similar Crawlers
1035
browser-kit v4.2.0-BETA2 — The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
Similar HTML/DOM Symfony Crawlers
905
crawler 4.2.0 — An easy to use, powerful crawler implemented in PHP. Can execute Javascript.
Similar Nice! Concurrency Crawlers
874
instagram-php-scraper v0.8.26 — Instagram PHP Scraper. Get account information, photos, videos, stories and comments.
Similar External APIs Instagram Crawlers
772
Crawler-Detect v1.2.74 — CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
Similar Browser detection Crawlers
371
http-status-check 3.1.1 — CLI tool to crawl a website and check HTTP status codes
Similar Applications Concurrency Crawlers

Events

    1 week ago
    browser-kit (Reached 1000 ⭐)
    The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
    2 weeks ago
    InstagramDownload (Reached 50 ⭐)
    Instagram image and video downloader with URL validation and cURL integration
    3 months ago
    Sn1per (Reached 2000 ⭐)
    Automated pentest framework for offensive security experts
    spiderling (Reached 50 ⭐)
    Browse html pages with php, selenium and phantomjs
    4 months ago
    weblabyrinth (Reached 10 ⭐)
    A system that creates a bogus web structure to entrap and delay web scanners
    image-hashtag-feed (Reached 25 ⭐)
    WordPress plugin to get Instagram hashtag feeds working again by bypassing the API.
    5 months ago
    PHP-HTTP-Tarpit (Reached 10 ⭐)
    Confuse and waste bot scanners time.
    instagram-parser (Reached 25 ⭐)
    :camera: Crawl the Instagram website tags and users like if it was a simple API client.
    6 months ago
    php-spider (Reached 1000 ⭐)
    A configurable and extensible PHP web spider
    7 months ago
    browser-kit (Reached 500 ⭐)
    The BrowserKit component simulates the behavior of a web browser, allowing you to make requests, click on links and submit forms programmatically.
    dom-crawler (Reached 1000 ⭐)
    The DomCrawler component eases DOM navigation for HTML and XML documents.

Once a week...

... I send out a list of most interesting PHP libraries and apps.
Want to get it?