roach-php/core
Stars: 1252
Forks: 57
Pull Requests: 73
Issues: 52
Watchers: 18
Last Updated: 2023-09-16 05:16:27
🐴 Roach
A complete web scraping toolkit for PHP
About
Roach is a complete web scraping toolkit for PHP. It is heavily inspired (read: a shameless clone) of the popular Scrapy package for Python.
Installation
Install the package via composer
composer require roach-php/coreDocumentation
The full documentation can be found here.
Contributing
Please read our Contribution Guide before opening issues or pull requests.
Credits
License
MIT
OPEN ISSUES
See all- Requeing requests by @pavlokomarov
- Scraping and crawling with Laravel Dusk by @clarkewing
- Duplicate requests being dispatched even with RequestDeduplicationMiddleware in place by @awebartisan
- [Laravel Sail] ExcecuteJavascriptMiddleware not firing by @andyscraven
- Unable to mark scans as failed by @illusive-ch
- Exceptions by @wengooooo
- Add Retry Middleware by @wengooooo
- what's roadmap in this project ? by @Azmandios
- Xpath not working by @Benoit1980
- Using Proxies, possible? by @Benoit1980
- interactive shell vs real code by @xciser77
- Event listeners get registered multiple times by @dodomedia
- spatie/robots-txt overwrites default Laravel robots.txt by @Xoshbin
- Crawling entire site? by @seongbae
- Symfony 5.4.1 issue by @mkrizanec-undabot
- No publishable resources for tag [] for publishing config file by @chiva-song
- Possibly to scrape behind secured sessions by @jaimyborgman
- Self signed certificate by @ntaylor-86