PhpDev.App
crwlrsoft/crawler

crwlrsoft/crawler

Stars: 264

Forks: 7

Pull Requests: 106

Issues: 12

Watchers: 5

Last Updated: 2023-08-21 09:59:13

Library for Rapid (Web) Crawler and Scraper Development

License: MIT License

Languages: PHP, HTML, Hack

https://www.crwlr.software/packages/crawler

crwlr.software logo

Library for Rapid (Web) Crawler and Scraper Development

This library provides kind of a framework and a lot of ready to use, so-called steps, that you can use as building blocks, to build your own crawlers and scrapers with.

To give you an overview, here's a list of things that it helps you with:

Documentation

You can find the documentation at crwlr.software.

Contributing

If you consider contributing something to this package, read the contribution guide (CONTRIBUTING.md).