Info
| Version: | 2.3.5544.21265 |
| Author(s): | Thomas Maierhofer |
| Last Update: | Saturday, March 7, 2015 |
| .NET Fiddle: | Create the first Fiddle |
| Project Url: | http://www.crawler-lib.net/crawler-lib-engine |
| NuGet Url: | https://www.nuget.org/packages/CrawlerLib.Engine |
Install
Install-Package CrawlerLib.Engine
dotnet add package CrawlerLib.Engine
paket add CrawlerLib.Engine
CrawlerLib.Engine Download (Unzip the "nupkg" after downloading)
Dependencies
- HtmlAgilityPack(1.4.6)
- Newtonsoft.Json(6.0.3)
Tags
It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to structure and parallelize even complex kind of work. Please visit the project page for the complete view of the Crawler-Lib Engine.
A license for the Anonymous Edition is included in the package.
A license for the more powerful free Community Edition can be generated on the project page. A unrestricted license is available too.