A simple but powerful web crawler library.
Info
| Version: | 0.5.2+gf6f16b3-github.2833243350 |
| Author(s): | James Turner |
| Last Update: | Wednesday, August 10, 2022 |
| .NET Fiddle: | Create the first Fiddle |
| Project Url: | https://github.com/TurnerSoftware/InfinityCrawler |
| NuGet Url: | https://www.nuget.org/packages/InfinityCrawler |
Install
Install-Package InfinityCrawler
dotnet add package InfinityCrawler
paket add InfinityCrawler
InfinityCrawler Download (Unzip the "nupkg" after downloading)
Dependencies
- HtmlAgilityPack(>= 1.8.11)
- Microsoft.Extensions.Logging.Abstractions(>= 2.2.0)
- TurnerSoftware.RobotsExclusionTools(>= 0.2.0)
- TurnerSoftware.SitemapTools(>= 0.2.0)
Tags
