Info
| Version: | 2.0.70 |
| Author(s): | Steven Jones |
| Last Update: | Monday, August 9, 2021 |
| .NET Fiddle: | Create the first Fiddle |
| Project Url: | https://github.com/sjdirect/abot |
| NuGet Url: | https://www.nuget.org/packages/Abot |
Install
Install-Package Abot
dotnet add package Abot
paket add Abot
Abot Download (Unzip the "nupkg" after downloading)
Dependencies
- AngleSharp(>= 0.12.1)
- Microsoft.CSharp(>= 4.7.0)
- NRobotsCore(>= 1.1.2)
- Serilog(>= 2.8.0)
- Serilog.Enrichers.Thread(>= 3.1.0)
- Serilog.Sinks.Console(>= 3.1.1)
Tags
It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data.
You can also plugin your own implementations of core interfaces to take complete control over the crawl process.