Top 20 NuGet crawler Packages

Invalid image

BCJobs.HtmlAgilityPack

This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
Score: | 2/22/2017 | v1.4.11
Invalid image

StaticVoidLabs.MediaCrawler

Scan local storage for media files.
Score: | 8/30/2018 | v0.0.3
Invalid image

Web Page Crawler

网页数据爬取
Score: | 11/21/2018 | v0.0.0.1
Invalid image

DotnetSpiderLite.Abstractions

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: | 5/31/2019 | v0.2.0
Invalid image

TinyScraper

Score: | 1/27/2019 | v
Invalid image

ScarpyRT.Client

An SDK client to make calls to a scrapyrt http endpoint.
Score: | 7/27/2019 | v1.0.0
Invalid image

Crawler

Score: | 12/19/2019 | v