Top 20 NuGet crawler Packages

Invalid image

DotnetSpiderLite.NLog

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .8 | 5/31/2019 | v0.2.0
Invalid image

DotnetSpiderLite.HtmlAgilityPack

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .8 | 5/31/2019 | v0.2.0
Invalid image

YeuAI.WebApi

YeuAI - Text, Voice and Image Processing Library
Score: .8 | 3/9/2019 | v1.0.0
Invalid image

DotnetSpider

DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Score: .8 | 8/4/2020 | v5.1.2
Invalid image

JsHttpClient for .Net Core

HttpClient extension class, and the .Net Core version of the HttpHelper class. Simple and flexible crawler base class library. JsHttpClient类是 .Net Core 下的一个简单灵活的爬虫基础类库
Score: .8 | 6/21/2020 | v1.0.6
Invalid image

HtmlDexterityPack

This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
Score: .5 | 4/22/2017 | v1.5.1
Invalid image

Mechanize.NET-AngleSharp

AngleSharp IHtmlParser Extension for Mechanize.NET
Score: .5 | 12/8/2017 | v1.0.2
Invalid image

WebCrawler.Pipelines

这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Score: .5 | 12/10/2017 | v1.0.0
Invalid image

WebCrawler.Core

这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Score: .5 | 12/10/2017 | v1.0.0
Invalid image

Patu

Score: .5 | 1/13/2018 | v
Invalid image

DotnetSpider.Proxy

Score: .5 | 7/24/2018 | v
Invalid image

DotnetSpiderLite.Scheduler.StackExchange.Redis

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .5 | 5/31/2019 | v0.2.0
Invalid image

DotnetSpiderLite.Core

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .5 | 5/31/2019 | v0.2.0
Invalid image

DotnetSpiderLite.AngleSharp

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .5 | 5/31/2019 | v0.2.0
Invalid image

DotnetSpiderLite.ProxyPools

A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
Score: .5 | 5/31/2019 | v0.2.0
Invalid image

InfinityCrawler

A simple but powerful web crawler library
Score: .5 | 3/15/2019 | v0.5.2+gf6f16b3-github.2833243350
Invalid image

YeuAI.Common

YeuAI - Text, Voice and Image Processing Library
Score: .5 | 3/9/2019 | v1.0.1
Invalid image

DotnetSpider.Mongo

DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
Score: .5 | 8/4/2020 | v5.1.2
Invalid image

HtmlMonkey

Score: .5 | 2/19/2020 | v
Invalid image

CrawlerWave.Core

A fluent wrapper for Selenium and many usefull tools to web crawlers
Score: .5 | 8/13/2019 | v0.0.0.3