Top 20 NuGet crawler Packages

Invalid image
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
Invalid image
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
Invalid image
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET
Invalid image
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Core platform. This NuGet package supports can be used with Un...
Invalid image
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET
Invalid image
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to t...
Invalid image
Web Exploration Model: crawlers, crawler reports, web analytic console, web loader, web crawler experiment setup...
Invalid image
A csharp crawler lib.
Invalid image
A library for reading/writing WARC files and scraping websites.
Invalid image
Spidey is a library designed to help with crawling and parsing web content.
Invalid image
A .NET Standard web crawling library similar to WebMagic and Scrapy. It is a lightweight ,efficient and fast high-level web crawling & scraping framework for .NET
Invalid image
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
Invalid image
A web crawler written with .net standard
Invalid image
Offical package. DotnetSpider is a high performance, light weight cralwer developed by C#.
Invalid image
It helps you to use HAP in easier and meaningful way via Reflection. It works somehow like Entity-Framework. Go to wiki in github page for tutorial : https://github.com/parsalotfy/HtmlAgilityPack_Helper/wiki
Invalid image
A web scraping framework for .Net
Invalid image
A .Net Web Crawler
Invalid image
AngleSharp IHtmlParser Extension for Mechanize.NET
Invalid image
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Invalid image
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。