Top 20 NuGet spider Packages

This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to t...
Aspose.HTML is a cross-platform class library that enables you to perform a wide range of HTML manipulation tasks directly within your .NET applications. Aspose.HTML supports parsing of HTML5, CSS3, SVG and HTML Canvas to construct a Document Object Model (DOM) based on the official W3C specificati...
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
LightningChart® Ultimate is the fastest 2D and 3D WPF data visualization toolkit for science and finance. 3 WPF APIs included: - Non-Bindable for best performance - Semi-Bindable for great performance and property binding features - Fully-Bindable for properties and data binding in MVVM Lightnin...
LightningChart® Ultimate is the fastest 2D and 3D WinForms data visualization toolkit for science and finance. LightningChart Ultimate is entirely GPU accelerated (DirectX9, DirectX11 and WARP) and performance optimized data visualization control for presenting masses of data in 2D XY graph, 3D XY...
Deprecated as there's new maintainer for original HAP project. Please check the new repo at https://github.com/zzzprojects/html-agility-pack. This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Core platform. This NuGet package supports can be used with Un...
Web Crawling and Scraping Framework
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implem...
Plugin which generates a robots.txt file, based on DenySpider attributes on classes or methods within controllers. If UserSessionMiddleware.Plugin is also installed, will check to see if a bot is trying to access a page it has been denied, and return a 403 forbidden result.
Web scraper / crawler / spider. Supports robots protocol and user agent.
This is a port of HtmlAgilityPack library created by Simon Mourrier and Jeff Klawiter for .NET Core platform. This NuGet package supports can be used with Universal Windows Platform, ASP.NET 5 (using .NET Core) and full .NET Framework 4.6. Original description: This is an agile HTML parser that bu...
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
LightningChart® Ultimate is the fastest 2D and 3D WPF data visualization toolkit for science and finance. 3 WPF APIs included: - Non-Bindable for best performance - Semi-Bindable for great performance and property binding features - Fully-Bindable for properties and data binding in MVVM Lightnin...
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to stru...
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks.
LightningChart® Ultimate is the fastest 2D and 3D WinForms data visualization toolkit for science and finance. LightningChart Ultimate is entirely GPU accelerated (DirectX9, DirectX11 and WARP) and performance optimized data visualization control for presenting masses of data in 2D XY graph, 3D XY...
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows you to parse "out of the web" HTML files. The parser is very tolerant with "real world" m...
AngleSharp IHtmlParser Extension for Mechanize.NET