Info
| Version: | 2014.2.19 |
| Author(s): | Çağdaş Tekin |
| Last Update: | Wednesday, February 19, 2014 |
| .NET Fiddle: | Create the first Fiddle |
| Project Url: | https://bitbucket.org/cagdas/robotstxt |
| NuGet Url: | https://www.nuget.org/packages/RobotsTxt |
Install
Install-Package RobotsTxt
dotnet add package RobotsTxt
paket add RobotsTxt
RobotsTxt Download (Unzip the "nupkg" after downloading)
Dependencies
Tags
Supports ;
- Allow directives.
- Crawl-delay directives.
- Sitemap declarations.
- * and $ wildcards.
See https://bitbucket.org/cagdas/robotstxt for usage examples.