CrawlCtrl

CrawlCtrl
by: CrawlCtrl
- .NET Standard 2.0 .NET Framework 4.6.2
- 220 total downloads
- last updated 1/21/2024
- Latest version: 1.0.0-alpha.2 (prerelease)
- robots.txt robots crawler crawling sitemap
Deserialize robots.txt files
CrawlCtrl.Reader
by: CrawlCtrl
- .NET Standard 2.0 .NET Framework 4.6.2
- 98 total downloads
- last updated 1/21/2024
- Latest version: 1.0.0-alpha.2 (prerelease)
- robots.txt robots crawler crawling sitemap
Convenient wrapper for the CrawlCtrl deserializer, that makes it easy to load and deserialize robots.txt files
CrawlCtrl.Reader.DependencyInjection.DotNet
by: CrawlCtrl
- .NET Standard 2.0 .NET Framework 4.6.2
- 98 total downloads
- last updated 1/21/2024
- Latest version: 1.0.0-alpha.2 (prerelease)
- robots.txt robots crawler crawling sitemap di dependency injection reader
.NET dependency injection support for CrawlCtrl.Reader
CrawlCtrl.DependencyInjection.DotNet
by: CrawlCtrl
- .NET Standard 2.0 .NET Framework 4.6.2
- 96 total downloads
- last updated 1/21/2024
- Latest version: 1.0.0-alpha.2 (prerelease)
- robots.txt robots crawler crawling sitemap di dependency injection
.NET dependency injection support for CrawlCtrl