sjdirect / nrobots
The Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable. This project provides an easy-to-use class, implemented in C#, to work with robots.txt files.
☆15Updated 6 years ago
Alternatives and similar repositories for nrobots:
Users that are interested in nrobots are comparing it to the libraries listed below
- ☆11Updated 9 years ago
- A cross-platform client for JabbR☆58Updated 10 years ago
- Visual Studio extension for auto updating extensions☆23Updated 8 years ago
- C# BeatsMusic API☆19Updated 9 years ago
- NExtra is a C# library with extended functionality for the .NET Framework.☆27Updated 9 years ago
- Short'n'sweet SQL Server/PostgreSQL/MySQL schema migration library☆43Updated 3 months ago
- A distributed network storage system with an hydrid data model☆13Updated 10 years ago
- S#arp Architecture: ASP.NET MVC Best Practices with NHibernate☆29Updated 2 years ago
- ☆18Updated 5 years ago
- Twitter like Social network written in ASP.NET MVC5☆26Updated 8 years ago
- CSharpTest.Net.Commands (moved from https://code.google.com/p/csharptest-net/)☆11Updated 10 years ago
- Free C# immutable collections implementation☆39Updated 8 years ago
- A set of utilities for .NET Framework☆22Updated 8 years ago
- ☆12Updated 4 years ago
- DotNetify + Nancy example for real-time web UI on Windows service / cross-platform Mono.☆10Updated 7 years ago
- ☆13Updated 8 months ago
- dashCommerce is a flexible and robust ASP.NET Open Source e-commerce application that you can use to set up your online store. dashCommer…☆36Updated 9 years ago
- The starter kit with entire modular approach to help remove boilerplate code in developing☆15Updated 6 years ago
- Makes certificate files by answering a few simple questions.☆10Updated 4 years ago
- An asynchronous web scraper / web crawler using async / await and Reactive Extensions☆59Updated 8 years ago
- ☆24Updated 2 months ago
- C#.NET based DevFast NuGet package☆11Updated last year
- CSharpTest.Net.Tools (moved from https://code.google.com/p/csharptest-net/)☆15Updated 10 years ago
- CODE Framework - Business Application Development Framework for Professional Developers☆25Updated 4 years ago
- aspnet/templates output [being] rewritten to BS4 final☆13Updated 6 years ago
- Utility class to easily generate random data.☆13Updated 7 months ago
- Just a simple web crawler which return crawled links as IObservable using reactive extension and async await.☆60Updated 5 years ago
- C# Code Compiler | Code Analysis and Code Compiler for Eval-Expression.NET and Eval-SQL.NET☆12Updated 9 months ago
- Set of modules that complements Signum Framework: Authorization, Charting, ControlPanels, Mailing, Processes, Scheduled Tasks, Disconnect…☆30Updated 3 years ago