django-robots

This is a basic Django application to manage robots.txt files following the robots exclusion protocol, complementing the Django Sitemap contrib app.

Contents:

• Robots exclusion application for Django
  • Installation
    • Sitemaps
  • Initialization
  • Rules
  • URLs
  • Support