# Robots.txt file from https://www.searchengineworld.com
#  
# Built from text file https://info.webcrawler.com/mak/projects/robots/active/all.txt
# 
# This restricts access to only known and registered robots. 
#