Any issues with the site? IF YOU ARE HAVING LOGIN ISSUES COME HERE!
- Posts: 34
- Joined: Sat Nov 03, 2007 3:17 pm
- Location: XRoads, KC
Could someone summon youthsonic? I'd like to ask that he switch up the robots.txt to Disallow everything? I believe we simply change it to:
- Urban Perversion
- Posts: 1033
- Joined: Tue Jul 05, 2005 4:58 pm
- Location: KCMO
I modified the existing one, and un-commented the Disalow: * line.
It might be of some use, but not all spiders honor this, obviously. Which is why I am also adjusting the "Robots" area of the admin panel to also not allow any archiving through the form software itself