| Default - All Robots are: |
|
|
| | | |
| Crawl-Delay: |
|
| | | |
| Sitemap: (leave blank if you don't have) |
|
| |
|
|
| Search Robots: |
Google |
|
| |
Google Image |
|
| |
Google Mobile |
|
| |
MSN Search |
|
| |
Yahoo |
|
| |
Yahoo MM |
|
| |
Yahoo Blogs |
|
| |
Ask/Teoma |
|
| |
GigaBlast |
|
| |
DMOZ Checker |
|
| |
Nutch |
|
| |
Alexa/Wayback |
|
| |
Baidu |
|
| |
Naver |
|
| |
MSN PicSearch |
|
| |
|
| Restricted Directories: |
The path is relative to root and must contain a trailing slash "/" |
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|
| |
|