ifhub/ifhub.club
1
0
Fork 0
mirror of https://github.com/Oreolek/ifhub.club.git synced 2024-06-26 03:30:48 +03:00
Code Issues Releases Wiki Activity

Fixes #216: robots.txt

Browse source
This commit is contained in:
Denis Shakhov 2013-05-22 14:43:00 +07:00
parent 4e3aa24c48
commit 57146ce444
1 changed files with 20 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

20
robots.txt Normal file
View file

@ -0,0 +1,20 @@
User-agent: *
Disallow: /login/
Disallow: /registration/
Disallow: /rss
Disallow: /search/
Disallow: /stream
Disallow: /feed
Disallow: /ajax
Disallow: /admin
Disallow: /subscribe/
Disallow: /tag/$
Disallow: /topic/$
Disallow: /page/$
Disallow: /error/$
Disallow: /settings/$
Disallow: /photoset/$
Disallow: /topic/$
Disallow: /link/$
Disallow: /question/$
Disallow: /message/$