ifhub.club/robots.txt

User-agent: *
Disallow: /login/
Disallow: /registration/
Disallow: /rss
Disallow: /search/
Disallow: /stream
Disallow: /feed
Disallow: /ajax
Disallow: /admin
Disallow: /subscribe/
Disallow: /tag/$
Disallow: /page/$
Disallow: /error/$
Disallow: /settings/$
Disallow: /photoset/$
Disallow: /topic/$
Disallow: /link/$
Disallow: /question/$
Fixes #216: robots.txt 2013-05-22 10:43:00 +03:00			`User-agent: *`
			`Disallow: /login/`
			`Disallow: /registration/`
			`Disallow: /rss`
			`Disallow: /search/`
			`Disallow: /stream`
			`Disallow: /feed`
			`Disallow: /ajax`
			`Disallow: /admin`
			`Disallow: /subscribe/`
			`Disallow: /tag/$`
			`Disallow: /page/$`
			`Disallow: /error/$`
			`Disallow: /settings/$`
			`Disallow: /photoset/$`
			`Disallow: /topic/$`
			`Disallow: /link/$`
Fix robots.txt 2013-05-24 18:55:50 +03:00			`Disallow: /question/$`