Ночная странница, Ыть!!! вот так всегда, на самом интересном месте!
Я вот тут по сусекам интернета подмел и на свое разумение нарисовал. Вот только не у кого проконсультироваться на предмет правильности и нужности.
User-agent: *
Allow: /forum/$
Allow: /forum/index.
Allow: /forum/$
Allow: /forum/index.php$
Allow: /forum/forumdisplay.php?f=
Allow: /forum/showthread.php?t=
Disallow: /forum/
Disallow: /misc/
User-agent: Googlebot
Sitemap:
мой сайт/sitemap_index.xml.gz
Allow: /forum/$
Allow: /forum/index.
Allow: /forum/$
Allow: /forum/index.php$
Allow: /forum/forumdisplay.php?f=
Allow: /forum/showthread.php?t=
Disallow: /forum/attachment.php
Disallow: /forum/calendar.php
Disallow: /forum/cron.php
Disallow: /forum/editpost.php
Disallow: /forum/faq.php
Disallow: /forum/login.php
Disallow: /forum/member.php
Disallow: /forum/memberlist.php
Disallow: /forum/misc.php
Disallow: /forum/newreply.php
Disallow: /forum/newthread.php
Disallow: /forum/online.php
Disallow: /forum/poll.php
Disallow: /forum/postings.php
Disallow: /forum/private.php
Disallow: /forum/printthread.php
Disallow: /forum/profile.php
Disallow: /forum/register.php
Disallow: /forum/report.php
Disallow: /forum/reputation.php
Disallow: /forum/sendmessage.php
Disallow: /forum/search.php
Disallow: /forum/showgroups.php
Disallow: /forum/showpost.php
Disallow: /forum/subscription.php
Disallow: /forum/usercp.php
Disallow: /forum/
Disallow: /album.php
Disallow: /archive/
Disallow: /calendar.php
Disallow: /clientscript/
Disallow: /converse.php
Disallow: /cpstyles/
Disallow: /css.php
Disallow: /customavatars/
Disallow: /customgroupicons/
Disallow: /images/customprofilepics/
Disallow: /external.php
Disallow: /faq.php
Disallow: /group.php
Disallow: /includes/
Disallow: /install/
Disallow: /js/
Disallow: /list.php
Disallow: /list/
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /members/
Disallow: /misc/
Disallow: /misc.php
Disallow: /modcp/
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /packages/
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /signaturepics/
Disallow: /subscription.php
Disallow: /tags.php
Disallow: /usercp.php
Disallow: /vb/
Disallow: /*do=
Disallow: /*blogtype=
Disallow: /*sort=
Disallow: /*order=
Disallow: /*mode=
Disallow: /*goto=
Disallow: /*m=
Disallow: /*y=
Disallow: /*prefixid=
Disallow: /*p=
Disallow: /*a=rate
Disallow: /*viewfull=
User-agent: Yandex
Host: мой сайт.com
Allow: /forum/$
Allow: /forum/index.
Allow: /forum/$
Allow: /forum/index.php$
Allow: /forum/forumdisplay.php?f=
Allow: /forum/showthread.php?t=
Disallow: /forum/
Disallow: /album.php
Disallow: /archive/
Disallow: /calendar.php
Disallow: /clientscript/
Disallow: /converse.php
Disallow: /cpstyles/
Disallow: /css.php
Disallow: /customavatars/
Disallow: /customgroupicons/
Disallow: /images/customprofilepics/
Disallow: /external.php
Disallow: /faq.php
Disallow: /group.php
Disallow: /includes/
Disallow: /install/
Disallow: /js/
Disallow: /list.php
Disallow: /list/
Disallow: /login.php
Disallow: /memberlist.php
Disallow: /members/
Disallow: /misc.php
Disallow: /modcp/
Disallow: /newreply.php
Disallow: /newthread.php
Disallow: /online.php
Disallow: /packages/
Disallow: /printthread.php
Disallow: /private.php
Disallow: /profile.php
Disallow: /register.php
Disallow: /search.php
Disallow: /sendmessage.php
Disallow: /showgroups.php
Disallow: /showpost.php
Disallow: /signaturepics/
Disallow: /subscription.php
Disallow: /tags.php
Disallow: /usercp.php
Disallow: /vb/
Disallow: /misc/
Clean-param: s & do & blogtype & sort & order & mode & goto & m & y & markreadhash & prefixid & p & viewfull & p
Crawl-delay: 5