помогите, робот txt Есть решение

день добрый. яндекс веб мастер выдает ошибки:

7 User-agent: * Найдено несколько правил вида 'User-agent: *'

135 User-agent: *


посмотрите что не так:

User-agent: *

# wa shop *

Disallow: /my/

Disallow: /checkout/

# wa shop


User-agent: *

# wa mailer mailer/*

Disallow: /mailer/unsubscribe/

# wa mailer


User-agent: Yandex

Disallow: /back/

Disallow: /cat_articless/

Disallow: /cfg/

Disallow: /cgi-bin/

Disallow: /classes/

Disallow: /core_functions/

Disallow: /data/

Disallow: /dblist/

Disallow: /images/

Disallow: /includes/

Disallow: /kernel/

Disallow: /languages/

Disallow: /login/

Disallow: /shop/$

Disallow: /system/

Disallow: /published/

Disallow: /temp/

Disallow: /help/

Disallow: /installer/

Disallow: /en/

Disallow: /i2/

Disallow: /modules/

Disallow: /products_files/

Disallow: /products_pictures/

Disallow: /rss/

Disallow: /sertificat/

Disallow: /shop1/

Disallow: /smarty/

Disallow: /sql/

Disallow: /SSWA/

Disallow: /templates/

Disallow: /templates_c/

Disallow: /test/

Disallow: /*?from=

Disallow: /*sort=*

Disallow: /*view=*

Disallow: */search

Disallow: */category_search

Disallow: */auth

Disallow: /cart

Disallow: */checkout

Disallow: */feedback

Disallow: */installer

Disallow: */login

Disallow: */logout

Disallow: */myaccount

Disallow: */order_status

Disallow: */published/SC/html/scripts/

Disallow: */published/wbsadmin/

Disallow: */register

Disallow: */remind_password

Disallow: /*phpsessid*

Disallow: /*PHPSESSID*

Disallow: */login.php

Disallow: *linkexchange*

Disallow: */admin.php

Disallow: */auth.php

Disallow: */forgot.php

Disallow: */order_history*

Disallow: */myaccount*

Disallow: */contact_info*

Disallow: /ajaxhandler.php

Disallow: *published*

Disallow: *vkontakte*

Disallow: *facebook*

Disallow: /domxml-php4-to-php5.php

Disallow: /install.js

Disallow: /install.css

Disallow: /install.log

Disallow: /license.txt

Disallow: /readme.txt

Disallow: /settings.xml

Disallow: /setupguide.htm

Disallow: /showdblist.php

Disallow: /showmucontent.php

Disallow: /adress

Disallow: /admin.php

Disallow: /advanced_search_in_category.php

Disallow: /affiliate_program.php

Disallow: /articles

Disallow: /authorization.php

Disallow: /category.php

Disallow: /category_search_results.php

Disallow: /category_tree.php

Disallow: /change

Disallow: /checklogin.php

Disallow: /comparison

Disallow: /contact_info

Disallow: /dumper

Disallow: /fail

Disallow: /fastinst

Disallow: /get_file

Disallow: /head

Disallow: /home.php

Disallow: /imgval

Disallow: /invoice

Disallow: /news.php

Disallow: /linkpoint

Disallow: /m.php

Disallow: /option

Disallow: /order

Disallow: /printable

Disallow: /register

Disallow: /search

Disallow: /shopping

Disallow: /ssilki

Disallow: /style

Disallow: /test.php

Disallow: /user_acc

Disallow: /transaction

Disallow: /wishlist

Disallow: */reviews/*

Disallow: */compare*

Disallow: */offset*

Disallow: */all/*

Disallow: /update.xml

Disallow: *&vote*

Disallow: *?msg=*

Allow: /product/kitajskie-kofejnye-boby/reviews/

Host: www.magazintut.ru

Sitemap: http://www.magazintut.ru/sitemap.php


User-agent: *

Disallow: /back/

Disallow: /cat_articless/

Disallow: /cfg/

Disallow: /cgi-bin/

Disallow: /classes/

Disallow: /core_functions/

Disallow: /data/

Disallow: /dblist/

Disallow: /images/

Disallow: /includes/

Disallow: /kernel/

Disallow: /languages/

Disallow: /login/

Disallow: /shop/$

Disallow: /system/

Disallow: /published/

Disallow: /temp/

Disallow: /help/

Disallow: /installer/

Disallow: /en/

Disallow: /i2/

Disallow: /modules/

Disallow: /products_files/

Disallow: /products_pictures/

Disallow: /rss/

Disallow: /sertificat/

Disallow: /shop1/

Disallow: /smarty/

Disallow: /sql/

Disallow: /SSWA/

Disallow: /templates/

Disallow: /templates_c/

Disallow: /test/

Disallow: /*?from=

Disallow: /*sort=*

Disallow: /*view=*

Disallow: */search

Disallow: */category_search

Disallow: */auth

Disallow: /cart

Disallow: */checkout

Disallow: */feedback

Disallow: */installer

Disallow: */login

Disallow: */logout

Disallow: */myaccount

Disallow: */order_status

Disallow: */published/SC/html/scripts/

Disallow: */published/wbsadmin/

Disallow: */register

Disallow: */remind_password

Disallow: /*phpsessid*

Disallow: /*PHPSESSID*

Disallow: */login.php

Disallow: *linkexchange*

Disallow: */admin.php

Disallow: */auth.php

Disallow: */forgot.php

Disallow: */order_history*

Disallow: */myaccount*

Disallow: */contact_info*

Disallow: /ajaxhandler.php

Disallow: *published*

Disallow: *vkontakte*

Disallow: *facebook*

Disallow: /domxml-php4-to-php5.php

Disallow: /install.js

Disallow: /install.css

Disallow: /install.log

Disallow: /license.txt

Disallow: /readme.txt

Disallow: /settings.xml

Disallow: /setupguide.htm

Disallow: /showdblist.php

Disallow: /showmucontent.php

Disallow: /adress

Disallow: /admin.php

Disallow: /advanced_search_in_category.php

Disallow: /affiliate_program.php

Disallow: /articles

Disallow: /authorization.php

Disallow: /category.php

Disallow: /category_search_results.php

Disallow: /category_tree.php

Disallow: /change

Disallow: /checklogin.php

Disallow: /comparison

Disallow: /contact_info

Disallow: /dumper

Disallow: /fail

Disallow: /fastinst

Disallow: /get_file

Disallow: /head

Disallow: /home.php

Disallow: /imgval

Disallow: /invoice

Disallow: /news.php

Disallow: /linkpoint

Disallow: /m.php

Disallow: /option

Disallow: /order

Disallow: /printable

Disallow: /register

Disallow: /search

Disallow: /shopping

Disallow: /ssilki

Disallow: /style

Disallow: /test.php

Disallow: /user_acc

Disallow: /transaction

Disallow: /wishlist

Disallow: */reviews/*

Disallow: */compare*

Disallow: */offset*

Disallow: */all/*

Disallow: /update.xml

Disallow: *&vote*

Disallow: *?msg=*

Disallow: /index.php?*

Disallow: *?*

Allow: /product/kitajskie-kofejnye-boby/reviews/

Sitemap: http://www.magazintut.ru/sitemap.php

7 ответов

  • 1
    Елена 28 декабря 2017 10:48 # Решение

    помогите настроить

  • 1
    Елена 28 декабря 2017 11:12 #

    так пойдет:

    User-agent: *

    Disallow: /my/

    Disallow: /checkout/

    Disallow: /mailer/unsubscribe/

    Disallow: /back/

    Disallow: /cat_articless/

    Disallow: /cfg/

    Disallow: /cgi-bin/

    Disallow: /classes/

    Disallow: /core_functions/

    Disallow: /data/

    Disallow: /dblist/

    Disallow: /images/

    Disallow: /includes/

    Disallow: /kernel/

    Disallow: /languages/

    Disallow: /login/

    Disallow: /shop/$

    Disallow: /system/

    Disallow: /published/

    Disallow: /temp/

    Disallow: /help/

    Disallow: /installer/

    Disallow: /en/

    Disallow: /i2/

    Disallow: /modules/

    Disallow: /products_files/

    Disallow: /products_pictures/

    Disallow: /rss/

    Disallow: /sertificat/

    Disallow: /shop1/

    Disallow: /smarty/

    Disallow: /sql/

    Disallow: /SSWA/

    Disallow: /templates/

    Disallow: /templates_c/

    Disallow: /test/

    Disallow: /*?from=

    Disallow: /*sort=*

    Disallow: /*view=*

    Disallow: */search

    Disallow: */category_search

    Disallow: */auth

    Disallow: /cart

    Disallow: */checkout

    Disallow: */feedback

    Disallow: */installer

    Disallow: */login

    Disallow: */logout

    Disallow: */myaccount

    Disallow: */order_status

    Disallow: */published/SC/html/scripts/

    Disallow: */published/wbsadmin/

    Disallow: */register

    Disallow: */remind_password

    Disallow: /*phpsessid*

    Disallow: /*PHPSESSID*

    Disallow: */login.php

    Disallow: /*linkexchange

    Disallow: */admin.php

    Disallow: */auth.php

    Disallow: */forgot.php

    Disallow: /order_history

    Disallow: /myaccount

    Disallow: /contact_info

    Disallow: /ajaxhandler.php

    Disallow: /*published

    Disallow: /*vkontakte

    Disallow: /*facebook

    Disallow: /domxml-php4-to-php5.php

    Disallow: /install.js

    Disallow: /install.css

    Disallow: /install.log

    Disallow: /license.txt

    Disallow: /readme.txt

    Disallow: /settings.xml

    Disallow: /setupguide.htm

    Disallow: /showdblist.php

    Disallow: /showmucontent.php

    Disallow: /adress

    Disallow: /admin.php

    Disallow: /advanced_search_in_category.php

    Disallow: /affiliate_program.php

    Disallow: /articles

    Disallow: /authorization.php

    Disallow: /category.php

    Disallow: /category_search_results.php

    Disallow: /category_tree.php

    Disallow: /change

    Disallow: /checklogin.php

    Disallow: /comparison

    Disallow: /contact_info

    Disallow: /dumper

    Disallow: /fail

    Disallow: /fastinst

    Disallow: /get_file

    Disallow: /head

    Disallow: /home.php

    Disallow: /imgval

    Disallow: /invoice

    Disallow: /news.php

    Disallow: /linkpoint

    Disallow: /m.php

    Disallow: /option

    Disallow: /order

    Disallow: /printable

    Disallow: /register

    Disallow: /search

    Disallow: /shopping

    Disallow: /ssilki

    Disallow: /style

    Disallow: /test.php

    Disallow: /user_acc

    Disallow: /transaction

    Disallow: /wishlist

    Disallow: /reviews/

    Disallow: /compare

    Disallow: /offset

    Disallow: /all/

    Disallow: /update.xml

    Disallow: /*&vote

    Disallow: /*?msg=

    Allow: /product/kitajskie-kofejnye-boby/reviews/

    Host: www.magazintut.ru

    Sitemap: http://magazintut.ru/sitemap-shop.xml


    User-agent: Googlebot

    Disallow: /my/

    Disallow: /checkout/

    Disallow: /mailer/unsubscribe/

    Disallow: /back/

    Disallow: /cat_articless/

    Disallow: /cfg/

    Disallow: /cgi-bin/

    Disallow: /classes/

    Disallow: /core_functions/

    Disallow: /data/

    Disallow: /dblist/

    Disallow: /images/

    Disallow: /includes/

    Disallow: /kernel/

    Disallow: /languages/

    Disallow: /login/

    Disallow: /shop/$

    Disallow: /system/

    Disallow: /published/

    Disallow: /temp/

    Disallow: /help/

    Disallow: /installer/

    Disallow: /en/

    Disallow: /i2/

    Disallow: /modules/

    Disallow: /products_files/

    Disallow: /products_pictures/

    Disallow: /rss/

    Disallow: /sertificat/

    Disallow: /shop1/

    Disallow: /smarty/

    Disallow: /sql/

    Disallow: /SSWA/

    Disallow: /templates/

    Disallow: /templates_c/

    Disallow: /test/

    Disallow: /*?from=

    Disallow: /*sort=*

    Disallow: /*view=*

    Disallow: */search

    Disallow: */category_search

    Disallow: */auth

    Disallow: /cart

    Disallow: */checkout

    Disallow: */feedback

    Disallow: */installer

    Disallow: */login

    Disallow: */logout

    Disallow: */myaccount

    Disallow: */order_status

    Disallow: */published/SC/html/scripts/

    Disallow: */published/wbsadmin/

    Disallow: */register

    Disallow: */remind_password

    Disallow: /*phpsessid*

    Disallow: /*PHPSESSID*

    Disallow: */login.php

    Disallow: /*linkexchange

    Disallow: */admin.php

    Disallow: */auth.php

    Disallow: */forgot.php

    Disallow: /order_history

    Disallow: /myaccount

    Disallow: /contact_info

    Disallow: /ajaxhandler.php

    Disallow: /*published

    Disallow: /*vkontakte

    Disallow: /*facebook

    Disallow: /domxml-php4-to-php5.php

    Disallow: /install.js

    Disallow: /install.css

    Disallow: /install.log

    Disallow: /license.txt

    Disallow: /readme.txt

    Disallow: /settings.xml

    Disallow: /setupguide.htm

    Disallow: /showdblist.php

    Disallow: /showmucontent.php

    Disallow: /adress

    Disallow: /admin.php

    Disallow: /advanced_search_in_category.php

    Disallow: /affiliate_program.php

    Disallow: /articles

    Disallow: /authorization.php

    Disallow: /category.php

    Disallow: /category_search_results.php

    Disallow: /category_tree.php

    Disallow: /change

    Disallow: /checklogin.php

    Disallow: /comparison

    Disallow: /contact_info

    Disallow: /dumper

    Disallow: /fail

    Disallow: /fastinst

    Disallow: /get_file

    Disallow: /head

    Disallow: /home.php

    Disallow: /imgval

    Disallow: /invoice

    Disallow: /news.php

    Disallow: /linkpoint

    Disallow: /m.php

    Disallow: /option

    Disallow: /order

    Disallow: /printable

    Disallow: /register

    Disallow: /search

    Disallow: /shopping

    Disallow: /ssilki

    Disallow: /style

    Disallow: /test.php

    Disallow: /user_acc

    Disallow: /transaction

    Disallow: /wishlist

    Disallow: /reviews/

    Disallow: /compare

    Disallow: /offset

    Disallow: /all/

    Disallow: /update.xml

    Disallow: /*&vote

    Disallow: /*?msg=

    Disallow: /index.php?*

    Disallow: /*?

    Allow: /product/kitajskie-kofejnye-boby/reviews/

    • +2

      Когда вставляете в сообщение код (особенно такой как у Вас тут - в 250 строк) используйте в редакторе специальный блок для вставки кода <>
      Иначе это ни прочитать толком, ни понять, невозможно. Сейчас всё через пустую строку. А как оно там у вас в файле?

  • 2

    Это для старого WebAsyst Shop-Script (v.309) robots.txt Вы пишите?
    Или для какого движка?
    Судя по Disallow: /kernel/ - не для Shop-Script 6/7
    Судя по этому не для WebAsyst Shop-Script (v.309) Sitemap: http://magazintut.ru/sitemap-shop.xml

    Может проще файлы удалить, если они не нужны?

    Disallow: /license.txt
    Disallow: /readme.txt

    В общем - ерунда какая-то, а не robots.txt




    • +2

      Какой смысл секцию для Яндекса переименовать в User-agent: * (директиву Host: понимает только Яндекс),
      а секцию для всех остальных в User-agent: Googlebot?
      Собственно роботс на 2 части делят именно из за Host: для Яндекса. Всё остальное обычно совпадает.
      (Если нужно что-то указать другим ботам (не Гуглу и Яндексу), то, обычно, их добавляют отдельными секциями с указанием их User-agent)

    • +1
      Елена Елена 28 декабря 2017 15:06 #

      да, это из старого асиста, теперь перешли на новый шоп скрипт роботс тхт старый остался

Добавить ответ

Чтобы добавить комментарий, зарегистрируйтесь или войдите