User-agent: Miralinks Robot Allow: / User-agent: Googlebot Allow: / User-agent: YandexBot Allow: / User-agent: Bingbot Crawl-delay: 3 Request-rate: 1/3s User-agent: * Crawl-delay: 2 Request-rate: 1/2s Allow: / Allow: /news/ Allow: /firmnews/ Allow: /catalog/ Allow: /person/ Allow: /horoscope/ Allow: /sign/ Allow: /quotes/ Allow: /testing/ Allow: /course/ Allow: /holiday/ Allow: /vacancy/ Allow: /resume/ Allow: /personal/ Allow: /subscribe/ Allow: /sitemap.xml Allow: /robots.txt Allow: /favicon.ico Disallow: /admin/ Disallow: /monitoring/ Disallow: /var/ Disallow: /vendor/ Disallow: /node_modules/ Disallow: /bin/ Disallow: /config/ Disallow: /src/ Disallow: /tests/ Disallow: /migrations/ Disallow: /translations/ Disallow: /templates/ Disallow: /public/build/ Disallow: /public/cache/ Disallow: /public/vendor/ Disallow: /client/ Disallow: /pressman/ Disallow: /api/ Disallow: /usr/ Disallow: /login Disallow: /logout Disallow: /register Disallow: /reset-password Disallow: /profile Disallow: /billing Disallow: /payment Disallow: /turbo-frame Disallow: /_fragment Disallow: /*?* Disallow: /*#* Disallow: /*.json$ Disallow: /*.xml$ Disallow: /*.txt$ Disallow: /*.pdf$ Disallow: /*.doc$ Disallow: /*.docx$ Disallow: /*.xls$ Disallow: /*.xlsx$ Disallow: /*.zip$ Disallow: /*.rar$ # Игнорировать GET-параметры для устранения дублей страниц Clean-param: print Clean-param: offset Sitemap: https://globalnsk.ru/sitemap.xml