# Robots.txt for Naryab Portal (https://naryab.com) # Configured for optimal crawling by Google, Bing, and major search engines. User-agent: * Allow: / User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: /images/ User-agent: Bingbot Allow: / User-agent: msnbot Allow: / User-agent: BingPreview Allow: / User-agent: Applebot Allow: / User-agent: DuckDuckBot Allow: / User-agent: YandexBot Allow: / # Canonical XML Sitemap Declaration Sitemap: https://naryab.com/sitemap.xml Host: https://naryab.com