# ------------------------------------- # General rules for all bots # ------------------------------------- User-agent: * Allow: / # ------------------------------------- # Sitemaps (use absolute URLs) # ------------------------------------- Sitemap: https://calculatorr.com/sitemap.xml # ------------------------------------- # Crawl-delay for aggressive bots # ------------------------------------- User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 User-agent: MJ12bot Crawl-delay: 10 User-agent: Baiduspider Crawl-delay: 10