User-Agent: * Allow: / Allow: /feeds/*?country= Allow: /feeds/*&country= Allow: /login Disallow: /app/ Disallow: /company/ Disallow: /video/ Disallow: /api/ Disallow: /login Disallow: /go/ Disallow: /*?platform= Disallow: /*&platform= Disallow: /*?work= Disallow: /*&work= Disallow: /*?country= Disallow: /*&country= Disallow: /*?q= Disallow: /*&q= Disallow: /*?ai= Disallow: /*&ai= Disallow: /*?label= Disallow: /*&label= Disallow: /*?fits= Disallow: /*&fits= Disallow: /*?kw= Disallow: /*&kw= Disallow: /*?focus= Disallow: /*&focus= Disallow: /*?terms= Disallow: /*&terms= Disallow: /*?min= Disallow: /*&min= Disallow: /*?from= Disallow: /*&from= Disallow: /*?remote= Disallow: /*&remote= Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?added= Disallow: /*&added= Disallow: /*?reach= Disallow: /*&reach= Disallow: /*?pay= Disallow: /*&pay= Disallow: /*?matches= Disallow: /*&matches= Disallow: /*?in= Disallow: /*&in= Disallow: /*?figure= Disallow: /*&figure= Disallow: /*?kind= Disallow: /*&kind= User-Agent: LinkupBot User-Agent: YouBot Allow: / Allow: /feeds/*?country= Allow: /feeds/*&country= Allow: /login Disallow: /app/ Disallow: /company/ Disallow: /video/ Disallow: /api/ Disallow: /login Disallow: /go/ Disallow: /*?platform= Disallow: /*&platform= Disallow: /*?work= Disallow: /*&work= Disallow: /*?country= Disallow: /*&country= Disallow: /*?q= Disallow: /*&q= Disallow: /*?ai= Disallow: /*&ai= Disallow: /*?label= Disallow: /*&label= Disallow: /*?fits= Disallow: /*&fits= Disallow: /*?kw= Disallow: /*&kw= Disallow: /*?focus= Disallow: /*&focus= Disallow: /*?terms= Disallow: /*&terms= Disallow: /*?min= Disallow: /*&min= Disallow: /*?from= Disallow: /*&from= Disallow: /*?remote= Disallow: /*&remote= Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?added= Disallow: /*&added= Disallow: /*?reach= Disallow: /*&reach= Disallow: /*?pay= Disallow: /*&pay= Disallow: /*?matches= Disallow: /*&matches= Disallow: /*?in= Disallow: /*&in= Disallow: /*?figure= Disallow: /*&figure= Disallow: /*?kind= Disallow: /*&kind= Crawl-delay: 60 User-Agent: AhrefsBot User-Agent: AhrefsSiteAudit User-Agent: SemrushBot User-Agent: SiteAuditBot User-Agent: DataForSeoBot User-Agent: MJ12bot User-Agent: DotBot User-Agent: rogerbot User-Agent: SERankingBacklinksBot User-Agent: Barkrowler User-Agent: BLEXBot User-Agent: serpstatbot User-Agent: SEOkicks User-Agent: AwarioBot User-Agent: Mediatoolkitbot User-Agent: magpie-crawler User-Agent: Reflectionbot User-Agent: ElevenlabsCrawler User-Agent: Bytespider User-Agent: TokenFoundryBot User-Agent: cohere-training-data-crawler User-Agent: AI2Bot User-Agent: PanguBot User-Agent: Diffbot User-Agent: Omgilibot User-Agent: omgili User-Agent: webzio-extended User-Agent: ImagesiftBot User-Agent: img2dataset User-Agent: Timpibot User-Agent: code-docs-corpus User-Agent: PetalBot User-Agent: KakaoBot User-Agent: Sogou web spider User-Agent: KeenableBot User-Agent: Keenable-User User-Agent: ShapBot User-Agent: Shap-User User-Agent: SofyaBot User-Agent: LivelapBot User-Agent: SojournerBot User-Agent: TalarionSearchBot User-Agent: 7Maps-bot User-Agent: StealthStackCrawler User-Agent: SealKeeperBot User-Agent: HarkBot User-Agent: CodebuffResearchBot User-Agent: interCrawlerBot User-Agent: AionBot User-Agent: Epochal-Search User-Agent: fresh-domain-watch User-Agent: Lightpanda User-Agent: ExaSearchBot User-Agent: ExaUser Disallow: / User-Agent: Googlebot Allow: / Allow: /feeds/*?country= Allow: /feeds/*&country= Allow: /login Disallow: /app/ Disallow: /company/ Disallow: /video/ Disallow: /api/ Disallow: /login Disallow: /go/ Disallow: /*?platform= Disallow: /*&platform= Disallow: /*?work= Disallow: /*&work= Disallow: /*?country= Disallow: /*&country= Disallow: /*?q= Disallow: /*&q= Disallow: /*?ai= Disallow: /*&ai= Disallow: /*?label= Disallow: /*&label= Disallow: /*?fits= Disallow: /*&fits= Disallow: /*?kw= Disallow: /*&kw= Disallow: /*?focus= Disallow: /*&focus= Disallow: /*?terms= Disallow: /*&terms= Disallow: /*?min= Disallow: /*&min= Disallow: /*?from= Disallow: /*&from= Disallow: /*?remote= Disallow: /*&remote= Disallow: /*?sort= Disallow: /*&sort= Disallow: /*?added= Disallow: /*&added= Disallow: /*?reach= Disallow: /*&reach= Disallow: /*?pay= Disallow: /*&pay= Disallow: /*?matches= Disallow: /*&matches= Disallow: /*?in= Disallow: /*&in= Disallow: /*?figure= Disallow: /*&figure= Disallow: /*?kind= Disallow: /*&kind= Disallow: /sitemap.xml$ Disallow: /sitemap/*.xml$ Sitemap: https://cyberjobs.cc/sitemap.xml Sitemap: https://cyberjobs.cc/sitemap-google.xml