User-Agent: facebookexternalhit Allow: / User-Agent: Bytespider User-Agent: Baiduspider User-Agent: PetalBot User-Agent: TikTokSpider Disallow: / User-Agent: Twitterbot Allow: /*?utm_ User-Agent: Bingbot Disallow: /?s= Disallow: /search/ Disallow: /*?comment_id= Disallow: /*&comment_id= Disallow: /*?media_id= Disallow: /*&media_id= User-Agent: * Allow: / Disallow: /*?comment_id= Disallow: /*&comment_id= Disallow: /*?media_id= Disallow: /*&media_id=