User-agent: * Allow: / Disallow: /unsubscribed/ Disallow: /error/ Disallow: /close Disallow: /t/ Disallow: /i/ Disallow: /w/ # Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared. User-agent: Twitterbot Allow: /w/ Allow: /i/ User-agent: facebookexternalhit Allow: /w/ Allow: /i/ Sitemap: https://getsitecontrol.com/sitemap.xml