User-agent: * Allow: / Allow: /assets/ Allow: /assets2/ Disallow: /.well-known Disallow: /administrator Disallow: /DB Disallow: /dumpss Disallow: /include Disallow: /old-backup-20-April2020 Disallow: /owlcarousel Disallow: /video Disallow: /blog/author* Disallow: /*feed Disallow: /beta Disallow: /_oldwebsite Disallow: /brochures User-agent: ia_archiver Disallow: Sitemap: https://www.crescentfoundry.com/sitemap.xml