User-agent: * Disallow: /assets/files/free-css-layouts/download/ Disallow: /assets/files/free-css-menus/download/ Disallow: /assets/files/free-css-templates/download/ Disallow: /assets/files/free-css-tutorials/download/ User-agent: ia_archiver Disallow: / User-agent: Snappy Disallow: / User-agent: cometrics-bot Disallow: / User-agent: snapbot Disallow: / Sitemap: https://www.free-css.com/sitemap.xml