# Crawling bot rules only allow inside website directory User-agent: * Allow: / Disallow: /node_modules/ Disallow: /.idea/ Disallow: /assets/ Disallow: /package-lock.json Disallow: /package.json Disallow: /deploy.sh Disallow: /tailwind.config.js