User-agent: * Disallow: /?* Disallow: /*?* Disallow: /api/ Disallow: /*.json$ Disallow: /*.txt$ Disallow: /*.conf$ Disallow: /*.sh$