# Robots.txt User-agent: * Disallow: /Ad/ Disallow: /doi/ Disallow: /ads/ Disallow: /jobs/offers/ Disallow: /navi/