User-agent: * Allow: / Disallow: /login Disallow: /admin/ Disallow: /register Disallow: /password/ Disallow: /user/ Disallow: /api/ Disallow: /*.json$ Disallow: /*.xml$ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /checkin/