User-agent: meta-externalagent Disallow: / User-agent: meta-webindexer Disallow: / User-agent: Baiduspider-render Disallow: / User-agent: * Allow: Disallow: /Agent Disallow: /AgentSelection Disallow: /CreateAgent Disallow: /GenerateResponse Disallow: /flexdates_fe Disallow: /gethotelcrosssell_fe