# Default — allow general crawling User-agent: * Allow: / # Lovable preview / app surfaces — keep out of search Disallow: /auth Disallow: /_authenticated/ # OpenAI crawlers MUST be able to reach landing pages used as ad destinations, # otherwise ads get rejected with crawler_404. Explicit allow blocks below. User-agent: OAI-AdsBot Allow: / Allow: /p/ User-agent: OAI-SearchBot Allow: / Allow: /p/ User-agent: GPTBot Allow: / Allow: /p/ User-agent: ChatGPT-User Allow: / Allow: /p/ Sitemap: https://adwise-pilot.lovable.app/sitemap.xml