Uploaded image for project: 'Gateway'
  1. Gateway
  2. GTWY-3908

Wrong robots.txt File is Being Returned by Staging and Prototype Instances

XMLWordPrintable

    • Icon: Defect Defect
    • Resolution: Done
    • Icon: Major Major
    • 2.0.43
    • None
    • None
    • None
    • 0.5

      The wrong robots.txt file is being returned when requesting the robots.txt file on our staging and prototype instances:

      https://esg.prototype.ucar.edu/robots.txt
      https://cadis.prototype.ucar.edu/robots.txt
      https://esg.staging.ucar.edu/robots.txt
      https://cadis.staging.ucar.edu/robots.txt

      What should be returned is a blank, disallow file:

      #
      # basic do not allow
      #
      User-agent: *
      Disallow: /

              bonnland Brian Bonnlander
              nhook Nathan Hook
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: