Uploaded image for project: 'Gateway'
  1. Gateway
  2. GTWY-3980

Thredds Harvesting generates exceptions for missing metadata

XMLWordPrintable

    • Icon: Defect Defect
    • Resolution: Done
    • Icon: Minor Minor
    • None
    • 2.0.46
    • XML Ingest
    • None

      Some EOL Thredds records contain missing metadata. The Thredds harvesting code does not take into account the possibility of missing values, and exceptions are thrown. This may cause dataset records to be entirely ignored instead of being harvested and displayed as containing missing information.

      This bug is classified as minor because it involves a small number of dataset records.

      Example exceptions from EOL harvesting follow:

      16:46:46.424 [DefaultMessageListenerContainer-1] ERROR sgf.gateway.integration.node.Node - exception transforming sgf.gateway.integration.thredds.ThreddsDatasetPayload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_795.thredds.xml:
      java.lang.NullPointerException: null
      at sgf.gateway.integration.thredds.transform.NodeDatasetPeriodOfPerformance.process(NodeDatasetPeriodOfPerformance.java:23) ~[NodeDatasetPeriodOfPerformance.class:na]

      16:46:48.464 [DefaultMessageListenerContainer-1] DEBUG sgf.gateway.integration.node.Node - Dataset name is Satellite Data Resources for payload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_804.thredds.xml
      16:46:48.464 [DefaultMessageListenerContainer-1] DEBUG sgf.gateway.integration.node.Node - Dataset description is null for payload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_804.thredds.xml
      16:46:48.465 [DefaultMessageListenerContainer-1] ERROR sgf.gateway.integration.node.Node - exception transforming sgf.gateway.integration.thredds.ThreddsDatasetPayload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_804.thredds.xml:
      java.lang.NullPointerException: null
      at sgf.gateway.integration.thredds.transform.NodeDatasetPeriodOfPerformance.process(NodeDatasetPeriodOfPerformance.java:23) ~[NodeDatasetPeriodOfPerformance.class:na]


      16:46:49.515 [DefaultMessageListenerContainer-1] DEBUG sgf.gateway.integration.node.Node - Dataset description is null for payload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_805.thredds.xml
      16:46:49.515 [DefaultMessageListenerContainer-1] INFO s.g.i.service.DatasetLoadService - loading dataset payload: http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_640.thredds.xml
      16:46:49.516 [DefaultMessageListenerContainer-1] ERROR sgf.gateway.integration.node.Node - exception transforming sgf.gateway.integration.thredds.ThreddsDatasetPayload http://data.eol.ucar.edu/jedi/catalog/ucar.ncar.eol.dataset.46_805.thredds.xml:
      java.lang.NullPointerException: null
      at sgf.gateway.integration.thredds.transform.NodeDatasetPeriodOfPerformance.process(NodeDatasetPeriodOfPerformance.java:23) ~[NodeDatasetPeriodOfPerformance.class:na]



              Unassigned Unassigned
              bonnland Brian Bonnlander
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: