AFCCC Historical Surface Weather Observation Database (DSI-9966)
Entry ID: gov.noaa.ncdc.C00676

[ Get Data ]
[ Update this Record ]

Summary
Abstract: The Historical surface weather observation database (HSWOD) is a digital dataset archived by the National Climatic Data center (NCDC). This database has been developed by the Air Force Combat Climatology Center in Asheville, NC and serves as a replacement for the DATSAV3 formatted DSI-9956 (C00442). This new database is a CSV formatted database that is easily viewed in spreadsheets and is easily integrated into the Integrated Surface Daily (ISD) dataset. As of this writing (October 2007) the plan is to overlap the two databases (DATSAV3 and HSWOD) through the end of 2007. At that time (January 2008) DATSAV3 will no longer be active and the HSWOD will be fully integrated into the ISD. The HSWOD contains worldwide observations (synoptic, airways, METAR, synoptic ship) for approximately 13,000 sites. All weather elements transmitted are retained; in some cases computed/derived values are incorporated into the record.

Purpose: Support DoD projects.

SUPPLEMENTAL INFORMATION: data set

Fees, if applicable, are displayed on the web page for obtaining these data; fees are also dependent on customer order specifications. Please contact NCDC for further information on fees and terms for retrieving these data.

CURRENTNESS REFERENCE: ground condition

Related URL
Link: GET DATA
Description: Data Access, Information, Methods, and Reports are available


Link: VIEW EXTENDED METADATA
Description: View Source Metadata document from the Metadata Manager and Repository (NMMR).


Geographic Coverage
 N: 90.0 S: -90.0  E: 180.0  W: -180.0

Data Set Citation
Dataset Originator/Creator: AFCCC - Air Force Combat Climatology Center (AFWA)
Dataset Title: AFCCC Historical Surface Weather Observation Database (DSI-9966)
Dataset Release Date: 2006-09-15
Dataset Release Place: Asheville, NC
Dataset Publisher: DOC/NOAA/NESDIS/NCDC > National Climatic Data Center, NESDIS, NOAA, U.S. Department of Commerce
Data Presentation Form: Digital database


Temporal Coverage
Start Date: 1901-01-01


Location Keywords
GEOGRAPHIC REGION > GLOBAL


Science Keywords
ATMOSPHERE >ATMOSPHERIC PRESSURE >PRESSURE TENDENCY    [Definition]
ATMOSPHERE >ATMOSPHERIC PRESSURE >PRESSURE THICKNESS    [Definition]
ATMOSPHERE >ATMOSPHERIC PRESSURE >SEA LEVEL PRESSURE    [Definition]
ATMOSPHERE >ATMOSPHERIC PRESSURE >SURFACE PRESSURE    [Definition]
ATMOSPHERE >ATMOSPHERIC PRESSURE >ATMOSPHERIC PRESSURE MEASUREMENTS    [Definition]
ATMOSPHERE >ATMOSPHERIC TEMPERATURE >AIR TEMPERATURE    [Definition]
ATMOSPHERE >ATMOSPHERIC TEMPERATURE >ATMOSPHERIC STABILITY    [Definition]
ATMOSPHERE >ATMOSPHERIC TEMPERATURE >MAXIMUM/MINIMUM TEMPERATURE    [Definition]
ATMOSPHERE >ATMOSPHERIC TEMPERATURE >TEMPERATURE TENDENCY    [Definition]
ATMOSPHERE >ATMOSPHERIC WATER VAPOR >DEW POINT TEMPERATURE    [Definition]
ATMOSPHERE >ATMOSPHERIC WINDS >SURFACE WINDS    [Definition]
ATMOSPHERE >ATMOSPHERIC WINDS >WIND CHILL    [Definition]
ATMOSPHERE >CLOUDS >CLOUD PROPERTIES >CLOUD FREQUENCY    [Definition]
ATMOSPHERE >CLOUDS >CLOUD PROPERTIES >CLOUD CEILING    [Definition]
ATMOSPHERE >CLOUDS >CLOUD PROPERTIES >CLOUD HEIGHT    [Definition]
ATMOSPHERE >CLOUDS >CLOUD TYPES    [Definition]
ATMOSPHERE >CLOUDS >CLOUD PROPERTIES >CLOUD VERTICAL DISTRIBUTION    [Definition]
ATMOSPHERE >PRECIPITATION >FREEZING RAIN    [Definition]
ATMOSPHERE >PRECIPITATION >HAIL    [Definition]
ATMOSPHERE >PRECIPITATION >PRECIPITATION AMOUNT    [Definition]
ATMOSPHERE >PRECIPITATION >PRECIPITATION RATE    [Definition]
ATMOSPHERE >PRECIPITATION >RAIN    [Definition]
ATMOSPHERE >PRECIPITATION >SLEET    [Definition]
ATMOSPHERE >PRECIPITATION >SNOW    [Definition]
OCEANS >OCEAN WAVES >WAVE HEIGHT    [Definition]
OCEANS >OCEAN WAVES >WIND WAVES    [Definition]
OCEANS >OCEAN WINDS >SURFACE WINDS    [Definition]
ATMOSPHERE >ATMOSPHERIC WINDS >WIND TENDENCY    [Definition]
ATMOSPHERE >ATMOSPHERIC TEMPERATURE >DEW POINT TEMPERATURE    [Definition]


ISO Topic Category
CLIMATOLOGY/METEOROLOGY/ATMOSPHERE
ELEVATION
OCEANS


Platform
METEOROLOGICAL STATIONS    [Information]
BUOYS    [Information]
SHIPS    [Information]


Instrument
ALTIMETERS    [Information]
ANEMOMETERS    [Information]
AWS >Automated Weather System    [Information]
BAROMETERS    [Information]
HUMIDITY SENSORS    [Information]
HYGROMETERS    [Information]
PRESSURE SENSORS
RAIN GAUGES    [Information]
TEMPERATURE SENSORS    [Information]
THERMOMETERS    [Information]
WIND VANES    [Information]
CEILOMETERS    [Information]
SUNSHINE RECORDERS    [Information]
VISUAL OBSERVATIONS    [Information]


Project
ESIP >Earth Science Information Partners Program    [Information]


Quality
LOGICAL CONSISTENCY REPORT: Automated checks are applied to the data during the ingest process before the data are written off to the archive (DATSAV3) flat file format and then loaded into the Surface Historical data base. There are three types of quality control applied to the data. The initial is validation of individual observations and is applied as the data is received. The second incorporates synoptic decode algorithms and various other functions as described below and is also run hourly as data are received. The third consists of continuity checks over time and consequently is run once a day. The initial Quality Control validates the data against the master station catalog, checks to see if the station is in our catalog and adds latitude and longitude where missing (if it is listed in the master station catalog). The second phase of the QC (QC_RAW) incorporates a variety of functions, the largest portion of which is decoding the additive portion of the synoptic observation. Its other roles are merging different types (i.e. METAR, SYNOPTIC) of observations that come in for the same station for the same time, removing duplicate observations, distinguishing record observations from special observations, rounding record observation times to the nearest whole hour where applicable, and calculating/correcting ceilings. The daily checks validate observations in three ways. It performs gross limit checks on specific elements within the observation. It performs intra-observation checks to see if elements within the same observation are consistent. It also performs inter-observation checks for consistency and continuity between different observations from the same station. A detailed description of the DAILY ALGORITHMS 27 Nov 95 (updated Dec 2001) WIND ALGORITHMS 1. Wind direction: If wind_dir not = 0-360 or 990 or 999, then set = missing. 2. Wind direction: If wind_dir not = 0 and wind_spd = 0 and wind_gust = 0 or 9999, then set wind_dir = 0. 3. Wind speed: If wind_spd not 0-

COMPLETENESS REPORT: Periods of record vary from station to station. The earliest station data dates back to January of 1901. New data are added to the dataset each month. There are over 22,000 stations loaded in the tables. Long periods of record do not necessarily end at the current time. No reasonable data are excluded from the dataset during the load process. The Oracle tables are set up to include all the surface data from the AFCCC archive file that is created for each month:

LINEAGE/PROCESS STEP:
PROCESS DESCRIPTION: Quality fields have been established for each meteorological element in the data base. Five quality flags are available for use, but only four are currently used by AFCCC. A quality flag of 0 = No check, 1 = Good, 2 = Suspect, 3 = Erroneous (not used by AFCCC, because if we determine it is bad, we remove it), 4=Calculated and 5=Removed. During the initial load of the data into the data base, a large number of stations that shared the same latitude and longitude were identified. Value judgments were made for each station and only one station per latitude and longitude combination was loaded into the tables. Any station data that could not be loaded because it shared the same latitude and longitude with another station was cataloged and an ongoing effort is underway to resolve such stations and get them loaded into the tables where possible. In some instances, it is simply a matter of resolving the latitude and longitude to a higher resolution (if available) so that the station can be reloaded into the tables. In other cases, extensive research will be required to determine if there is an error in either the latitude or longitude or perhaps even the block station number that has been assigned to the station before it was sent to the archive. It should be noted that there were over one thousand stations that could not be loaded into the data base because of this problem. In addition to this problem there were approximately xxxxx stations in the archive that did not have any latitude and longitude or the latitude and longitude had been set to a default of latitude = 0 and longitude = 0. Stations without a valid latitude and longitude were not loaded into the tables. A detailed quality control data base of errors (QC_ADE) is available on the AFCCC intranet at http://intranet/dod/quality.php. QC_ADE is an Access data base that the Data Quality Team uses to detail and catalog any know errors that exist in the various data bases maintained at AFCCC. QC_ADE contains details of both open and resolved errors in the data. It offers search a search capability based on weather element, database, blockstation, country, date range, AFWA Problem Report Number, internal tracker identification number, and keyword.
PROCESS DATE: 19010101


Access Constraints
ACCESS CONSTRAINTS: Access through AFCCC is limited to DoD agencies and their contractors. All other requests are filled through the National Climatic Data Center in Asheville, N.C.

DISTRIBUTION LIABILITY: Every effort has been made to ensure that these data are accurate and reliable within the limits of current NOAA quality control procedures. NOAA can only certify that the data provided to its customers is an authentic copy of the records which were accepted for inclusion in NOAA archives. NOAA cannot assume liability for any damages caused by any errors or omissions in the data, nor as a result of the failure of the data to function on a particular system. NOAA makes no warranty, expressed or implied, nor does the fact of distribution constitute such a warranty.


Use Constraints
Acknowledgement of the Data Originator when using the Data Item as a source.


Keywords
CRYOSPHERE > SNOW/ICE
HYDROSPHERE > SNOW/ICE
GOSIC
G3OS/


Data Set Progress
COMPLETE


Data Center
National Climatic Data Center, NESDIS, NOAA, U.S. Department of Commerce    [Information]
Data Center URL: http://www.ncdc.noaa.gov/
Dataset ID: ______DSI-9966 ____

Data Center Personnel
Name: NCDC CUSTOMER SERVICE
Phone: 828-271-4800
Fax: 828-271-4876
Email: ncdc.orders at noaa.gov
Contact Address:
151 Patton Avenue, Room 120
City: Asheville
Province or State: NC
Postal Code: 28801-5001
Country: USA



Distribution
Distribution_Format: CSV
Fees: Please see summary


Personnel
NCDC METADATA SERVICES
Role: DIF AUTHOR
Phone: 828-271-4800
Fax: 828-271-4876
Email: ncdc.metadata at noaa.gov
Contact Address:
151 Patton Avenue
Room 468
City: Asheville
Province or State: North Carolina
Postal Code: 28801-5001
Country: USA



Creation and Review Dates
DIF Creation Date: 2007-09-28
Last DIF Revision Date: 2011-07-21

[ Update this Record ]


Link to Web Site