Abstract:
Python implementation of the Data Access Protocol
This module is an implementation of the Data Access Protocol written in Python from scratch. You can use the module as a client to connect to remote datasets and download data transparently as needed; you can also run a server to share your scientific data over the network, so it can be easily accessed using Matlab, Ferret, GrADS or a web browser. ... The module comes with a DAP client, allowing Python programs to access any DAP-served dataset through array-like objects and lists. It also comes with a DAP server that understands data in a variety of formats and that can be easily extended. A lot of effort went into this new release, and there are plenty of changes:
* The server is implemented as a Python Web Server Gateway Interface (WSGI) _application_ (http://www.python.org/peps/pep-0333.html). A WSGI application can run on any WSGI _server_. Currently, there are WSGI servers for mod_python, FastCGI, AJP, SCGI, CGI, Twisted, IIS, so it is possible to run the pyDAP server unmodified on any of these different environments.
WSGI _middleware_ can also be used between the server and application; pyDAP implements WSGI middleware for logging events, memory and disk caching and for automatically generating a THREDDS catalog file. Additional WSGI middleware of interest include Gzip compression and error handling, available in third-party Python modules.
Description:
Ferret Live Access Server (LAS), a Web-based Data Visualization and Analysis Tool
The server provides access to a large (over 20 gigabytes) research-oriented data base of multi-dimensional, gridded, environmental data collected within NOAA and elsewhere. The data base is maintained by the Thermal Modeling and Analysis Project (TMAP) at PMEL.
Description:
Grid Analysis and Display System SERFs
Service Citation
Originators:
Roberto De Almeida
Title:
Python implementation of the Data Access Protocol (pyDAP)
Provider:
Roberto De Almeida
Edition:
2.1
URL:
http://pydap.org/
Access Constraints
The server has support for Python Paste (http://pythonpaste.org), so all the WSGI configuration mentioned above (server, middleware, etc.) can be handled using a single INI-like configuration file. pyDAP also comes with a simple script to run a standalone server for testing purposes:
* The pyDAP server is able to serve data stored as netCDF, Matlab or Comma Separated Values (CVS) files. It is also able to serve data stored in RDBMS using the Python DB-API 2.0 specification; this includes PostgreSQL, MySQL, Oracle, IBM DB2, Informix, Interbase, Ingres/OpenIngres, JDBC, mxODBC, SQLite and SAP DB.
The module defines an API that allows new data formats to be supported through plugins. Plugins can be easily created, and are located by the server through an automatic discovery mechanism. urrently working on plugins for Grib 1/2 and HDF 4/5 files, and an aggregation plugin. There also a "meta" plugin that enables any supported file to be served in compressed (gzip/bzip2) format.
* The server is able to handle datasets of arbitrary size. The whole process of reading the data, encoding to ASCII/XDR and sending through HTTP is done in small blocks, avoiding memory consumption. Also, the server is able to handle dynamic datasets generated from Python code.
* The module implements an experimental JavaScript Object Notation (JSON) (http://json.org) response and parser.
The biggest advantage of using JSON is that it's parsed by Javascript more easily than XML; since a JSON response is valid Javascript, it can be simply eval()ed. Another great advantage of JSON is that it's *also* valid Python code (!), so it can be easily parsed and generated.
The module already has support for a DDX response/parser, to be implemented when the final specification is released.
Concerning recent discussions about the DAS, the DAS parser in the module understands both nested and flat attributes. The DAS response generated by the server follows the DAP 2 specification and mimics the DDS structure.
* pyDAP is distributed/packaged using setuptools instead of the default distutils module. Provided you have Python installed, it is possible to install pyDAP with three simple steps:
This will also install the required dependencies. You'll still need to install Numeric, Numarray or Scipy Core manually, and a few additional modules dependending on the data being served. Updating to new versions is also easy with setuptools:
sudo easy_install -U dap
Use Constraints
The MIT License
Copyright (c)
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, ... merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
TYLER
B.
STEVENS Role:
SERF AUTHOR
Phone:
(301) 614-6898
Fax:
301-614-5268
Email:
Tyler.B.Stevens at nasa.gov
Contact Address:
NASA Goddard Space Flight Center
Global Change Master Directory City:
Greenbelt
Province or State:
MD
Postal Code:
20771
Country:
USA
Publications/References
Sorlien, C.C., B.P. Luyendyk, D.S. Wilson, R.C. Decesari, L.R. Bartek, and J.B. Diebold, 2007. Oligocene development of the West Antarctic ice sheet recorded in eastern Ross Sea strata, Geology v.35(5): p.467-470.
Decesari, R.C., 2006. The Mesozoic and Cenozoic depositional, structural, and tectonic evolution of the Ross Sea, Antarctica, University of California, Santa Barbara, PhD thesis: p.232.
Decesari, R.C., C.C. Sorlien, B.P. Luyendyk, D.S. Wilson, L. Bartek, J. Diebold, and S.E. Hopkins, 2007. Regional seismic stratigraphic correlations of the Ross Sea: Implications for the tectonic history of ... the West Antarctic Rift System (USGS Open File Report 2007-1047, Short Research Paper 052), Antarctica: A Keystone in a Changing World â Online Proceedings of the 10th ISAES, edited by A. K. Cooper and C. R. Raymond et al. v.USGS Open-File Report 2007-1047, Short Research Paper 52: p..
Boyd, L.W., L.R. Bartek, B.P. Luyendyk and D.S. Wilson, 2007. Contrasting Sub-Ice Shelf, Sub Glacial and Glacial Marine Deposition: Implications for Ice Shelf Stability, Antarctica: A Keystone in a Changing World â Online Proceedings of the 10th ISAES, edited by A. K. Cooper and C. R. Raymond et al. v.USGS Open-File Report 2007-1047, Extended Abstract 152: p..
Decesari, R.C., D.S. Wilson, B.P. Luyendyk, and M. Faulkner, 2007. Cretaceous and Tertiary extension throughout the Ross Sea, Antarctica, Antarctica: A Keystone in a Changing World â Online Proceedings of the 10th ISAES, edited by A. K. Cooper and C. R. Raymond et al. v.USGS Open-File Report 2007-1047, Short Research Paper 98: p..
Loth, A.S., L.R. Bartek, B.P. Luyendyk, D. Wilson and C. Sorlien, 2007. Scale of subglacial to sub-ice shelf facies variability, Eastern Basin-Ross Sea, Antarctica: A Keystone in a Changing World â Online Proceedings of the 10th ISAES, edited by A. K. Cooper and C. R. Raymond et al. v.USGS Open-File Report 2007-1047, Extended Abstract 200: p..
Luyendyk, B.P., D.S. Wilson, and C.S. Siddoway, 2003. Eastern margin of the Ross Sea Rift in western Marie Byrd Land, Antarctica: Crustal structure and tectonic development, Geochemistry, Geophysics, Geosystems v.4: p.1090.
Sorlien, C.C., D.S. Wilson, B.P. Luyendyk, L.R. Bartek, R.C. Decesari, and J.B. Diebold, 2007. Buried Oligocene glacial topography beneath a smooth middle Miocene unconformity in the southeast Ross Sea: Evolution of West Antarctic glaciation, Antarctica: A Keystone in a Changing World â Online Proceedings of the 10th ISAES, edited by A.K. Cooper and C.R. Raymond et al. v.USGS Open-File Report 2007-1047, Extended Abstract 099: p..
Wilson, D.S., and B.P. Luyendyk, 2006. Bedrock platforms within the Ross Embayment, West Antarctica: Hypotheses for ice sheet history, wave erosion, Cenozoic extension, and thermal subsidence, Geochemistry, Geophysics, Geosystems v.7: p..
Boyd, L., 2008. Contrasting sub-ice shelf, subglacial and glaciomarine sedimentation at the Ross Ice Shelf: Implications for the glacial history of the Ross Sea Region, Antarctica, University of North Carolina, Chapel Hill, MS thesis: p..
Loth, A., 2009. Seismic Stratigraphic Record of West Antarctic Ice Sheet Fluctuations within the Eastern Basin of the Ross Sea, Antarctica, University of North Carolina, Chapel Hill, MS thesis: p..
Viator, P., 2009. Evolution the East Antarctic Ice Sheet: A Record from the Seismic Stratigraphy of the C-19 Site, Ross Sea, Antarctica, University of North Carolina, Chapel Hill, MS thesis: p..
Creation and Review Dates
SERF Creation Date:
2006-01-26
SERF Last Revision Date:
2013-05-10
Links
