2012.05 WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

From IMarine Wiki

Jump to: navigation, search


This WP9 Activity Report described the activities performed in May 2012 by Beneficiary and Task.

It is part of the Monthly Activity Report.

T9.1 Data Access and Storage Facilities

FAO Activities

FAO has started the refactorisation of the tree-manager-library towards compliance with the design model defined in the context of WP11. In doing so, it has used the framework also produced in WP11, providing feedback to the suitability of its support. The refactorisation impacts on the clients of the library, both within the tree-based subsystem of Data Access and outside. In particular, FAO has supported the evolution of the Transfer services that make use of the tree-maanger-library

None to report.

None to report.

CNR Activities

CNR finished with the development of the SpeciesLink and ITIS plugins. In particular, to improve the response time of ITIS plugin, we created a MySQL database from a SQL dump.

None to report.

  • SpeciesLink plugin implementation
  • ITIS plugin implementation

T9.2 Data Transfer Facilities

CERN Activities

CERN has performed the extension of the Data Transfer Agent service in order to integrate the URLResolution Library implemented by NKUA ( to transparently handle transfers from various type of URLs : HTTP/s, FTP, SFTP, BitTorrent). The service as well has been integrated with the Storage Manager Library to implement transfers from/to MongoDB. A first version of the development guide for the service and the library implementing the API is available on the Development wiki.



NKUA Activities

NKUA has been working on improving the TCP transfer method performance of gRS2 as reported on the ticket #302. So far performance has been increased by a factor of 4 by adopting some core Java techniques such as object serialization, buffered reading/writing and data compression.

The next task NKUA will work on is the management of some special cases that require some customization handling and the investigation of some further optimizations.



Terradue Activities

Terradue has documented the WPS-hadoop software as wiki pages available at https://gcube.wiki.gcube-system.org/gcube/index.php/Geospatial_Data_Processing The WPS-hadoop software includes examples of processes dealing with raster products (e.g. gebco bathymetry), a streaming example for running non-java processes (e.g. matlab, IDL, bash) but did not include any vectorial example. A simple SPREAD process was implemented to support the WPS 52 North IntersectionAlgorithm but on a hadoop resource and using WFS data by reference managed as GML. The intersection example takes a FAO area and the EEZs. This example is used and enhanced by FAO (E. Blondel). Furthermore, WPS-Hadoop 1.0 was delivered to gCube infrastructure, including the 52 North WPS 3.0 after a positive impact assessment. Finally we provided support to CNR in order to install and setup its WPS-Hadoop development environment.

T9.3 Data Assessment, Harmonization and Certification Facilities

No activity to report on T9.3 in May.

CNR Activities

Nothing to report.

Personal tools