2013.05 WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

From IMarine Wiki

Jump to: navigation, search

Contents

This WP9 Activity Report described the activities performed in May 2013 by Beneficiary and Task.

It is part of May 2013 Monthly Activity Report.

T9.1 Data Access and Storage Facilities

FAO Activities

The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

CNR Activities

A new instance of SDMX Fusion Registry was installed on a new node for the development infrastructure (#1700). This instance will be used in order to test sdmx client libraries and replaces an old instance on a development machine.

A issue with RepositoryInfo object returned by remote plugins in the Species Product Discovery service has been fixed (#605).

Storage Manager

  • Deployed a new MongoDB sharded cluster for development environment as storage-manager library backend #1703)
  • bug fix: remote connections left open on mongoDB backend #606).
  • A new version of storage-manager library has been deployed in release gcube-2.15


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T9.2 Data Transfer Facilities

CERN Activities

During the reported period the following activities were performed:


none


none

NKUA Activities

Nothing to report


Nothing to report


Nothing to report

Terradue Activities

  • Started the implementation of the IRD Tuna Atlas indicators as legacy applications #1460, #1461, #1462, #1792
  • Started the integration of the FAO SPREAD stand-alone application #1795
  • Pom-ification of legacy application files - #1460, #1461, #1462, #1792, #1795
  • Analysis of candidate toolboxes/APIs for environmental enrichment - ticket #1794 and #1819


None


  • Prototypes of IRD Tuna Atlas and FAO Spread applications as WPS-hadoop services

T9.3 Data Assessment, Harmonization and Certification Facilities

CNR Activities

During May CNR completed development on cube-manager and cube-manager-api components (#1471). A few modifications were brought to the implementation. A few corrective actions and new requirements arised during the implementation of the components. The latter are listed in the following section.

CNR started and completed implementation of tabular-query module for the tabular data system (#1746). This module will be used by tabular data service in order to query data from tables and create materialized views of datasets along with codelist levels.

CNR started also the development of tabular-data-manager service using jax-ws, with the interfaces for import and export facilities. A first version of tabular-data-api has been developed (#1829)

CNR developed a new version of sdmx registry client libraries solving a few bug fixes (#1715) and usability issues (#1741). CNR also updated sdmxsource libs to the latest version (0.9.25).


cube-manager

  • A generic table type was enabled in order to support newly imported tables.
  • Generic metadata support at table and column level. Codelist now supports levels allowing codelists with degenerate levels.
  • In order to support faster joins between codelists and hierarchical codelists we enabled indexing on the related tables columns.
  • Parent-child relationship between tables is now directly supported by cube manager allowing a client to know the history of a table (codelist, dataset, etc.).


sdmx libraries

  • released new components with gCube 2.15: sdmx-registry-client(2.0.0) sdmx-registry-client-gcube(2.0.0) sdmxsource-utils(1.0.0)
  • new wrapper library for sdmxsource beans released in externals repo (sdmxsource-deps 1.2.0)
Personal tools