2013.11 WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

From IMarine Wiki

Jump to: navigation, search

Contents

This WP9 Activity Report described the activities performed in November 2013 by Beneficiary and Task.

It is part of November Monthly Activity Report

T9.1 Data Access and Storage Facilities

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

CNR Activities

CNR has performed the following activities:

Storage Manager v 2.0.3

Implementation of a new version of "lock" and "unlock" operations for locking and unlocking a remote objects. The scope is to allow multiple users to work simultaneously on the same remote object


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T9.2 Data Transfer Facilities

CERN Activities

Continued to enhance the Storage Management portlet (1985):

  • on the right side there are now also the Upload and URI options (symmetric with left side)
  • it is possible to copy files to Workspace.
  • it is possible to create directories and delete elements from Workspace.
  • it is possible to copy directories to MongoDB (from MongoDB and Workspace).


none


none

NKUA Activities

The activities of NKUA included:

  • WikiDoc Validation:
    • The wiki pages: "Developer's Guide: gRS2 Broker" (1974) have been reviewed and validated.


None


None

Terradue Activities

  • Test with 52 North SOS server on Terradue's infra, and study use of O&M for the data Model (con'd)


  • None


T9.3 Data Assessment, Harmonization and Certification Facilities

CNR Activities

Tabular Data:

  • A GWT module that allows the GWT javascript translation of tabular data model classes (contained in tabular-model artifact) has been created. This module can be effectively used in GWT portlet development in order to reuse data model classes in client applications (#2366). tabular-model had to be slightly modified in the process.
  • Modified operation-api module (module for pluggable operation development). Added the capability for a worker to declare a FallBack worker. Fallback worker mechanism can be leveraged in order to execute validations whenever a transformation worker fails.
  • Developed several pluggable operations for the tabular data service:
    • Table type transformation: e.g. allows to change a table from the generic type to the codelist type, hence applying a different policy on data management (like column indexing)
    • Column type transformation: allows to change the column type (e.g.: from attribute to code name) and the column data type (e.g.: from text to date). Created several validation operations that manages data type casting.
    • Row duplicate validation: validation that exposes duplicate tuples in a table (2348)
    • Duplicate row remover: transformation that automatically removes duplicate tuples leaving only one instance of those tuples (2348).
    • Time Dimension transformation: Developed a transformation that allows to build time dimension codelist from a table with a column with text values. Text values should represent a time period with relaxed ISO8601 format: a date, a month, a quarter, a year. The transformation automatically creates a time dimension codelist with the provided table values and enrich those values with several dimension levels (e.g.: for dates it creates the month, quarter, year, decade, isoweek, isoyear additional levels. These levels are useful as they can be used for aggregation with tools like Mondrian. Developed validation that return applicability of the aforementioned transformation on a given target table (#1225) for each tuple.
    • Dimension management transformation: transformation that allows to link values in a given table column to tuples of a codelist table. Tuples linking can be based on any Code or CodeName column of the target table. Developed validation that returns values which cannot be linked to the targeted codelist.
  • Written documentation wiki pages on Cube Manager and Tabular Data system.

Legacy components:

  • Solved issues with legacy timeseries portlets that occurred in the deployment environment (production platform) during gCube 2.17 integration phase. The problem affected the timeseries portlet and the charts portlet and was related to a class loading issue caused by missing libraries on the common tomcat classpath.


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

Personal tools