2012.08 WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

From IMarine Wiki

Jump to: navigation, search

Contents

This WP10 Activity Report described the activities performed in August 2012 by Beneficiary and Task.

It is part of August 2012 Monthly Activity Report.

T10.1 Data Retrieval Facilities

NKUA Activities

NKUA has been working in the following directions

  • In updating and enhancing the gCube search service in order to be generalized and follow the project's guidelines the following actions have been made:
    • Java Logger has been replaced with slf4j in SearchSystem, OpenSearch Library and OpenSearch Data Source. This will facilitate the configuration of logging at deployment time and help overcome significant configuration obstacles presented by the standard Java logging environment.
    • The following projects have been moved to Maven: Registry, SearchSystem, SearchSystemService, OpenSearch Data Source, Open Search Library and Index Common Library.
    • SearchSystem and SearchSystemService have been updated in order to be aligned to new environmental hint based interface for resource registry and workflow adaptors.
  • In order to support dynamic configurations for Resource Registry (as discussed in a conference call) the following components have been created : ResourceRegistry-configuration-default, ResourceRegistry-configuration-dts, ResourceRegistry-configuration-execution, ResourceRegistry-configuration-index, ResourceRegistry-configuration-search, ResourceRegistry-configuration-workflow
  • In supporting the activity of XSearch integration with gCube. A conference call was organized in order to plan the activity taking into account the time constraints present until the next gCube minor release. In this conference call the involved partners, NKUA and FORTH discussed some of the suggestions and observations resulting from NKUA's experience using the X-Search portlet and the resolution of remaining issues.


None


  • Transition to maven of a number of components
  • Transition to slf4j of a number of components

FORTH Activities

During M10 FORTH finalized the integration phase between XSearch and gCube search.


none


none

Terradue Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.2 Data Manipulation Facilities

NKUA Activities

During last month, considering the upcoming minor release that will include Data Transformation NKUA has been working on the transition of the corresponding components from ant to maven. This procedure includes four library components and one service. Also, all released components have been refactored to use the slf4j logging facade in order to facilitate the configuration of loggers at deployment time. Future effort will be focused on release integration of the related components.


none


The following components have been transformed to maven and were refactored to replace Java logger with slf4j:

  • DataTransformationService
  • DataTransformationLibrary
  • DataTransformationHandlers
  • DataTransformationPrograms
  • WorkflowDTSAdaptor

CNR Activities

During the month of August CNR mainly worked on the WPS-hadoop framework developed in T9.2. An Hadoop 2.1 cluster was attached and the resampling algorithm by Terradue was run on it. Unfortunately CNR noticed that the yet developed algorithms cannot be parallelized on a cluster as they are, because the algorithms developed so far by Terradue were designed for a single node cluster supplying several users. Effort has been done for publishing a WPS single node server in production environment and for extending the currently available algorithms to the cluster. The first goal has been achieved and released with gCube 2.10.


Further effort will be needed for running the currently supported algorithms on an Hadoop 2.1 cluster.


  • Hadoop cluster 2.1 was attached to the WPS-hadoop framework

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.3 Data Mining and Visualisation Facilities

CNR Activities

CNR continued the work on the Statistical Manager after the distributed computation system was completed. The new improvements added clustering features (DBSCAN, KMEANS) and a message queue for storing the requests coming from the users. The web interface to the service has been designed and the development was started.


No deviations to report.


  • Added clustering features
  • Design of the web interface was finished

NKUA Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

Terradue Activities

Terradue finished to develop the WPSHadoop new algorithm called tiff_uploader, previously presented. This software represents the missing "connector" to a WMS hosted by GeoServer, providing a "visualization" tool to the gCube WPSHadoop framework. Before the end of September we'll delivery this library and update the related wiki page with its documentation.

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.4 Semantic Data Analysis Facilities

FORTH Activities

FORTH worked on the XSearch portlet. The desired functionality is ready and some minor changes (in terms of efficiency and look and feel) has been addressed during this month.


none


none

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

NKUA Activities

NKUA is providing active support for the development and integration of XSearch service / portlet in the gCube platform.


This activity is additional to the ones planned in the DoW.


none to be reported

Personal tools