2012.10 WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

From IMarine Wiki

Jump to: navigation, search

Contents

This WP10 Activity Report described the activities performed in October 2012 by Beneficiary and Task.

It is part of Monthly Activity Report.

T10.1 Data Retrieval Facilities

NKUA Activities

The activities of NKUA included (i) further support and coordination of the integration of XSearch with gCube and (ii) minor bug fixing and enhacements in Resource Registry: Regarding the integration of XSearch with gCube, collaboration with FORTH has continued with some private discussionss. These discussions helped towards addressing issues in the use of gRS2 component.

  • Bug fixes include:
    • Remove of harvesting the deployed packages of a Hosting Node due to the large list of packages that caused fail at bridging, as reported at the ticket #482. (This temporary solution will be replaced with a replacement of the database schema of ResourceRegistry).
    • Load of static configuration resources when field directory is missing.
    • Corrected Generic Resources update during the first iteration.
    • Corrected store of the updated fields using the datastore selected by the plugin.
  • Enhancements include:
    • Harvesting of Tree Manager collections (Not in 2.11.0 release).

Furthermore, NKUA has been investigated an issue reported at the ticket #486 and took the appropriate actions to resolve it.


None


The following components have been released in gCube 2.11.0:

  • ResourceRegistry 1-3-1
  • ResourceRegistry_NODEPS 1-3-1
  • RRGCubeBridge 1-3-1

FORTH Activities

During this month some discussions were initiated regarding the efficiency of gCube search. In particular FORTH identified that ranking was not supported if search was done on top of multiple collections. A related ticket has been opened for organizing the discussions for this topic (#684). Furthermore some discussions were started regarding the efficiency of gCube RSConsumer.


none


none

Terradue Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.2 Data Manipulation Facilities

NKUA Activities

Last month, NKUA has been working on Species Products Discovery integration with Data Transformation in order to export out of the source the desired rowsets for indexing procedure. This task includes the creation of a new DataSource, general enough for every Tree Manager plugin, that models the specific source along with the corresponding XSLTs that are used during transformation process.

The DataSource that will be created is supposed to be as general to handle every Tree Manager collection, but the integration procedure also includes the creation of the corresponding XSLTs that are specific to the plugin's schema.

More specifically, the DataSource is responsible for iterating on trees and passing them to transformers. The transformers are spawned with awareness of the transformation that is going to be used (Workflow adaptor used by the Service orchestrates that), and uses the corresponding XSLTs which are stored as generic resources on IS.


none


A new DataSource has been created

  • TMDataSource

following XSLTs which are applied on every tree transformation are introduced

  • BrokerXSLT_TAXONOMY_anylanguage_to_ftRowset_anylanguage
  • BrokerXSLT_PROVENANCE_anylanguage_to_ftRowset_anylanguage
  • BrokerXSLT_DwC-A_anylanguage_to_ftRowset_anylanguage

following transformation program has been updated (added new transformation unit supporting multiple xslt appliance on single DataElement)

  • FtsRowset_Transformer

the components that have been released are:

  • DataTransformationService
  • DataTransformationLibrary
  • DataTransformationHandlers
  • DataTransformationPrograms
  • WorkflowDTSAdaptor

CNR Activities

No activity was performed during October.


no deviations to report


FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.3 Data Mining and Visualisation Facilities

CNR Activities

CNR has enhanced the algorithms and methods included in the Ecological Engine Library. Furthermore the Statistical Manager has been refactored for future maintenance purposes. A distributed architecture has been adopted also for the requests incoming to the SM. The portlet has been bug fixed and the whole system has been tested by simultaneous users on large computations. The tests have involved also the computation on the D4Science nodes via the Generic Worker plugin. The available algorithms are now: 11 Transducers, 3 Modelers, 3 Evaluators and 7 Distribution Algorithms.


No deviations to Report.


  • Bug fixes of the SM service, portlet and library
  • Enrichment of the algorithms
  • Tests on D4Science via GenericWorker
  • Tests on local computations by simultaneous users

NKUA Activities

Acquisition of community datasets and launch of experimentation. No concrete results delivered.


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

Terradue Activities

We have initiated the analysis of R Spatial as a mean to provide geo-spatial data visualization approaches for raw and aggregated data.


None


None

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

T10.4 Semantic Data Analysis Facilities

FORTH Activities

During this period FORTH worked on making the XSearch components (XSearch-portlet, XSearch-service) more efficient. FORTH had encountered an issue when the results that had to be sent from the XSearhc-portlet to the XSearch-service were more than 50. A related ticket had been opened (#628). This proved to be an issue with the TCPLocator buffer size. FORTH followed the proposed (from NKUA) approach described in ticket #628. Using the current approach the XSearch-portlet establishes a connection with XSearch-service (using the TCPLocator), starts sending results through that communication channel and triggers XSearch-service to start retrieving them. The service is then waiting for the desired number of results (50) and then start analyzing them.

Regarding the XSearch-service FORTH changed the way it is initialized and configured. In particular the service was updated to download at deployment time the required configuration files. This requires no post activities for making the service properly runnable. A related ticket has been opened (#783)


none


The following components has been released:

  • XSearch-Portlet
  • XSearch-Service

FAO Activities

The beneficiary should report here a summary of the activities performed in the reporting period


The beneficiary should report here major issues faced in the reporting period and the identified corrective actions, if any.


The beneficiary should report here a bullet list highlighting the main achievements of the reporting period

Personal tools