2013.08 Activity Report

From IMarine Wiki

Jump to: navigation, search

Contents

This Activity Report captures the activities performed in August 2013.

This report is organized in two parts:

Progress and Achievements at WP level

WP1: Administrative and Financial Management

WP Leader: ERCIM - Participants: CNR

The WP leader should report here a summary of the activities performed in the reporting period


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP2: Project Management

WP Leader: CNR - Participants: NKUA, FAO

  • Finalization of the Scientific part of the Periodic Activity Report;
  • Review Rehearsal sessions (22.09 - 28.09 - 30.09)
  • Liaison with the Lifewatch project representatives for the organization of a joint workshop at the 2nd EUDAT conference (http://www.eudat.eu/eudat-2nd-conference-workshops);
  • Provision of a proposal for the iMarine participation to Milan World expo 2015;
  • iMarine shared workspace operation and maintenance.


No major issue.


  • Periodic Activity Report delivered to the Commission;
  • Planned joint LifeWatch -iMarine workshop.

WP3: Governance and Policy Development

WP Leader: FAO - Participants: ERCIM, CNR, NKUA, FORTH, TERRADUE, FIN, UNESCO, CRIA, IRD

T3.1

  • Prepare for meetings; review, EMODNET, and Board
  • Prepare NEAFC Subcontract

T3.2

  • iMarine Policy Document on Data Access and Sharing edited and submitted for review to FAO legal office.

T3.3

FORTH

  • Continued collecting feedback and new domain requirements to continue the design/implementation/testing of a new release (Version 3.0.0) of the MarineTLO: #2046
  • Continued preparing the documentation of the MarineTLO #1764
  • Extended the design and the implementation of the MarineTLO #2046
  • Extended the Mapping and Transformation rules from imarine data source to MarineTLO and testing the forthcoming outcomes #2046
  • Documentation of the process of constructing MarineTLO-based Warehouse #1848

IRD

Semantics

  • Work on slides about ConnectCube for the review in Brussels
  • first discussion about introducing entities related to fishing vessels in TLO.

Geospatial cluster:

  • improving the genericity of processes by introducing new input parameters enabling the mapping for different structure (semantic of columns labels). This should validating by running processes with FAO datasets
  • grouping IRD indicators in a R package.

The major issues faced in the reporting period and the identified corrective actions should be reported here


  • iMarine Policy Document on Data Access and Sharing edited and submitted for review to FAO legal office.

WP4: Communication, Dissemination and Training

WP Leader: TRUST-IT - Participants: CNR, NKUA, FAO

The WP leader should report here a summary of the activities performed in the reporting period

  • Preparation of the special issue article for the iSGTW "Surfing marine data wave". Joint effort between CNR, FAO and Trust-IT Services.
  • Provision of the "Indexing data" e-training video by NKUA and upload in the Infrastructure management facilities section.
  • Creation of a new graphical identity for the new iMarine website: the new website will be more service-oriented
  • 2nd Review preparation: WP4 presentation preparation by TRUST-IT (Integrating partners comments)
  • 2 Rehearsal meetings: 1 August 2013 & 22 August 2013 to finalise the review ppt.


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP5: iMarine Data e-Infrastructure Deployment and Operation

WP Leader: CERN - Participants: CNR, NKUA, FAO, FIN

for T5.1

The iSearch VRE was deployed in production on both iMarine and D4Science.og portals (1190)

CERN was also involved in the investigation of some incident tickets after the upgrade to gCube 2.16.1 ( some of the issues were integrated in 2.16.1 in September)

In addition CERN renamed the geoservers GHNs (2069)

Effort was also spent for the preparation of the talk for the iMarine review after a first rehealsal in July.

for T5.2

CNR, NKUA and FAO has been keeping up and running the provided nodes hosting development, testing and production GHNs, UMD and project management services.

CNR deployed a new server for the Smartfish prototype 2060 and new VMs for Couchbase services in production.

for T5.3

No activities


none


  • the iSearch VRE is available in production.

WP6: Virtual Research Environments Deployment and Operation

WP Leader: CNR - Participants: ERCIM, NKUA, FAO, FIN, UNESCO, CRIA, IRD

For Virtual Research Environments Operation:

  • the previously deployed Virtual Research Environments have been maintained in operation;

For resources and tools provision:

  • Species Name Reconciliation Service development continued;
  • Cotrix Development continued;
  • IRD processes have been enhanced and included in a R Package;

For common interfaces and tools:

  • no major activity was reported


  • No report from ERCIM, FIN, UNESCO, CRIA


  • Existing VREs have been maintained;

WP7: Enabling-technology Integration and Distribution

WP Leader: E-IIS - Participants: CNR, NKUA

nothing to report


nothing to report


nothing to report

WP8: iMarine Data e-Infrastructure Enabling Technology Development

WP Leader: CNR - Participants: NKUA, E-IIS, FAO

T8.1:

  • Continued development on common-smartgears: suite of components that allows to build gCube services capable to run in external containers.
  • Minor modification common-events: a lightweight eventing library to be used in the new gCube service stack.
  • Applied several modifications to common-gcore-resources that improved the robustness of serialization/deserialization

T8.2:

  • completed the implementation of the common-accounting library and updated wiki
  • completed the implementation of the accounting portlet and updated wiki
  • created a wiki documentation of the overall resource accounting solution.

T8.3:

  • WorkflowHiveQLAdaptor implementation has progressed. In more details, Parser, Planner and Optimizer are now ready, while Workflow Engine adaptor is under development.


None to report


None to report

WP9: Data Management Facilities Development

WP Leader: CNR - Participants: NKUA, CERN, TERRADUE, FAO

In T9.1 no activity was performed by the participants

In T9.2:

A new developer (Michal Simon) was assigned by CERN to the iMarine project in the context of this task. He has started working on the Storage Management portlet.

In T9.3: CNR worked on the Tabular Data framework, where some components were refactored to achieve greater extensibility. In particular the Time dimension was added to the data model.

CNR designed a strategy to handle the time dimension through the creation of dimension tables on the fly. Several time dimension tables will be available, one for each supported time granule (gregorian day, month, quarter). Each table will present several other levels containing data automatically generated by the system. This design will allow for more efficient implementation of analyses procedures. Dates will be represented in the ISO8601 format.

CNR also developed SQL scripts that handle the creation of tables and relationships. They also implemented procedures that allow to import SDMX codelists in a table.


no deviations to report.


  • design of the management of the temporal dimensions in tabular data
  • design and development of SQL scripts for tables creation and relationships definitions
  • import of SDMX codelists

WP10: Data Consumption Facilities Development

WP Leader: NKUA - Participants: CNR, FORTH, TERRADUE, FAO

In T10.1, mainly bug fixing took place regarding a problem that caused failure while searching in all collections and an encoding problem in opensearch results. Work was placed on the geospatialy driven Oozie workflow to create time-series of daily SST for species occurences. The dbscan algorithm was used to identify spatial clusters (R implementation). These clusters are then converted into bounding boxes used to extract SST chunks of data from the WCS data stores.

In T10.2, there was no major activity to report.

In T10.3, the Trendylyzer activities moved towards the problem to define "common species" by means of Statistical Analysis. A formula was proposed to estimate the degree of commonness for a species and planned to test the formula by means of different data mining methods. On the other side, other experiments about Lenght-Weight Relationship estimate were performed on a new dataset provided by Rainer Froese with significant compared improvements in time. The result was compared to the sequential one and validated by R. Froese. Further tests were made to assess the reliability of the distributed computational facility in the Statistical Manager. Finally, there was involvement in the problem of "Stock Biomass Spawning vs Recuitments Production”, which is a hard modelling problem.

In T10.4, a first version of X-Link library was developed, which is responsible for analyzing the contents of any documents and link them with semantic information.


none


  • Definition of a formula to estimate the commonness of a species
  • Production of new results for LWR
  • Involvement in the SSB vs Recruits problem
  • First implementation of X-Link
  • Prototype of the Oozie worflow and Map/Reduce Streaming scripts for the SST enrichment of species occurences

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development

WP Leader: NKUA - Participants: CNR, CERN, E-IIS, FORTH, TERRADUE, FAO

During August, in T11.2, effort was spent on testing the integration of the security library.

In T11.3, effort was spent on making ASL Core, ASL Content and ASL Search compliant with the new FeatherWeight stack. Also, personalization services integration with FeatherWeight stack has been started.


None


None

Progress and Achievements by WP and Beneficiary

WP1: Administrative and Financial Management Monthly Activity By Task and Beneficiary

WP2: Project Management Monthly Activity By Task and Beneficiary

WP3: Governance and Policy Development Monthly Activity By Task and Beneficiary

WP4: Communication, Dissemination and Training Monthly Activity By Task and Beneficiary

WP5: iMarine Data e-Infrastructure Deployment and Operation Monthly Activity By Task and Beneficiary

WP6: Virtual Research Environments Deployment and Operation Monthly Activity By Task and Beneficiary

WP7: Enabling-technology Integration and Distribution Monthly Activity By Task and Beneficiary

WP8: iMarine Data e-Infrastructure Enabling Technology Development Monthly Activity By Task and Beneficiary

WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development Monthly Activity By Task and Beneficiary

Personal tools