2013.07 Activity Report

From IMarine Wiki

Jump to: navigation, search

Contents

This Activity Report captures the activities performed in July 2013

This report is organized in two parts:

Progress and Achievements at WP level

WP1: Administrative and Financial Management

WP Leader: ERCIM - Participants: CNR

  • SB teleconference call participation and minutes taking
  • Subcontract with Edward signed and first payment made
  • Monitor and submit of the due deliverables and milestone achievement statements
  • Prepare second periodic review
  • Prepare General Assembly meeting
  • Collect contributions from partners for Periodic Report 2:
    • Effort report received: CNR,CERN, NKUA, FORTH, FAO, FIN,
    • Explanation of the use of resources received: CNR, CERN, FORTH, FAO, FIN
    • Form C received: CNR, CERN, FORTH, FAO, FIN,
    • Work packages: WP3, WP5, WP7, WP8, WP9, WP10, WP11


N/A


  • Subcontract with Edward signed and first payment made

WP2: Project Management

WP Leader: CNR - Participants: NKUA, FAO

  • Organization and chairing of the monthly Steering Board conference call (15.07 and 17.07) and revision of the minutes prepared by ERCIM;
  • Organization, chairing and preparation of the minutes of the Monthly PEB conference call (22.07);
  • Second project review planning: finalization of the review the Agenda;
  • Organization of first review rehearsals;
  • Periodic Activity Report preparation;
  • Planning of the EMODNET- iMarine meeting;
  • Initial discussion with partners for a possible extension of the project duration;
  • Day-by-day supervision and monitoring of the scientific and technical activities;
  • Contribution to the finalization of the ToC of a White Paper on iMarine sustainability;
  • Update of D2.4 "Risk Analysis and Risk Response": inclusion of the analysis of risks and countermeasures applied during the 2nd period of the project;
  • Update of D2.5 "Report on inter-projects coordination and collaboration": reorganization of the on-line document, reporting of the progresses and inclusion of new collaborations;
  • iMarine shared workspace operation and maintenance;
  • Participation of the TD in a series of WP specific calls dedicated to the coordination of different activities.


No major deviations


  • Steering Board and PEB conference calls;
  • Review planning and initial rehearsals;
  • Revision and update of D2.4 and D2.5;

WP3: Governance and Policy Development

WP Leader: FAO - Participants: ERCIM, CNR, NKUA, FORTH, TERRADUE, FIN, UNESCO, CRIA, IRD

All WP participants and tasks contributed to the review preparation, when needed.

In T3.1;

  • Revision of Board Work-Plan;
  • Preliminary meetings with NEAFC, GOLD and TBTI representatives to draft collaboration plans

In T3.2;

  • the iMarine data access and sharing policy was submitted for review by experts in the FAO legal office.
  • Revision of wiki pages started in preparation for the review.

In T3.3 activities continued on:

  • Cotrix code-list management; development of connectors to legacy code-repositories (RDBMS and SDMX based)
  • SmartFish was proposed as an infrastructure resource
  • The Country/Flagstate - EEZ mapping Java procedure was improved
  • The VALID validation of fishing data was analysed with DPMA
  • The VME-DB activity was initiated; a database synchronization with the reporting service
  • Collecting feedback to continue the design/implementation/testing of the new release (Version 2.0.0) of the TLO: #1603
  • Building the Version 2.0.0 of the MarineTLO based Warehouse #1932
  • Exploiting the Version 2.0.0 of the MarineTLO based Warehouse through the use of X-search and FactSheetsgenerator. Formulation and Testing of a set of competency queries #2050
  • Investigating on the set of competency queries and dataset to be able to set up the Tuna Atlas use case #1451
  • Collecting feedback and new domain requirements to continue the design/implementation/testing of a new release (Version 3.0.0) of the MarineTLO: #2046
  • Preparation of the documentation of the MarineTLO #1764


The major issues faced in the reporting period and the identified corrective actions should be reported here


  • reports on VALID
  • First species reconciliation JAR
  • The version 2.0.0 of the MarineTLO ontology in OWL

WP4: Communication, Dissemination and Training

WP Leader: TRUST-IT - Participants: CNR, NKUA, FAO

The WP leader should report here a summary of the activities performed in the reporting period


  • WP4 risks identification


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP5: iMarine Data e-Infrastructure Deployment and Operation

WP Leader: CERN - Participants: CNR, NKUA, FAO, FIN

Activities in T5.1:

CERN was involved in the infrastructure upgrade to gCube 2.16:

  • QA infra upgrade 1999
  • Infra upgrade plan preparation 2000
  • GHN upgrade scripts 1998

FactSheet plugin for TM was deployed and instantiated in the gCubeApps VOVirtual Organization; , the generated collection has then been indexed in production. (2051)

A new version of the GHN distribution has been released in gCube 2.16 in order to drop CM dependencies (1891)

Activities in T5.2:

NKUA completed the installation of the Virtuoso system.(http://virtuoso.i-marine.d4science.org:8890/)

CNR, NKUA and FAO has been keeping up and running the provided nodes hosting development, testing and production GHNs, UMD and project management services.

CNR VOMS upgraded to EMI3 version 2038 and VOMS admin interface restored [1]

Activities in T5.3:

A new server for the installation of the Gangia Server for the D4Science infrastructure has been setup. The Ganglia server (1990) has been configured in collaboration with CNR and is available at

https://ganglia.d4science.org/ganglia/

In addition the Messaging producer was released in gCube 2.16 in order to remove the creation of Topic Connections (1926)


None


WP6: Virtual Research Environments Deployment and Operation

WP Leader: CNR - Participants: ERCIM, NKUA, FAO, FIN, UNESCO, CRIA, IRD

For Virtual Research Environments Operation:

  • the previously deployed Virtual Research Environments have been maintained in operation;
  • Deployment of two new VREs: iSearch and TBTI;

For resources and tools provision:

  • Species Name Reconciliation Service development continued;
  • Cotrix Development continued;
  • SPD plug-ins have been revised to support a retry mechanism;
  • TM plug-ins have been revised to resolve some issues;
  • Tuna Atlas revised to be compliant with TLO;

For common interfaces and tools:

  • A lot of portlets was enhanced by adding new features and removing bugs: namely News feed, Messages, Calendar, Reports management, Workspace, GeoExplorer, Species Products Discovery, FullText Index, Forward Index, Collections Navigator, Result Portlet;
  • Home Library was reinforced to support public links and history tracking;
  • Trendylyzer portlet was finalised;


  • No report from ERCIM, FIN, UNESCO, CRIA


  • Existing VREs have been maintained;
  • Deployment of two new VREs: iSearch and TBTI;
  • Completion of D6.4 Virtual Research Environments Activity Report;
  • Release of new portlets (Trendylyzer) and revised portlet in gCube 2.16.0;

WP7: Enabling-technology Integration and Distribution

WP Leader: E-IIS - Participants: CNR, NKUA

  • finalization of deliverable D7.3 "Software Release Activity Report" after minor comments from SC.
  • gCube 2.16.0 released on 30th July. In total for this release 20 integration builds and 40 integration issues have been identified and managed through Trac system.
  • gCube Distribution site updated for 2.16.0 release by inserting the corresponding entry in the database. The news for the release of gCube 2.16.0 have been published and are available on the iMarine website.
  • Documentation validation process has been started. Tickets concerning the validation of the Developer's Guide have been issued, following the reformation of the developer's guide structure.
  • Operation of the ETICS service.


nothing to report


  • deliverable D7.3 "Software Release Activity Report" completed.
  • release of gCube 2.16.0

WP8: iMarine Data e-Infrastructure Enabling Technology Development

WP Leader: CNR - Participants: NKUA, E-IIS, FAO

T8.1:

  • Produced a common schema for the representation of relational database resources on the IS along with a java client library that allows to retrieve those resources.
  • continued the development of the first versions of common-smartgears and common-events, the two new components for management of servlet containers and their application as as gCube resources
  • Bugfixing activity and minor changes on infrastructure components (from both the old stack and new FWS): common-gcore-stubs, gcf, common-gcore-resources.

T8.2:

  • Continued effort on completing security integration on portal side and the integration of SAML Identity Federation with Registration and Login Portlets
  • Continued development of accounting library
  • Continued implementation of accounting portlet

T8.3:

  • Modified implementation of Workflow Engine Service and Execution Engine Service in order to leverage gCube Messaging library
  • Refactorings and removal of obsolete components related to Workflow management area.


None to report.


Components were released in gCube 2.16:

T8.1:

  • database-resource: library that allows to query for relational database resources on the IS.

T8.3:

  • Execution Engine Service
  • Workflow Engine Service
  • WorkflowDTSAdaptor
  • Resource Registry
  • RRModel
  • resourceregistry-configuration-index
  • resourceregistry-configuration-search

WP9: Data Management Facilities Development

WP Leader: CNR - Participants: NKUA, CERN, TERRADUE, FAO

In T9.1:

CNR worked on the Species Discovery Service, in particular they added the UNFOLD functionality in the SPQL service and enhanced the performance of the service by introducing retries and failure management.

On the Storage Manager side, CNR implemented features for remote directories management. The client libraries now allow to copy or move a remote directory.

In T9.2:

CERN released a major version of the Data Transfer facilities in gCube 2.16. This release involves the integration with the TreeManager to perform tree object transfers. Modifications involved all the submodules of the Transfer Agent, that is: the Agent Service, the Scheduler Service and the Scheduler portlet.

In T9.3:

CNR enhanced the tabular data query module to support filtering on data. With this enhancement the tabular data query module now supports pagination, ordering, filtering, JSON output format.

Alpha versions of some components of the new Tabular Data framework have been prepared for the gCube 2.16 release, which involve the Tabular Data resource model. This is a module that manages tables residing on a PostgreSQL DB (Cube Manager), in particular it manages the table and column metadata and their persistence on a backend. Other components manage the creation/deletion operations on a PostgreSQL DB backend (Component of Tabular Data).

CNR also fixed bugs on the current Timeseries and Codelist management portlets:


no deviations to report.


  • the UNFOLD operation was added on SPQL
  • major enhancements of the Data Transfer facilities
  • release of alpha versions of the Tabular Data framework components

WP10: Data Consumption Facilities Development

WP Leader: NKUA - Participants: CNR, FORTH, TERRADUE, FAO

In T10.1, few steps towards Federated Search realisation have been made. A client for consuming SRU datasources and an adapter for relational database are ongoing. The activities also include various bug fixes, like supporting “or” operation and providing snippets in OpenSearch. Investigation on using Oozie to drive hadoop streaming jobs in the context on the environmental reconciliation with R and WCS SST daily data.

In T10.2, the activities mostly focused in releasing Data Transformation components.

In T10.3, the basic features of the Trendylyzer system were finalized and released. On the other side, experiments were performed in the Length-Weight Estimate and the final procedure was released. Also, the Maps Comparison facility was released.

Furthermore, Interactive Layers component was released with visualisations’ appearance enhanced and the behaviour of which is determined during initialisation.

In T10.4, the implemented mechanism for exploiting several xSearch-service instances was tested. Moreover, the xSearch portlet was improved in terms of look-&-feel. Among others the required changes were made to show the search results using TabPanels, homogenizing this way the presentation of results in results-portlet and xSearch-portlet.


none


The following component has been released in 2.16.0:

  • Data Fusion operator
  • Data Transformation
  • Trendylyzer (basic) system
  • Maps Comparison
  • InteractiveLayers
  • xSearch-service and xSearch-portlet

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development

WP Leader: NKUA - Participants: CNR, CERN, E-IIS, FORTH, TERRADUE, FAO

During July, in T11.2, effort was spent on developing a new version of CLs for the Data Transfer Agent and Scheduler.

In T11.3, effort was spent on enhancements on the Application Support Layer on search and browsing results presentation. Also, the ASL search was refactored to get the available search services through the new FeatherWeight stack. Furthermore, Resource Registry integration with the FeatherWeight Stack has been continued to testing phase.


None


The following components have been released in gCube 2.16.0:

  • data-transfer.agent-library.2-0-0
  • data-transfer.scheduler-library.2-0-0
  • application-support-layer-core.3-4-0
  • application-support-layer-search.4-1-0
  • application-support-layer-content.5-1-0
  • application-support-layer-http-content-access.1-0-3

Progress and Achievements by WP and Beneficiary

WP1: Administrative and Financial Management Monthly Activity By Task and Beneficiary

WP2: Project Management Monthly Activity By Task and Beneficiary

WP3: Governance and Policy Development Monthly Activity By Task and Beneficiary

WP4: Communication, Dissemination and Training Monthly Activity By Task and Beneficiary

WP5: iMarine Data e-Infrastructure Deployment and Operation Monthly Activity By Task and Beneficiary

WP6: Virtual Research Environments Deployment and Operation Monthly Activity By Task and Beneficiary

WP7: Enabling-technology Integration and Distribution Monthly Activity By Task and Beneficiary

WP8: iMarine Data e-Infrastructure Enabling Technology Development Monthly Activity By Task and Beneficiary

WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development Monthly Activity By Task and Beneficiary

Personal tools