2014.02 Activity Report

From IMarine Wiki

Jump to: navigation, search

Contents

This Activity Report captures the activities performed in February 2014.

This report is organized in two parts:

Progress and Achievements at WP level

WP1: Administrative and Financial Management

WP Leader: ERCIM - Participants: CNR

  • Monthly SB & PEB meeting
  • Complete the Amendment 2: updated DoW with 5 month extension
  • Follow and submit deliverables to EC
  • Complete subcontract with Neafc


N/A


  • Amendment 2 completed and approved by EC
  • Neafc subcontract completion

WP2: Project Management

WP Leader: CNR - Participants: NKUA, FAO

  • Participation in a LifeWatch operational meeting aimed at discussing how gCube might contribute to building an e-infrastructure supporting the corresponding community (3-4.02, Granada);
  • Participation in a meeting of the Italian LifeWatch community dedicated at refining the discussion held in Granada (20.02);
  • Meeting with a representative of LTER (Long Term Ecology Research Network) aimed at presenting gCube and D4Science and to discuss how these two products might contribute to the LTER goals (17.02):
  • Presentation of iMarine to the coordinator of the “Mediterranean Sea Checkpoint”, a project aimed at building a new EMODNET portal that will serve to quality assess, extract the synergies between and identify the gaps of the present monitoring data sets for the entire Mediterranean Sea (28.02);
  • Submission to EUDAT of a proposal for exploiting the B2STAGE and B2SAFE services (replication service and distributed computing facilities);
  • Planning and preparation of the “iMarine data platform for collaboration workshop”;
  • Participation in weekly phone calls dedicated to discuss the sustainability plan activity (19-25.02);
  • Monthly SB meeting (21.02);
  • Monthly PEB meeting (19.02);
  • Day-by-day scientific and technological coordination and supervision.


No major issue to report.


  • Progresses on existing liaisons - new liaisons established;
  • Preparation of the “iMarine data platform for collaboration workshop”;
  • Contribution to the Sustainability Plan activity;
  • Monthly SB meeting;
  • Monthly PEB meeting.

WP3: Governance and Policy Development

WP Leader: FAO - Participants: ERCIM, CNR, NKUA, FORTH, TERRADUE, FIN, UNESCO, CRIA, IRD

In T3.1 mediation

  • FAO prepared the iMarine event
  • Several partners contributed to Business Model Development
  • UNESCO is preparing training and outreach event, also using iMarine sw, seeks advice and assistance from project (CNR)
  • presentation of cotrix to KISAF,
  • presentation of iMarine to IAEA (P.Harris)

In T3.2 Governance

  • FAO legal provided additional comments with the Data and Sharing policy

In T3.3 Harmonization and metadata standards

  • TLO development progressed
  • Chimaera was validated in Mauritius
  • Cotrix was demood in FAO for IT managers and developers
  • UNESCO intends to host TrendyLyzer in Ostend, and started preparations to such effect
  • IRD started describing how R processes can be made available on a WPS server.
    • More than enabling R processes through WPS the goal is to enrich R codes to make a better use of WPS (mapping of data structure, multiple data formats as inputs....).
    • One aim is Enrichment of RDF metadata in WPS outputs.


The major issues faced in the reporting period and the identified corrective actions should be reported here


Mediation;

  • Preparation of event
  • Based on iMarine resources, a COST proposal is evolving

Metadata and Harmonization;

  • Cotrix demonstrated at FAO to a large group of internal IT managers and developers
  • Chimaera validated in Mauritius
  • Validation progress in VME-DB and other products

WP4: Communication, Dissemination and Training

WP Leader: TRUST-IT - Participants: CNR, NKUA, FAO

The WP leader should report here a summary of the activities performed in the reporting period

  • Preparation of the “iMarine data platform for collaboration workshop”:

Agenda definition; Invitations management; Venue & Logistics organisation; Registration management; Liasion with FDI organisers; Event promotions on iSGTW; monthly newsletter "Top Reasons to join us at the "iMarine data platform for collaborations" workshop"

  • Finalisation of the deliverable D4.2 Production of Printed and Multimedia Promotional Material
  • Support to the ICRI event organisation
  • Social networks updates


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP5: iMarine Data e-Infrastructure Deployment and Operation

WP Leader: CERN - Participants: CNR, NKUA, FAO

for T5.1:

CERN was involved in the preparation of the upgrade to gCube 3.0.0 :

  • candidate release deployment on the QA environment 2651, which included the reinstallation from scratch of all the software on the Ecosystem VOVirtual Organization; in order to move to JAVA 7
  • Usage tracker was installed and configured 2679
  • Already some services have ben upgraded to be ready for the demo Workshop, in particular SM and GW 2695
  • Both production portal moved to JAVA 7 in order to install fixes and enhancements for the Workshop.
  • The ActiveMQ server was upgraded to the latest version 2562

In addition support was given for the installation of the Social ISTI infrastructure at CNR as part of the knowledge transfer given the end of CERN contribution to the project.

for T5.2

NKUA Planned and started the decommission procedure for GR-09-UoA site from EGI (started at 2014-02-28). The plan is aiming to have the site decommissioned in 45 days. In addition 2 new VM sin production hosting gCube Indexes for SmartFish and the Smartfish WebApp were deployed.

CNR installed JAVA 7 on each production node and installed a new node to deploy a ServiceProvider.


for T5.3

CERN spotted a problem on the messaging-endpoint library in the case of usage in a tomcat container, cause some threads were not correctly destroyed when stopping the container (2644). The problem affected also other messaging compo and fixes will be released on the next release.

Nagios Plugins for CouchBase and ElasticSearch were deployed on the Nagios instance at CNR 2629, the instances in production have been configured to be monitored.


none


Infrastructure upgrade to gCube 3.0.0 started after a successful deployment on the QA env.

WP6: Virtual Research Environments Deployment and Operation

WP Leader: CNR - Participants: ERCIM, NKUA, FAO, FIN, UNESCO, CRIA, IRD

For Virtual Research Environments Operation:

  • The previously deployed Virtual Research Environments have been maintained in operation;

For resources and tools provision:

  • Cotrix development continued, in particular the activity focused on the integration with “gCube”, e.g. with social facilities and AuthN\AuthZ;
  • Species Name Reconciliation (BiOnym) development continued, 5 conference calls have been organised, user interface has been revised;
  • VME-DB development continued, e.g. bug fixing on FAO, https proxy server in FAO;
  • SPREAD/WPS has been revised, e.g. input data formats include SDMX and GML (not yet deployed in T2 WPS);
  • SmartFish integration continued, e.g. JavaScript has been improved;
  • Statistical Manager has been reinforced with WPS algorithms invocation facilities;
  • IRD has revised the documentation on Tuna Atlas indicators;
  • IRD has analysed the Standard Data Exchage Format (SDEF), a data format for sampling, landings, and effort data from commercial fisheries;

For common interfaces and tools:

  • Workspace has been enhanced, e.g. added VREs shared folder, set permission;
  • Tabular Data has been enhanced, e.g. templates, sharing via workspace, widgets for expressions, widgets for columns;
  • Home Library has been reinforced, e.g. trash "folder", VREs folders management, bug fixing;
  • Statistical Manager portlet has been enhanced, e.g. import DWC-A files, integration of accounting;
  • Users Management has been revised to support the sync with VRE Shared Folder;
  • IRBootstrapper revised for bug fixing;


None


  • Existing VREs have been maintained;
  • The development of community specific tools continued;
  • Statistical Manager has been reinforced to integrate any WPS algorithm;
  • Several portlets have been enhanced;

WP7: Enabling-technology Integration and Distribution

WP Leader: E-IIS - Participants: CNR, NKUA

  • Integration of gCube 3.0.0 continued
  • A total of 23 integration builds have been executed.
  • Up to some point (~end of Feb), a bug in the etics client caused some components to build with java 6
  • Integration and release of gCube 2.17.3 to fix issues with workspace-portlet and workspace-portlet-tree
  • Upgrade of the testing infrastructure to gCube 3.0.0 (ghn, enabling services)
  • Operation and maintenance of the ETICS service.
  • Integration of release issues report completed in the etics web tools
  • NKUA continued to manage the review process of the admin and developer's guides.
    • Developers' guide: 56%
    • Administrator's guide: 50%


  • release of gcube 3.0.0 planned by mid February is still onoing.


  • gCube release 2.17.3

WP8: iMarine Data e-Infrastructure Enabling Technology Development

Completed in October 2013

WP9: Data Management Facilities Development

Completed in January 2014

WP10: Data Consumption Facilities Development

WP Leader: NKUA - Participants: CNR, FORTH, TERRADUE, FAO

During February, in Data Retrieval Facilities task web services of ExecutionEngine, DataTransformation and FullTextIndex have been refactored and turned into RESTful services - platform independent in combination with SmartGears. Due to the transformation of FullTextIndex service from SOAP to REST refactoring in ExecutionEngine, Workflow Search Adaptor and SearchSystem was required. Resource Registry has also been refactored to discover the new type of SerchSystem Service and ExecutionEngine Service. Moreover, the migration of the ResourceRegistry to the new version Datanucleus, in order to be compatible with Java 7, is under testing.

New capabilities of the index have been explored such as query optimization by exploiting native features of elasticsearch. A new parser built with ANTLR is now employed for building elasticsearch queries. Merging of ForwardIndex with the FullTextIndex has been investigated since browsing can be offered also from FullTextIndex. Smartfish indices exploitation from the SearchSystem has been explored by extending the FullTextIndex to support querying with both field names and field IDs.

Towards the realization of an enterprise search, two new data adaptors have been created to deliver content in a homogeneous manner - xml over HTTP. One is for ingesting data from relational databases configured by an input xml file with credentials stored in IS, while the other one is for ingesting data from tree manager.

The construction of the MarineTLO-based warehouse V3+ has evolved. Some of the new features of the warehouse are: exploitation of multiple graph spaces, enhanced access control, support of 3 levels of provenance tracking and improved refreshing capabilities.

During the process of constructing a MarineTLO-based warehouse, particular focus was given on the aspect of quantifying the connectivity of a warehouse. Towards this direction some novel metrics were developed for evaluating the connectivity of a warehouse.

At last, several improvements of the X-Link library were made.


none


Created an ASL tree collection adapter for feeding tc into the DTS

The following components have been released in 3.0.0:

  • Environment Provider libraries
  • Execution Engine libraries and workflow adaptors
  • Resource Registry components
  • gCube Data Transformation Service and ingestion adaptors
  • Index management libraries
  • Search related libraries
  • xSearch portlet

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development

WP Leader: NKUA - Participants: CNR, CERN, E-IIS, FORTH, TERRADUE, FAO

During February, in T11.2, effort was spent on completing the development of the Resource Aware Service libraries. Also, the client library of the RESTful FullTextIndex has been completed has to be tested along with the Resource Aware Service libraries. Furthermore, authoring of the deliverable D11.4 has started. Moreover, several enhancements on the Storage Management portlet have been implemented

In T11.3, effort was spent on the implementation of the XSearch APIs. So far Main Services for matching and enriching an identified entity as well as support services for getting the supported categories of entities, supported algorithms and supported search systems have been implemented.


None


Release of the following components in 3.0.0: org.gcube.search.search-client-library.2-0-0

Progress and Achievements by WP and Beneficiary

WP1: Administrative and Financial Management Monthly Activity By Task and Beneficiary

WP2: Project Management Monthly Activity By Task and Beneficiary

WP3: Governance and Policy Development Monthly Activity By Task and Beneficiary

WP4: Communication, Dissemination and Training Monthly Activity By Task and Beneficiary

WP5: iMarine Data e-Infrastructure Deployment and Operation Monthly Activity By Task and Beneficiary

WP6: Virtual Research Environments Deployment and Operation Monthly Activity By Task and Beneficiary

WP7: Enabling-technology Integration and Distribution Monthly Activity By Task and Beneficiary

WP8: iMarine Data e-Infrastructure Enabling Technology Development Monthly Activity By Task and Beneficiary - Completed in October 2013

WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary - Completed in January 2014

WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development Monthly Activity By Task and Beneficiary

Personal tools