2013.12 Activity Report

From IMarine Wiki

Revision as of 16:43, 20 January 2014 by Alex.antoniadi (Talk | contribs)
Jump to: navigation, search

Contents

This Activity Report captures the activities performed in December 2013:

This report is organized in two parts:

Progress and Achievements at WP level

WP1: Administrative and Financial Management

WP Leader: ERCIM - Participants: CNR

The WP leader should report here a summary of the activities performed in the reporting period


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP2: Project Management

WP Leader: CNR - Participants: NKUA, FAO

The WP leader should report here a summary of the activities performed in the reporting period


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP3: Governance and Policy Development

WP Leader: FAO - Participants: ERCIM, CNR, NKUA, FORTH, TERRADUE, FIN, UNESCO, CRIA, IRD

T3.1 Activities User Community Mediation

  • Trendylyzer was promoted at the OBIS steering group meeting and Caribbean Marine Atlas meeting
  • iMarine was present at the FAO project proposal for the GEF funded ABNJ/deep sea project. iMarine infrastructure (and data from OBIS) for the identification of VMEs among other topics.
  • Board operations such as meeting preparations and liaison with individual mebers

T3.2 Activities Governance Mechanisms, Policies and Guidelines Development

  • Continued refining the iMarine policy for data access and sharing
  • continued developing best practices and guidelines
  • Continued contributig to Business Model development (ToR's and workplan)
  • Discussed OBIS data policy and terms of use at the OBIS Steering Group meeting, where iMarine may assist in aligning data and policies.

T3.3 Activities Harmonisation of Metadata, Semantics and Technologies

FAO activities include:

  • BiOnym development
  • VME-DB development
  • Interaction with NEAFC on DataExchange; the components to connect to the NEAFC database, and make the semestral reports available to ICES for further analysis;
  • Liaise with the VME-DB team to facilitate the exchange of data between the iMarine and VME-DB (Oracle) database;
  • Continue development of cotrix.
  • Proposal for StatBase migration (Ticket 2425) (Y.Laurent)

FORTH Activities include

  • Ontological analysis of the iMarine sources (FISHBASE, ECOSCOPE, WoRMS, FLOD and DBpedia) w.r.t. the new requirements #2319
  • Designing and Implementing MarineTLO Version 4.0.0 #2319
  • Extending the design of Mapping and Transformation rules between MarineTLO and iMarine sources #2319

UNESCO activities included:

  • Data preparation for Trendylyzer and discussions with Gianpaolo Coro and Tom Webb on several steps forward to categorizing species according to conservation status
  • Harvesting data form 12 OBIS nodes: OBIS Canada | South Western Pacific OBIS | OBIS-SEAMAP | EurOBIS | OBIS Japan | WSA-OBIS | AntOBIS | AfrOBIS | ArOBIS | MicrOBIS | FishBase OBIS | ESP-OBIS. Currently harmonizing, standardizing, integrating, quality controlling and indexing these data for publication. Lots of new and improved quality data will be available to iMarine by end of December/early January 2014


The major issues faced in the reporting period and the identified corrective actions should be reported here


  • NEAFC Sub-contract details forwarded to ERCIM for preparation
  • VME-DB first test version reviewed

WP4: Communication, Dissemination and Training

WP Leader: TRUST-IT - Participants: CNR, NKUA, FAO

The WP leader should report here a summary of the activities performed in the reporting period

  • Events:
  • The Fifteenth International Conference on Grey Literature, 2-3 December, 2013 Bratislava, Slovak Republic The iMarine poster "A Social Networking Research Environment for Scientific Data Sharing: The D4Science Offering" has been presented. The social portal facilities have been presented to a new community.
  • NKUA gave an iMarine presentation @ SEMAGROW and agINFRA stakeholder meeting, Dec. 12, at NCSR "Demokritos"
  • Courses on the iMarine e-infrastructure for students in France

5-6 / 12-13 December, 2013-Paris, France: The first course took place on 5-6 December 2013 at the UPMC - Sorbonne Université in Paris. The 4 lessons, each lasting three hours, focus on “Using the iMarine infrastructure: In Theory and In Practice”.

The second course took place the following week, 12-13 December 2013 at the Observatoire Océanologique de Villefranche sur mer, Villefranche sur mer: “Using the iMarine infrastructure: In Theory and In Practice” with 2 lessons, each lasting 6 hours. Both courses are part of the Master in Océanographie Environnements Marins (OEM).

Overall 66 students will be trained by Gianpaolo Coro, CNR-ISTI on e-Infrastructures for biodiversity data, niche modelling, taxa matching, management of biodiversity data heterogeneity, habitat analysis.

  • iMarine March event: agenda finalisation, invitation message creation & dispatch, participant list identification, online registration creation, event webpage creation
  • Contact with GBIF to add the iMarine e-Training material in the GBIF website.
  • iMarine Christmas Card creation
  • iMarine participation to the Biodiversity Data Integration IG RDA working group. Nicolas Bailly and Yde de Jong are chairs of the group. N. Bailly is more in charge to gather ideas and suggestions to reduce the scattering of efforts on Biodiversity Information Systems, in particular for names.So iMarine developments are of interest, and will be used and cited. https://www.rd-alliance.org/internal-groups/biodiversity-data-integration-ig.html


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP5: iMarine Data e-Infrastructure Deployment and Operation

WP Leader: CERN - Participants: CNR, NKUA, FAO, FIN

T5.1 Activities

CERN was coordinating and performing the infrastructure upgrade to gCube 2.17.0 at the beginning of the month(2337)

In addition the QA infra has been then upgrade to gCube 2.17.1 (2469) and the production was also upgraded to 2.17.1 before the holidays.

Some activity related to JAVA 7 integration were performed:

T5.2 Activities

CNR

  • keeping up and running the provided nodes hosting development, testing and production GHNs, UMD and project management services.
  • new OBIS db node to load Unesco data
  • Two new server, one for production, one for development, for the upgraded version of StatBase
  • New Xen servers added to the HW infrastructures, completing the resources with more 80 cpu, 384 GB RAM, 8 TB DISK

NKUA

  • Maintenance of the provided nodes hosting GHNs, UMD and the gcube wiki.
  • Planning upgrade to UMD-3 and installation of Argus.

T5.3 Activities

CERN integrated the portal accounting probe into a WebApp, in order to remove the portal dependency to an external GHN (2215). In the context of this task a new version of the messaging producer gCF free has been developed.

A first version of a Nagios plugin to test Search availability has been developed and deployed on the production Nagios instance. It uses ASL HTTP API to run periodically search queries and check the correctness of results. (2450)


  • CNR recovered data from backup of mongodb server, because a user deleted a full iMarine shared folder, due to a bug (now fixed).


  • Infrastructure upgrade to gCube 2.17.0 and 2.17.1

WP6: Virtual Research Environments Deployment and Operation

WP Leader: CNR - Participants: ERCIM, NKUA, FAO, FIN, UNESCO, CRIA, IRD

For Virtual Research Environments Operation:

  • The BiodiversityLab VRE has been created to support University courses on Species Distribution Modelling;
  • The previously deployed Virtual Research Environments have been maintained in operation;

For resources and tools provision:

  • Cotrix development continued, e.g. completed the permission module, added support for emails;
  • VME-DB development continued, Reports Store Gateway enhancements;
  • Species Name Reconciliation (Bionym) development continued, e.g. YASMEEN enhancements;
  • The RFigisGeo package has been released and its integration in WPS planned;
  • FIGIS species layers revised to support random styles;
  • OAI-PMH support (OAI-TM plugin + Harvester) has been revised, e.g. automatic cardinality update facility removed;

For common interfaces and tools:

  • A lot of Tabular Data Widget have been developed, e.g. Task Widget;
  • Workspace has been enhanced with History filtering facility;
  • Report Management has been reinforced by supporting a "drop down list" component;
  • Home Library has been reinforced by bug fixing, e.g. lack of ‘shared with’ details in subfolders;
  • Users Management Portlet has been reinforced by bug fixing, e.g. resolved an issue with multiple acceptance;
  • Bootstrapper portlet has been enhanced, e.g. added more information on submitted jobs, support indices update tasks;


None


  • A new VRE - BiodiversityLab - has been created;
  • Existing VREs have been maintained;
  • A number of portlets have been reinforced;

WP7: Enabling-technology Integration and Distribution

WP Leader: E-IIS - Participants: CNR, NKUA

The WP leader should report here a summary of the activities performed in the reporting period


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP8: iMarine Data e-Infrastructure Enabling Technology Development

WP Leader: CNR - Participants: NKUA, E-IIS, FAO

Completed in October 2013.

WP9: Data Management Facilities Development

WP Leader: CNR - Participants: NKUA, CERN, TERRADUE, FAO

The WP leader should report here a summary of the activities performed in the reporting period


The major issues faced in the reporting period and the identified corrective actions should be reported here


The WP leader should report here a bullet list highlighting the main achievements of the reporting period

WP10: Data Consumption Facilities Development

WP Leader: NKUA - Participants: CNR, FORTH, TERRADUE, FAO

During the month of December, in T10.1, the new Resource Accounting framework has been integrated with PE2ng. In the context of Enterprise/Federated Search, the design of supporting external datasources has been completed. Furthermore, Opensearch collection have been harmonized with the rest of the exploited resource, as it has been transformed to GenericResource with DataSource type. ForwardIndexNode and SearchSystemService has been updated to change their status to FAILED upon Resource Registry initialization failure. At last, various bugs have been fixed and two more wiki pages have been reviewed and validated.

In T10.2, the gCube Data Transformation Service is being expanded to include one more data source supporting data in xml format transferred over HTTP protocol.

In T10.3, BiOnym procedure has been adjusted to enhance the performance. Furthermore, the problem of finding an automatic definition of Common Species was addressed, where the focus moved to threatened\unthreatened species. On the Service side, Statistical Manager is being updated in order to be able to import of generic files, where a text file or a Darwin Core Archive file can be uploaded into the system. Activities also concentrated on enhancements of the service, in registering external databases, adjusting tooltips and managing the presence of a single SM in two VOs. Finally, the SM portlet was transformed into a widget.

In T10.4, the construction of a new warehouse which stores the contents coming from different sources is ongoing to separate graphspaces. Moreover it computes various quality metrics for evaluating the warehouse and allows to incrementally refresh it. An issue in the communication between xsearch-service and the SPARQL endpoint of the warehouse has been resolved. At last, bug fixing in xsearch-portlet took place.


none


  • Integration with new Resource Accounting Framework.
  • The SM can correctly manage its presence in several VOs.
  • Release of the following components in 2.17.1:
    • org.gcube.execution.RRModel.1-5-1
    • org.gcube.execution.MadgikCommons.1-5-0--1
    • org.gcube.index-management.elasticsearch-gcube.1-2-1
    • org.gcube.portlets-user.xsearch-portlet.1-1-2
    • xsearch-service.1-1-2

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development

WP Leader: NKUA - Participants: CNR, CERN, E-IIS, FORTH, TERRADUE, FAO During December, in T11.2, effort was spent on implementing a library that enables persistant logging for the executed jobs in the gCube system as part of the ASL.

In T11.3 effort was spent on completing the integration of the ASL with the Personalization Client Libraries. Also, the design of the XSearch APIs has continued.


None


None

Progress and Achievements by WP and Beneficiary

WP1: Administrative and Financial Management Monthly Activity By Task and Beneficiary

WP2: Project Management Monthly Activity By Task and Beneficiary

WP3: Governance and Policy Development Monthly Activity By Task and Beneficiary

WP4: Communication, Dissemination and Training Monthly Activity By Task and Beneficiary

WP5: iMarine Data e-Infrastructure Deployment and Operation Monthly Activity By Task and Beneficiary

WP6: Virtual Research Environments Deployment and Operation Monthly Activity By Task and Beneficiary

WP7: Enabling-technology Integration and Distribution Monthly Activity By Task and Beneficiary

WP8: iMarine Data e-Infrastructure Enabling Technology Development Monthly Activity By Task and Beneficiary - Completed in October 2013

WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development Monthly Activity By Task and Beneficiary

Personal tools