2012.11 Activity Report

From IMarine Wiki

Jump to: navigation, search

Contents

This Activity Report captures the activities performed in xxx

This report is organized in two parts:

Progress and Achievements at WP level

WP1: Administrative and Financial Management

WP Leader: ERCIM - Participants: CNR

  • Participated to the 1st review in Brussels
  • Collected signed original Form Cs from partners to send to EC
  • Followed up effort contribution from partners for M11-M12 (September - October)
  • Proceeded with 2nd advance payment for the remaining partners: CRIA, FIN, TERRADUE
  • Followed and submitted deliverables and milestones
  • Studied sub-contract procedure


N/A


  • 2nd advance payment completed for the whole consortium
  • Cost claim of P1 approved by EC
  • All signed original Form Cs for period 1 sent to EC

WP2: Project Management

WP Leader: CNR - Participants: NKUA, FAO

  • Organization and chairing of the final review rehearsal;
  • Participation in the project first project review;
  • Finalization of the October activity report:
  • Organization and chairing of the monthly SB meeting which was held in three successive telcos (16-23-26 November 2012);
  • Validation and approval of the SB meeting minutes;
  • Preliminary discussion on the MoU to be signed with Catalogue of Life.
  • Meeting with Erina+( 11 November) and preparation of the contributes to the Erina+ questionnaire;
  • Telco CNR-Forth to discuss semantic activities planning (20 November);
  • Definition, implementation, and communication of the new procedure for technical activities planning and reporting.
  • Participation in in telcos to plan and prioritize specific technical activities.
  • Participation as iMarine delegate in the Marine and Sub-Marine Infrastructures symposium (MSI) 13-15 November 2012, Toulon, France;
  • Liaising with the RDA initiative.


N/A


  • Final review rehearsal;
  • Participation in the project first project review;
  • Finalization of the October activity report:
  • SB meeting which was held in three successive telcos (16-23-26 November 2012);
  • Meeting with Erina+( 11 November) and contributes to the Erina+ questionnaire;
  • Definition, implementation, and communication of the new procedure for technical activities planning and reporting.
  • Participation in in telcos to plan and prioritize specific technical activities.
  • Participation as iMarine delegate in the Marine and Sub-Marine Infrastructures symposium (MSI) 13-15 November 2012, Toulon, France;
  • Liaising with the RDA initiative.

WP3: Governance and Policy Development

WP Leader: FAO - Participants: ERCIM, CNR, NKUA, FORTH, TERRADUE, FIN, UNESCO, CRIA, IRD

In the reporting period, the WP performed activities in:

  • Review, participation to the annual review in Brussels;
  • Mediation; with VocBench and FishFinder group, AppliFish;
  • Harmonization; continued data content in FLOD, alignment of Cotrix design with vocBench, Geospatial data export from FAO SDI as layers, and metadata to a geonetwork node, collaboration with IRD on geospattial and statistical data alignment, Technology watch on WPS for R and IDL processings with IRD, FAO and Terradue;
  • Validation of VRE's, with effort from CRIA, FIN, FAO, IOC/Unesco staff.


Organizing the validation effort was difficult without clear compartmentalized resources to validate. The diffuse boundaries of both EA-CoP and e-Infrastructure will always remain a challenge, as they confound the scope of the validation effort. In addition, the activities in P1 were often beyond user validation reach, such as the lower level data access and discovery components.

Improvements to the iMarine Board work-plan, with better definition of EA-CoP requirements can now be made, as the major structures have been established for data access and discovery. Validation can now focus on refinement and enhancements in the EA-CoP data management area.

The Milestone MS15, reporting on the Meeting of iMarine Board, could not yet be produced, as the closure date for comments was not yet reached.


This WP activities resulted in

  • A positive review
  • D3.4; the validation report
  • MS9; Definition of Policy and governance development model
  • A meeting agenda for the December Semantic cluster meeting in Sete (On TLO) between FORTH, FAO, and IRD (Mainly task 10.4)
  • A meeting agenda for the Geospatial and Tuna Atlas requirements between IRD and FAO in Sete.
  • An agreement with the VocBench team to extend their platform to include CLM, with export to ICIS etc. through e.g. SKOS and SDMX.
  • An agreement with the FishFinder group to use the reporting tools of iMarine, and assess the potential of an off-line reporting tool.

WP4: Communication, Dissemination and Training

WP Leader: TRUST-IT - Participants: CNR, NKUA, FAO

- Review preparation & participation to the annual review in Brussels;

- Preparation of the action plan to answer reviewers requests mainly on user engagement & training

- Publication of iMarine video & written interview of Neil Holdsworth, Head of Data and Information, International Council for the Exploration of the Sea (ICES);

- Three iMarine Board members and representatives, Marc Taconet (FAO), Ingrid Bergeret (MEDDE), and Isabelle Terrier (IRD), were present as observers at the Mediterranean Regional Database Meeting held in Rome on the 28-29 November 2012

- Update of the iMarine Board expert page on the channel http://www.i-marine.eu/Content/About.aspx?id=6518b08c-dda1-4612-974e-0a180c6f8151&category=0_1000000_1030000_1030100

- Website revision: new structure definition to give more evidence to the iMarine pillars: iMarine Services, iMarine Gateway, iMarine Board experts, the e-infrastructure, the CoP

- Mobile & Web app finalization (Valdation phase within iMarine communities)

- Publication of the 1st year achievements press release

- 100 new contacts on linkedIN

- November Newsletter


The major issues faced in the reporting period and the identified corrective actions should be reported here


- iMarine databse integration with over 100 contacts from iMarine LinkedIN profile

- Retweet of the ENM webpage by Ward Appeltans (almost 800 contacts in few hours)

- Press clippings of the iMArine first year press release. The press release has been published on:

Cordis Wire http://cordis.europa.eu/wire/index.cfm?fuseaction=article.Detail&rcn=32987&rev=0

ISGTW http://www.isgtw.org/announcement/imarine-e-infrastructure-integrating-technologies-unlock-knowledge-marine-living-resour

WP5: iMarine Data e-Infrastructure Deployment and Operation

WP Leader: CERN - Participants: CNR, NKUA, FAO, FIN

For T5.1:

for T5.2:

  • NKUA has been keeping up and running the provided nodes hosting GHNs, UMD and the gcube wiki. Any issues and tickets have been resolved immediately.
  • FAO  : production node kept operational

For T5.3


  • CNR No activity reported despite the known contribution in the WP.
  • FIN No activity to be reported. Still no server availability in GEOMAR for the moment.


Successfully presented the WP5 activities during the first project review meeting

WP6: Virtual Research Environments Deployment and Operation

WP Leader: CNR - Participants: ERCIM, NKUA, FAO, FIN, UNESCO, CRIA, IRD

The previously deployed Virtual Research Environments have been maintained in operation (e.g. requests for subscriptions have been evaluated and either approved or rejected). Moreover, in cooperation with WP3 team, the activity leading to the validation of the existing Virtual Research Environments have been performed.

For resources and tools provision:

  • FIN started documenting the taxamatch algorithm;
  • IRD started implementing WPS processes (in particular, a demo one based on R code). Moreover, they revised Ecoscope in order to accommodate the comments raised during the project review (e.g. download of RDF data, usage of proper URIs for RDF models);

For common interfaces and tools, the following facilities has been revised:

  • Social Portal, Social Data Sharing implementation #865
    • a number of portlets has been developed including Share Updates portlet (to enable the publication of "news"), News Feed portlet (to view news and act on them), MyVREs Portlet (to provide users with the list of VREs they are subscribed only).
    • as a consequence the gCube Login Portlet has been revised to nicely fit with the new paradigm;
  • Workspace Portlet and Workspace Light Tree have both been enhanced to support the "resource link items" objects;
  • Species Products Discovery Portlet has been enhanced to revise the mechanisms for production of checklists and occurrence points by supporting tasks;
  • GeoServerInterface and GeoExplorer has been reinforced to enable the publishing of geo-images (for this the GeoServerInterface has been integrated with the data transfer facilities);
  • UsersManagement and RolesManagement portlets has been enhanced wrt the email support (#879, #540);
  • GCubeSearch library component is developed and is available as a maven component. This library provides a simple API for logging in to the system, submitting search queries and retrieve related content.
  • An android application is available for searching through the gCube system. The application now offers also a UI for submitting advanced search queries (#836);


Apart from the technical activities (T6.3) there is a very limited usage of the TRAC tickets to plan and document activity related with resources and tools provision (T6.2). The lack of this is preventing any planning / actual integration with the risk to develop technologies that will be very difficult to use in the iMarine infrastructure.


  • Deployed VREs have been maintained;
  • an initial set of portlets introducing social facilities has been developed and deployed in devportal;
  • a number of portlets has been reinforced (e.g. Workspace, Species Products Discovery, Geo-*, User Management);

WP7: Enabling-technology Integration and Distribution

WP Leader: E-IIS - Participants: CNR, NKUA

  • Integration of gCube 2.11.0 has been finalized in this period. In total, 20 full integration builds have been executed plus some partial builds.
  • During deployment of gCube 2.11.0 an issue with artifacts uploaded in gCube Releases has been identified. It derives from the release policy that skip release in case the artifact has been released in previous releases. In collaboration with CERN and FAO a solution has been identified based on append gCube version to artifact's versions for each release.
  • E-ISS updated Mavenizer and Maven proxy tools to solve issue described above. They will be used starting from gCube 2.12.0


None to report


  • gCube 2.11.0

WP8: iMarine Data e-Infrastructure Enabling Technology Development

WP Leader: CNR - Participants: NKUA, E-IIS, FAO

In T8.1:

FAO and CNR lunched a new initiative called FeatherWeight Stack (FWS). It is the response to the aim to further simplify the connection to the infrastructure by external clients. FWS is a set of gCube components that enable interaction with gCube services. It is very small in terms of code, dependencies, and overall usage requirements. CNR contributed to the new FeatherWeight Stack (FWS) by implementing the required support to abstract on the gCube Resource Model. FAO leaded the activity and contributed to FWS by providing the required implementation (i) to exploit JAX-WS proxies to call remote gCore services, (ii) to instruct the proxies to generate scoped gCube calls, (iii) to define a gCore-independent and IC-independent framework for query formulation and submission, (iv) to customise the query formulation and submission mechanisms of discovery-client to the IC. Details on motivations and components are available here: https://gcube.wiki.gcube-system.org/gcube/index.php/Featherweight_Stack.

In T8.2:

ENG worked on the integration of the gCube Portal (Liferay) with an Identity Provider (Shibboleth IdP) to enable the web browser SSO. The integration has been completed and testing on the E-IIS testbed is currently undergoing.

In T8.3:

NKUA defined and an evaluation procedure of the PE2ng performance and clearly defined enhancements of the PE2ng framework to support compliance to Map-Reduce / Master-Worker and to support the identification of the nodes participating to the process by performing a selection based on the libraries that the hosting node contains.

In T8.4

There are no activities to report.


Nothing to report


  • common-gcore-stubs (#854)
  • common-gcore-resources (#847)
  • discovery-client (#855)
  • ic-client (#856)

WP9: Data Management Facilities Development

In T9.1:

FAO has worked on the "trees" and "tree-repository" software to solve bugs. FAO has also added a new distribution artefact to the tree-repository, with classifier standalone.

CNR has improved the framework to support Species Discovery Service plugins. CNR has also worked on improving the related Client Library to support job submission.

In T9.2:

CERN has implemented File Transfer to data storages. In particular they have tested transfer to FTP servers. CERN has enhanced the Data Transfer libraries to account for post-processing activities and transfer progress monitoring. A transfer scheduler has been implemented which supports Storage Manager. Finally a first version of a portlet including the above features has been developed.

In T9.3:

CNR has worked on the SDMX registry. They have laid out the architecture of the gCube SDMX dissemination system in terms of components, interaction and interfaces. A SDMX Registry client library has been implemented. It can be used to submit and retrieve structural metadata to/from Metadata Technology Fusion Registry. A REST web service exposes data available coming from the Timeseries gCube Service in SDMX format. CNR has started also the development of a client library for SDMX Datasources and of a SDMX publisher library. These will account for publishing data coming from the Timeseries Service. CNR has worked also on the Tabular Data Widget which has been changed to support to Maven.


No corrections to report.


  • Enhancements in the SPD Client Library
  • Enhancements in the Data Transfer
  • Development of a SDMX Registry Client Library

WP10: Data Consumption Facilities Development

WP Leader: NKUA - Participants: CNR, FORTH, TERRADUE, FAO

During November, in T10.1 there has been a redesign from the custom management of fulltext index towards integration with ElasticSearch, which provides a distributed and scalable solution. Some minor bugs have been fixed related to Resource Registry and Index. Discussions have started concerning snippets mechanism and search ranking.

In T10.2, an implementation of a client library for Data Transformation Service has been completed, based on client-library framework. More specifically, Data Transformation Service API is exposed to the client, while hiding probably frustrating complexity from the client side.

In T10.3, Statistical Manager has been redesigned to deal with more complex inputs and outputs. Moreover, some algorithms for general purpose modelling have been introduced. In particular Feed Forward Neural Networks have been implemented to perform simulation of real valued functions. Algebraic operations, introduced in previous months, have been bug fixed and set up for distributed computations. In the Ecological Engine Library some design operations have been performed in order to figure out how to manage the time dimension.

Furthermore, R application has been integrated as a legacy application on the WPS-hadoop framework using the streaming approach. Especially, the application takes a GML file of fishery data in order to produce a graph.

In T10.4, work has been done on some minor improvements on the xsearch-service component. Further discussions continued regarding the ability of searching over multiple collections. Also, there is an ongoing planning regarding the development of a web application (as a proof-of-concept) that will use ASL-HTTP API.


none


  • Bug fixes are included in the maintenance release of gCube 2.11.1
  • Implementation of client library dts-gcore-client-lib
  • Refactoring of the SM service and library for complex inputs and outputs management
  • Implementation and deploy of Feed Forward Neural Networks for simulating real valued functions
  • Design of distributed computations for Occurrence points analysis
  • R simple application integrated as a WPS process

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development

During November, work in WP11 has progressed in all three tasks. In T11.1, the testing of the common-security-library of the Interoperability framework has started, with the authentication feature being fully tested and the testing of gCube Security Handler for the SOA3/gCube integration being in progress. Moreover, several bugs have been fixed in common-gcore-clients that prepared it for the release of gCF 1.6.0, and were included in gCube 2.11.1 release.

In T11.2 a new version of the Data Transfer Agent CL has been implemented in order to perform enhances in File Transfer to data storages, improve transfer monitoring, add transfer options in Post-processing data. A new version of the DataTransfer Scheduler Service CL has also been implemented with fixes and enhancements for the implementation of transfers to the Storage Manager.

In T11.3, the implementation of the client library for Data Transformation Service has been completed and the implementation of a client library for submitting jobs over the JDL adaptor of the execution engine has started.


none


  • dts-gcore-client-lib implementation

Progress and Achievements by WP and Beneficiary

WP1: Administrative and Financial Management Monthly Activity By Task and Beneficiary

WP2: Project Management Monthly Activity By Task and Beneficiary

WP3: Governance and Policy Development Monthly Activity By Task and Beneficiary

WP4: Communication, Dissemination and Training Monthly Activity By Task and Beneficiary

WP5: iMarine Data e-Infrastructure Deployment and Operation Monthly Activity By Task and Beneficiary

WP6: Virtual Research Environments Deployment and Operation Monthly Activity By Task and Beneficiary

WP7: Enabling-technology Integration and Distribution Monthly Activity By Task and Beneficiary

WP8: iMarine Data e-Infrastructure Enabling Technology Development Monthly Activity By Task and Beneficiary

WP9: Data Management Facilities Development Monthly Activity By Task and Beneficiary

WP10: Data Consumption Facilities Development Monthly Activity By Task and Beneficiary

WP11: Data e-Infrastructures Integration and Interoperability Facilities Development Monthly Activity By Task and Beneficiary

Personal tools