PubFlow

Test our PubFlow JIRA-plugin demo

Sep 03, 2014

Visit http://maui.se.informatik.uni-kiel.de:48080/jira to test the latest version of our PubFlow JIRA-plugin!

The workflow in our example is the transformation of raw data to a correctly formatted file which can be uploaded to Pangaea, a world data centre for earth and environmental science.

Currently we are testing our plugin together with the KDMI at the GEOMAR Helmholtz Centre for Ocean Research Kiel.

There are two different roles/groups:

  • the scientists, creating a new issues in JIRA, appending the experiment results and committing it to the data managers
  • the data managers, receiving the data from the scientists and working off a predefined workflow in JIRA

 

The workflow contains following steps:

  • The scientist creates a new issue, appends the raw data, adds some meta data as a comment and commits it to the data manager
  • The data manager checks if the data is complete and has not been uploaded to Pangaea yet.
  • The DM imports the data into the local institutional database (OCN [Ocean])
  • The DM prepares the data processing through PubFlow by adding meta information to the issue in predefined fields. for example about the cruise, crew, etc. Afterwards the data manager commits the issue to PubFlow
  • (sub workflow): PubFlow collects the required data from the database (OCN), checks if the data is valid and consistent (e.g. negative measuring values) and generates log comments in case of abnormal data. It scans the quality flags, automatically maps OCN parameter ids to Pangaea parameter ids and generates a file that is correctly formatted for an import do Pangaea.
  • The DM checks the result file and uploads it to Pangaea

 

 

To test our setup you will need the following logins:

login: SampleDataManager , password: datamanager

login: SampleScientist , password: scientist


Note: the SampleDataManager is also in group 'scientists' so basically there is no need to log in as user SampleScientist but feel free to try it!

In the 'PREPARE FOR PUBFLOW'-step it is absolutely nessecary to enter 12013 as 'leg id', otherwise you won't get an result.

The final imported result of leg no. 12013 can be found here: http://doi.pangaea.de/10.1594/PANGAEA.774842

 

New Downloads

Jun 25, 2014

New versions of the ProvenanceArchive and the GraphFramework are ready for downloading.

 

You can find the download links at our "getting the software" page.

PubFlow at TAPP

Jun 16, 2014

PubFlow and the "Start Smart" approach of the KDMT was presented at this years TAPP at the DLR in Cologne. Find the paper an the talk in our documents section.

PubFlow at IPAW

Jun 16, 2014

CAPS the PubFlow Provenance Capturing Framework was presented at IPAW 2014. Find the poster in our documents section.

New Graph Framework screencast

Apr 30, 2014

We created a new screencast to explain the Graph Framework. You find it here.

PubFlow at DLR Provenance Week

Apr 29, 2014

PubFlow will be presented at the DLR provenance week 2014 (http://provenanceweek.dlr.de/) in the context of the TaPP 2014. We will provide more information as soon as the conference schedule is available.

Public test of the “Data Portal German Marine Research” has started

Feb 19, 2014

We are happy to announce open access to the prototype of the “Data Portal German Marine Research”. For the first time a large amount of marine research data sets from nationally operated research platforms and monitoring facilities are made searchable and accessible through a single portal. 
 
The “Data Portal German Marine Research” aims at offering an integrative "one-stop-shop" framework for coherent discovery, visualization, download and dissemination of marine research data (vessels, observatories, alert systems, etc.). The content originates from distinct data and publication repositories offered by German marine research institutions ranging from cruise-related metadata to reports, publications, data (archived and near real time) and data products. 
 
To improve services and content of the prototype we would like to receive your feedback on its potential utility for your research. Please use the data portal according to your requirements and leave your suggestions via our feedback form. 
 
The Data Portal for German Marine Research is a product of the Marine Network for Integrated Data Access (MaNIDA) funded cooperatively by the Helmholtz Association together with the partner institutes.

PubFlow at PubMan Days 2013

Jan 29, 2014

PubFlow was presented (invited Talk) at this years Max Planck PubMan Days.

PubFlow presented at IMDIS 2013

Jan 29, 2014

PubFlow was presented at the International Conference on Marine Data and Information Systems (Talk + Paper) which took place at Lucca (Italia) on September 23-25, 2013.

PubFlow Workshop 2013

Apr 19, 2013

Workshop13

The second PubFlow workshop took place on the 18.4.2013 from 10:30 to 17:00 at the Haus der Wissenschaft in Bremen.

RDA Launch event

Mar 25, 2013

From the 18. to the 20. March 2013 the first plenary meeting of the Research Data Alliance took place in Gothenburg, Sweden.

 

http://rd-alliance.org/

First prototype released

Jun 07, 2012

written by Peer Brauer

Today the first working prototype of the PubFlow framework was released and is now evaluated by the KDMT.

PubFlow presented at SWPM 2012

Jun 06, 2012

written by Peer Brauer

At monday the 28. of may PubFlow and the provenance recording mechanism we currently developing in the context of this project were presented at the SWPM 2012, the Third International Workshop on the role of Semantic Web in Provenance Management. All proceedings of the workshop where pulished by CEUR, you can find a link on the workshop page.