ro2019

Logo

Workshop on Research Objects 2019

View the Project on GitHub ResearchObject/ro2019

Peer Review of RO-5

Review 1

Quality of Writing

Is the text easy to follow? Are core concepts defined or referenced? Is it clear what is the author’s contribution?

The article is clear an easy to understand.

Research Object / Zenodo

URL for a Research Object or Zenodo record provided?   Guidelines followed?   Open format (e.g. HTML)?   Sufficient metadata, e.g. links to software?   Some form of Data Package provided?   Add text below if you need to clarify your score.

I didn’t see a reference to Zenodo with the article packaged, but it does link to a zenodo example. https://zenodo.org/record/2641314#.XTop35MzbOQ

Overall evaluation

Please provide a brief review, including a justification for your scores. Both score and review text are required.

This is a clear, well written article which describes the use of Research Objects in the Whole Tale system which allows for publishing of re-runnable, well-described objects. It covers the design well and discusses implementation issues.

I would have liked a little more detail on how users can run the system locally but given that the focus is on the packaging format that is OK.

There is one MAJOR issue - the references are all showing up for me in the PDF as [?] though they are numbered in the reference section at the end.

Review 2

Quality of Writing

Is the text easy to follow? Are core concepts defined or referenced? Is it clear what is the author’s contribution?

Good writing. Would prefer more detail on the scenario over some of the abstraction in the requirements section.

Research Object / Zenodo

URL for a Research Object or Zenodo record provided?   Guidelines followed?   Open format (e.g. HTML)?   Sufficient metadata, e.g. links to software?   Some form of Data Package provided?   Add text below if you need to clarify your score.

Zenodo with HTML and example of format

Overall evaluation

Please provide a brief review, including a justification for your scores. Both score and review text are required.

This paper provides some nice details about how Research Objects are being explored in a particular platform (Whole Tale), and how the BagIt serialization is being used.

I think RO-Crate discussions will be informed by this experience. The paper has some interesting discussion points, but I felt that the scenario described in Section II could be better woven through the rest of the paper.

Specifically, the requirements and discussion are more abstract and harder to understand because they are not grounded in the scenario.