• Aucun résultat trouvé

Research Assessment in an Open Science context

N/A
N/A
Protected

Academic year: 2021

Partager "Research Assessment in an Open Science context"

Copied!
23
0
0

Texte intégral

(1)

Panel Session:

Research Assessment

Bernard RENTIER, Chair

Open Science Fair

(2)

Liège University & EUA

Utrecht University

EUA

Open University of Catalonia & EUA Science Eur

(3)

Open Science:

a paradigm shift

Open Scholarly Communication

Open citations

Open Research Data

Open Source Software

Citizen Science

(4)

Why do we assess ?

Resources are scarce (money, time)

Selection is permanently needed

(5)

How do we assess ?

Today mostly on quick proxies (Journal Impact

Factors,…), not enough on content and

advancement of knowledge

Impact of research is a good indicator but it should

be clear which impact, on what and how to

measure it

(6)
(7)

Why should we change ?

Growing distrust and frustration

Quantitative assessment promotes

competitiveness rather than cooperation

(8)
(9)

Why should we change ?

Current evaluation methods

shape researchers in the same mould.

(10)

Why should we change ?

Landscape is changing towards Open

Science, based on exchange and sharing

Assessment should take the OS principles

(11)

Authorship has become an obsolete concept

in fields where contributions abound.

Position (first, last or middle of the pack)

authorship has no evaluation value.

Real acknowledgement of contributing merit

is needed

Why should we change ?

(12)

June 2019 - Hiring conditions

in a prestigious institution...

(13)

Hello, [...]

We work with Scopus and WOS database rating reviews in all areas and guarantee their indexing.

It is possible to publish articles in Scopus Q3 and Q4 magazines by the end of the year and in Scopus Q1 and Q2 magazines for the summer of 2020.

Send your article for a preliminary review response on the timing and cost of publication.

If you don't have your article yet, but publication is required and deadlines are tight, we have a number of articles ready that have already been accepted by the magazines. You can add yourself as a collaborator, you can make your own modifications and suggestions. We translate the translation into English and design the article ourselves.

Write to me your specialty, I will choose topics for co-author. The number of places in future publications is limited.

(14)

Are there alternatives ?

DORA & Leiden Manifesto

Several theoretical paths

(15)

A variety of assessment

contexts

Hiring

Promotions

Awards

Researchers

Teams

Projects

Institutional

support

(equipment,

space,

personnel)

Funding

Publications

(16)
(17)

Assessment must be based on

MULTIPLE CRITERIA

(18)

1. Research output

• Research activity • Publications • Datasets • Open source • Funding

2. Research Process

• Stakeholder engagement/citizen science • Collaboration & interdisciplinarity • Research integrity • Risk management

3. Service & Leadership

• Leadership • Academic standing • Peer review • Networking

4. Research Impact

• Communication & dissemination • IP (patents, licenses) • Societal impact • Knowledge exchange

5. Teaching and

supervision

• Teaching • Mentoring • Supervision

6. Professional

Experience

• Continuing professional development • Project management • Personal qualities

(19)
(20)

OS-CAM, the Career Assessment Matrix

R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching and supervision (++) + ++ ++++ Professional Experience + +++ ++++

(21)

Engineering etc R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching and + ++ ++++ Profession al + +++ ++++ Humanities etc R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching and + ++ ++++ Profession al + +++ ++++

OS-CAM, a customised matrix

Social sciences R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching and supervision + ++ ++++ Professiona l Experience + +++ ++++ Earth Sciences R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching and supervision + ++ ++++ Professional Experience + +++ ++++ Life Sciences R1 R2 R3 R4 Research output + ++ +++ ++++ Research Process + +++ ++++ ++++ Service & Leadership + +++ ++++ Research Impact + ++ +++ ++++ Teaching &

supervision

(++) + ++ ++++ Professional Experience + +++ ++++

(22)

It will be impossible

to implement Open Science harmoniously

without a large, significant and determined consensus

on new ways to evaluate research and researchers.

(23)

E-book freely available at:

Références

Documents relatifs

The Raspberry Pi was the hacking and making board with brains, but the Raspberry Pi 2 takes the formula much further: real- time physics calculations, complex computer vision

Plexus offers a number of good sup- port plans, including a field mainte- nance support program under which Plexus will send a field engineer within four hours of

information on this control register, please obtain the Cirrus Logic revision “M” errata from your Motorola Computer Group sales representative.. This condition will be corrected in

A little time invested now will help you make the most of your conference and will give you the skills necessary to participate in any conference at The University of

Don’t be ashamed, go and see your local nurse or doctor for a check-up if you have any of these symptoms. The earlier breast cancer is found, the greater your chance

• Once you have done this, lie down on your bed or the ground and firmly feel your left breast using the palm of your right hand in a circular motion.. Do the same for your

• We take the opportunity to warmly thank all the members of our team, including Tracy Addis our Bookkeeper and Ian Katte our Accountant, both from UK, Dee Waugh WCET®

At that time the com­ pany, under the direction of Peter Z inovieff, was exploring the possibilities of using mini­ computers to control electronic music instruments.. My job was