Introduction

For many years I have been a practicing librarian and writer. At the beginning of my career I helped start a journal, served on its editorial board, and worked with my colleagues to develop journal policies. Over time and as my research evolved, it became clear to me that most librarians and other early career professionals in academia have not had adequate training to consider peer review in scholarly publishing. Just what should peer review do? Who is involved? Why is it important? How does one approach it as a reviewer?

Often peoples’ first foray into peer review is when they must submit writing to a peer-reviewed journal, or when they are asked to provide a review for a manuscript. How does one prepare to take on that task? In this open educational resource, Peer Review: A Critical Primer and Practical Course, I have developed a series of eight learning modules that address the training and learning gaps I have identified in my personal experience and through my research regarding peer review.

The eight modules offered ask you to engage in a variety of learning activities. You may be asked to read, listen, watch, think aloud, write, and engage in other activities that are all designed for them to explore peer review from their own experiences and come to their own conclusions. This course attempts to engage you with active learning in each of the modules. The course is scaffolded, and there are activities in the later modules that ask you to refer back to their work in previous modules. All materials in this course have been curated from items freely available on the web, which are also all cited for further reference.

Course Objectives

This course aims to offer anyone taking it the following:

  • An overview of what peer review is, who the actors are, and its position in the scholarly communication landscape
  • An observation and identification of the positives and negatives of opaque and open peer review implementations, as well as the challenges presented by peer review to each of the actors in the process
  • The opportunity to critically examine peer-review implementations
  • The opportunity to create and express one’s personal values for a peer-review practice and connect that practice to their profession
  • The opportunity to practice providing peer review

Course Outline and Learning Outcomes

Module 1: What is Peer Review?

This module presents the basics, and positions you to dig more deeply into peer review.

By the end of the module you should be able to:

  • Summarize a basic peer-review process
  • Identify your personal knowledge gaps with peer review
  • Discover new information about peer review
  • Examine your own understandings of the peer-review process

Module 2: Opportunities and Challenges in Peer Review

This module goes a bit deeper into issues inherent to contemporary peer-review practices and processes.

By the end of the module you should be able to:

  • Identify positive aspects of, and problems with, peer review
  • Consider ethical dimensions of the peer-review process
  • Interpret peer-review challenges and compose reactions to them

Module 3: Bias and Power Structures in Peer Review

This module asks you to begin examining bias and power structures, including your own.

By the end of the module you should be able to:

  • Examine personal bias(es)
  • Explore how bias can manifest in peer review
  • Identify policies intended to mitigate bias
  • Identify and analyze bias and power structures in peer-review systems

Module 4: Critically Examining Established Peer-Review Practices

This module expands upon the concepts and exercises covered in Module 3, and deepens the examination of bias and power structures. You are asked to examine peer-review practices with a lens of criticality.

By the end of this module you should be able to:

  • Identify concepts and practices that reinforce bias and power structures in peer review
  • Examine peer-review systems for bias and imbalances of power
  • Identify established anti-bias practices
  • Develop strategies for eliminating bias in peer-review systems

Module 5: Innovations in Peer Review

This module allows you to discover innovations in peer review, asking you to use your own creativity to innovate and imagine the future for peer review.

By the end of this module you should be able to:

  • Recognize basic online systems used for peer review
  • Consider the ethical implications that technology has on peer review
  • Discover recent peer-review innovations
  • Evaluate innovations for their potential to implement opportunities and diminish challenges presented by traditional peer-review systems

Module 6: Librarians and Peer Review

This module is specifically for library workers and library students. It uncovers themes particular to the field of library and information science as well as the practices of our professional community.

By the end of this module you should be able to:

  • Identify peer-review practices in LIS literature
  • Outline librarians’ roles in peer review, both as scholars and as educators
  • Illustrate peer-review challenges and opportunities specific to LIS

Module 7: Developing Peer-Review Norms, Guidelines, and Expectations for LIS (or Your Discipline)

This module can be specific to library and information science (LIS) workers and students, but it is also applicable to other disciplines. It is a module that mostly requests students to complete activities based on the knowledge they have gained in the first 6 modules.

By the end of this module you should be able to:

  • Define the role of peer review in LIS/your discipline
  • Develop a rubric for referees to do peer review based on its purpose
  • Develop a policy document for peer-review workflows and decision making

Module 8: Developing Your Peer-Review Practice

This final module also asks you to engage in peer review as a reviewer.

By the end of this module you should be able to:

  • Articulate your positionality and values in relation to peer review
  • Professionally evaluate a work in your field using your positionality and guiding values

How to Use This OER

This OER could be used as a self-paced course for anyone interested in discovering peer-review processes. It could also be used by instructors in Library and Information Science programs, librarians, or other educators who want to offer students lessons in the peer-review process.

Each module offers a brief introduction and reiterates its learning outcomes. It then offers Activities and Exercises, which are structured to be completed in the order they are presented. Activities are coded with easy-to-identify icons, and are numbered according to module and activity number. For example, the first activity in Module 1, Free Write, is numbered 1:1. Some of the activities ask you to refer back to previous activities. In those instances, the numbered activity is provided.

Icon of an open book Read: for written content

Icon of a play buttonWatch: for visual content

Icon of an ear and a soundwaveListen: for audio content

Icon of a pencilDo: for active learning exercises

Finally, each module provides a list of references for the readings and other content.

You will be producing materials during this course. Since modules request you to use content they have created from previous lessons, I recommend that you create an organizational system where they keep all content related to this course. Because this learning will ask you to reflect, it may also be helpful to you to keep a handwritten journal or a running journal document for your reflections and thoughts as you progress through the course. In addition to saving your work, consider sharing what you have done and your thoughts via social media using the course hashtag: #PeerReviewPrimer. Some activities request that you make and share social media posts. Remember these are all suggestions intended to create community engagement; if you do not want to post to social media that is fine; the content and exercises will still be helpful, and hopefully fun!

Offering Feedback

Anyone using these materials is invited to provide feedback to its creator, Emily Ford. I can be reached at forder@pdx.edu, and I welcome feedback via email and also invite you to set up a time for a phone call to discuss the course or anything related to it. I also invite you to use the course hashtag #PeerReviewPrimer while engaging in its activities and share your thoughts on social media.

Upon completing the course you will be asked to complete a course evaluation, after which you will receive a certificate as evidence of your completion of the course.

License

Icon for the Creative Commons Attribution-ShareAlike 4.0 International License

Peer Review: A Critical Primer and Practical Course Copyright © 2022 by Emily Ford is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License, except where otherwise noted.

Share This Book