AJPH
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ellis, J. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ellis, J. A.
Related Collections
Right arrow Writing/Reviewing/Publishing
April 2003, Vol 93, No. 4 | American Journal of Public Health 533-535
© 2003 American Public Health Association


EDITORIAL

Why Should I Review a Paper for the American Journal of Public Health?

Jennifer A. Ellis, MPhil

The author is with the Harlem Health Promotion Center, Mailman School of Public Health, Columbia University, New York, NY, and is technical deputy editor at the Journal.

Correspondence: Requests for reprints should be sent to Jennifer A. Ellis, MPhil, Harlem Health Promotion Center, Mailman School of Public Health of Columbia University, 600 W 168th St, New York, NY 10032 (e-mail: jae33{at}columbia.edu).


    INTRODUCTION
 TOP
 INTRODUCTION
 "I DON’T KNOW WHAT...
 "I’VE READ THE PAPER,...
 A FINAL WORD ABOUT...
 
The importance of reviewers to the American Journal of Public Health publication process cannot be underestimated. Without our reviewers, the Journal would not only be worse off but would actually fail to exist as the quality vehicle for dissemination of public health information that it strives to be. As editors, we are proud to read submissions and screen them for validity and contribution, but we rely heavily on the expertise of reviewers for their precise comments and critical responses that maintain the Journal’s quality and significance.

The past year has brought many exciting changes for the Journal, including the hiring of new editorial and production staff and, most notably, the unveiling of a new Web-based electronic submission system. These changes have inspired considerable conversation among the editorial staff about the value of our review process and, of course, the value of our reviewers.

Because we have the utmost appreciation for our reviewers, we have made it a priority to provide as much support and guidance as they would like. As part of our commitment to the process, we have developed reviewer recommendations to make the job of the reviewer easier and more efficient. Because one person’s ease and efficiency is another’s headache, these guidelines and recommendations come with an invitation to read the following once, 10 times, or not at all—indeed, these are simply guidelines for those who want them, not rules carved into stone.

Of course, no list is complete without the requisite caveats, and the reviewer recommendations are no exception. The following recommendations represent 2 sets of thoughts about the reviewer’s role: the rules we depend on and the exceptions we make to these rules. Our reviewers should know that no guidelines are inflexible, and the ultimate goal of disseminating quality work that furthers the field of public health is never sacrificed for rigidity or bureaucracy. We aim to keep this overall goal in sight every time we read a submission. We hope that these reviewer recommendations will empower reviewers to be part of the Journal’s contribution to the larger public health community and discourse.


    "I DON’T KNOW WHAT TO LOOK FOR": REVIEWER RECOMMENDATIONS
 TOP
 INTRODUCTION
 "I DON’T KNOW WHAT...
 "I’VE READ THE PAPER,...
 A FINAL WORD ABOUT...
 
1. One world, global health. The theme of the American Public Health Association 2001 annual meeting provides important lessons for the review process. In order to move the public health world forward, we want to be sure that we publish papers that are read by diverse audiences. As such, we encourage study findings that are appropriate for the general public health audience. Of course, the "rule" of nonrigidity applies here as well, so specialized findings are not excluded out of hand, but it is helpful if they are framed in a way that allows an array of audiences to appreciate their significant contribution to advancing public health.

2. Preliminary, exploratory, underfunded, or pilot studies (i.e., generally neglected work). As researchers and practitioners, many of us begin our work with preliminary studies. We lovingly refer to these projects as pilot studies, exploratory studies, or underfunded studies, all of which yield preliminary results about a particular population or issue. Without these important studies, it would be difficult to move forward with work that has traditionally been marginalized. By providing a forum in which these types of studies can be disseminated, we hope to contribute to a process that is continually expanding and growing and makes room for its underattended areas. These preliminary studies are considered for briefs. Although these studies provide preliminary findings, we strive to ensure that our publication standards remain rigorous and address key elements of the research process: for example, high response rates, relevant findings, and testable hypotheses. It is essential that these studies highlight innovative methods or findings, illustrate a new direction for public health, or address a group that is generally underserved.

3. Reviewing for different formats. We see the Journal as a vehicle for disseminating original research and practice. In order to provide a diversity of formats, we have instituted or evolved a variety of departments. Although we consistently apply rigorous standards, different departments have different goals and criteria of which reviewers need to be aware.

4. Research and Practice? Practice and Research? What’s the point? Although different editors approach the first reading of a paper differently, one way to quickly evaluate the overall aim of a paper is to read the Conclusions section of the abstract. This section is key because it concisely shows the reader the paper’s contribution to our overall goal of disseminating quality work that furthers the field of public health. Well-stated conclusions have an accurate interpretation of the results that clearly shows the contribution to public health. If nothing else, our work must provide us with a clear understanding of "real world" implications.

5. Not to be too formulaic, but . . . The validity of a study is almost always strengthened by a high response rate. We prefer to publish studies with response rates that are over 65%. Because of the importance of the response rate in ensuring high validity and lending a context of generalizability, it is nearly impossible for the Journal to publish a paper that does not state the response rate, preferably in the Results section. Cohort or prospective studies, in addition to needing a strong response rate, also need to demonstrate a high follow-up or low attrition rate.

6. Who is this again? As stated earlier, a high response rate is essential, but generalizable findings are also key. If a sample is not generalizable, it is critical to give a justification or explanation of why the research is important despite its lack of external validity. The main caveat within this guideline is that undersampled or "hidden" populations may profit from unconventional study designs.

7. A meritorious Methods section. If reviewers are satisfied that the potential conclusions of the presented research meet the goals of the Journal, rigorous review of a paper should focus on the Methods section. The explanation of methods used to conduct the study should be clear and complete as well as concise and must be able to stand on its own without substantive reference to other published works. Referring to previously published studies that give full explanation of the methodology of the study is useful for careful documentation, but reviewers should look for papers that allow a critical review of the methods without referring elsewhere. Simply put, reviewers should be extremely particular in the review of the methods section.

8. Approaching inevitable threats to validity. Every study has limitations. Every reviewer has walked the difficult line between the ideal study design and execution, and what is feasible in the real world. We encourage a frank discussion of the threats to validity in every study, and we encourage our reviewers to use these discussions as tools so they can place the study in a context of what is already known. The tendency to tally limitations can be resisted—our reviewers should generally be comfortable evaluating the limitations of a study as substantive or nonsubstantive.


    "I’VE READ THE PAPER, NOW WHAT DO I DO?": PASSING ALONG INPUT
 TOP
 INTRODUCTION
 "I DON’T KNOW WHAT...
 "I’VE READ THE PAPER,...
 A FINAL WORD ABOUT...
 
When a reviewer is ready to pass along thoughts about a paper, the Journal’s on-line system (at http://submit.ajph.org) asks for 2 categories of information: (1) a rating of the paper, overall and in several categories, from 1 to 4 (1 = outstanding, 2 = solid, 3 = marginal, 4 = poor) and (2) general comments for the author or editor. Many authors tell us how valuable the reviewer comments are. If the reviewer believes the paper is deserving of publication in the Journal, it is extremely helpful if the reviewer gives the authors detailed comments for strengthening the paper. It is not always easy for reviewers to appreciate the fruits of their detailed reviews, particularly for papers that are not revised and eventually accepted for the Journal. For the most part, authors use these reviews to improve their papers for submission to another peer-reviewed publication.

There are circumstances in which reviewers read a paper and do not think it deserves publication in the Journal, even with extensive revision. In this case, we trust reviewers to use their time efficiently and inform the editors of the key shortcomings.


    A FINAL WORD ABOUT COMMUNITY
 TOP
 INTRODUCTION
 "I DON’T KNOW WHAT...
 "I’VE READ THE PAPER,...
 A FINAL WORD ABOUT...
 
At the Journal, we are committed to the concept of a public health community. The peerreview process allows us to see our work as a means of creating strong ties and strengthening discourse within the public health community. We encourage authors to nominate qualified reviewers for their papers; we encourage reviewers to submit manuscripts; we regularly solicit editorials and commentaries from the public health community; and we publish a variety of viewpoints about our published work in the Letters to the Editor section. As members of a public health community, we all struggle to prioritize our time and to create ways in which we can further our collective work while contributing to a larger process. Peer reviewing for the Journal can be 1 method through which public health professionals are a part of the process of highlighting innovative strategies in the world of public health, promoting discussion of public health issues, and bringing our collective work to the attention of a larger social and political arena. We welcome contributions from our community on how we can make the peer review process more meaningful and more efficient, and we hope that these recommendations further these goals.


    Acknowledgments
 
The author thanks Kenneth R. McLeroy, PhD, Amy Bleakley, MPH, and Mary E. Northridge, PhD, MPH for their thoughtful editorial comments on this manuscript.

Accepted for publication November 8, 2002.





This Article
Right arrow Extract Freely available
Right arrow Full Text (PDF)
Right arrow Submit a response
Right arrow Purchase Article
Right arrow View Shopping Cart
Right arrow Alert me when this article is cited
Right arrow Alert me when eLetters are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ellis, J. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Ellis, J. A.
Related Collections
Right arrow Writing/Reviewing/Publishing


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
Copyright © 2003 by the American Public Health Association