Journal Reading: How to Effectively Read and Review Research Articles
Table of Contents
Prologue
“Journal reading” – the practice of reading and evaluating scholarly articles – often raises questions. Why would reading scientific papers need to be taught as a separate skill, even as a course at the doctoral level? In reality, the fundamental act of reading a journal article is not inherently difficult. However, formal training in this skill exists for the sake of standardization. Standardization ensures that undergraduate, master’s, and doctoral students and researchers develop a consistent level of competence in analyzing literature, following common processes from input (selecting sources) to output (synthesizing insights). Every university and publisher has its own writing style guide (sometimes called gaya selingkung in Indonesian contexts) for theses or journals. These style differences stem from academic traditions, but they are usually benchmarked against practices of reputable international publishers and aligned with higher education regulations.
In other words, learning a standardized approach to reading academic articles helps researchers navigate any journal’s format and expectations. Importantly, advice on reading scholarly work often boils down to two key points: read actively and read often. Active reading – reading with an intent to truly understand and evaluate – is a learned skill that improves with practice. Below, we discuss strategies for selecting credible articles, efficiently extracting their essence, and critically reviewing them in line with global best practices.
Selecting Credible Journals and Articles
The first step in effective journal reading is choosing the right sources. Always start with scholarly articles published in recognized, peer-reviewed journals. Such journals carry academic weight (often indexed in Scopus or Web of Science) and have been vetted by experts. They can be found through university libraries, academic databases, or publishers’ websites (e.g., Elsevier, SAGE, Wiley, Emerald). In Indonesia, one can also use indexes like SINTA or GARUDA to find accredited local journals.
By contrast, avoid grabbing papers haphazardly via general web search engines. A random Google or Yahoo search might return shareware/freeware uploads – articles anyone could put online without academic vetting. These might not have been acknowledged by the scientific community (e.g., lacking proper peer review or not associated with reputable institutions or professional associations).
In short, use academic search engines and databases (or your library’s portal) to ensure the article you’re reading comes from a trusted journal. For deeper literature dives, you can even leverage modern literature-mapping tools (such as Connected Papers, Inciteful, Litmaps, or ResearchRabbit) that help visualize networks of research on a topic, but in all cases, prioritize sources that the relevant peer community recognizes as valid. The credibility of the journal is a foundation – it means the article has at least passed a quality filter and is worth your time.
Scanning Key Parts of an Article
Once you have a potentially relevant paper, the next technique is scanning. Rather than reading linearly word-for-word, start by gleaning the high-level information: look at the title, abstract, and keywords, and then the introduction and section headings. The abstract is a crucial summary; a well-written abstract should tell you the paper’s motivation, its main results, and a brief conclusion or implication (Snyder, 2019). By carefully reading the abstract, you can discern what variables were examined, what the main findings were, and whether the study was observational or experimental.
After the abstract, skim through the introduction and any section headings or subheadings throughout the paper. The introduction gives the rationale for the study—what question is being investigated and why it matters—often by summarizing prior research or theory. As you scan it, keep questions in mind: What is the specific problem or question? What do the authors predict or hypothesize? Also, quickly check the conclusion section for a concise summary of results. This quick scan helps you decide whether the article is worth a full read and if it’s relevant to your needs.
Critically, ensure the article’s content matches what you’re looking for. Does the paper cover the constructs or variables you are interested in? Does it study a context or industry relevant to your research? For example, suppose you are researching sustainable consumer behavior in the cosmetics industry. If you come across a paper on the “clean beauty” trend among Millennial and Gen Z consumers, a scan of the abstract would reveal that the study assesses the impact of “clean beauty” attributes (safety, ethicality, sustainability) on young consumers and even proposes a new index for product cleanliness. From this you learn the key variables and the context—enough to know the article’s focus. Such a quick triage saves you from reading papers that ultimately aren’t useful.
In practice, Keshav (2007, cited in Kapoor, Tamilmani, Rana, Patil, Dwivedi, & Nerur, 2018) suggests that an efficient literature reader can decide on an article’s relevance in about 5–10 minutes by this kind of structured scan. If after scanning you can answer basic questions—What type of study is this? What are the main contributions?—you can determine whether to commit more time to a thorough read. If the article isn’t closely related to your area or seems to make invalid assumptions, you might drop it and move on. This way, you allocate your reading time to papers that truly matter for your purpose.
If the paper does seem relevant, also take note of the theoretical framework or model it uses (sometimes presented in the introduction or a dedicated section). Understanding the theory or conceptual model behind the study is key. Make sure you have (or can acquire) enough theoretical background on those concepts—active reading is much easier when you’re familiar with the terminology and context. At this stage, you might also glance at any figures or diagrams of the model and skim the keywords listed, as they indicate the academic topics under which the work is categorized. All of this scanning sets you up for a more informed and focused deep reading on the second pass.
Identifying Research Gaps
One of the most valuable sections of a research article is the discussion of limitations and future research directions. Typically located at the end of the paper (often in the Discussion or Conclusion), this section outlines the study’s shortcomings and suggests possible next steps. For undergraduate or graduate students searching for thesis ideas, or for researchers planning new projects, this part is a gold mine because it often highlights research gaps explicitly (Snyder, 2019).
Identifying these gaps is crucial for ensuring academic originality (novelty), which remains a key criterion in publishing. Analyses show that the use of terms like “novelty” and “innovation” in titles and abstracts has increased significantly in recent decades (BMJ Editorial, cited in Liu, Wu, & Li, 2019). By compiling the future research suggestions from multiple recent articles, readers can detect patterns or recurring themes that the academic community considers important for further exploration.
To illustrate, imagine prior research on social-media marketing found a correlation between influencer credibility and consumer purchase intention, but noted the limitation that it only studied fashion influencers in Europe, suggesting future work on other industries. You could take that suggestion and propose a study on beauty and health business influencers in Asia—that extends the work. But you might go further by introducing a novel variable (e.g., the role of cultural differences in trust) or using an experimental design instead of the prior survey approach. That way, you’re not only addressing the suggested gap but also adding a fresh contribution.
Finally, as you decide how an article informs your own research, ensure there’s alignment on the methodological aspects. Check what research design and analysis techniques were used. Is the study experimental, survey-based, qualitative, simulation-based? What statistical tools or metrics were involved? This matters because if you plan to build on the work, you’ll need to consider whether you have the skills or resources to use similar methods, or whether you might approach the question with a different method. For example, a paper in finance and venture capital might use complex econometric models—if you’re not versed in those, you might need a collaborator or choose a simpler approach. Or a study in digital business and marketing might analyze big data from social media—consider if such data access is feasible for you. Being mindful of methodology helps ensure any research gap you pursue is actually executable with rigor.
Published Studies Aren’t Gospel
A common pitfall for novice readers is to treat published articles—especially those in high-impact journals or written by renowned scholars—as unquestionable truth. In reality, no study is perfect or beyond critique. Even prestigious journals have published work later found to be flawed or irreproducible (Appelbaum & Nehmer, 2017). As one guideline bluntly states: “Published papers are not truths etched in stone” (Kristaung & Augustine, 2019). Science is an evolving conversation, not scripture.
This is why critical thinking is essential. Readers must ask: Do the data truly support the conclusions? Could alternative explanations exist? The ongoing replication crisis across many disciplines underscores this point (Podsakoff et al., 2005). A 2020 editorial in PLOS Computational Biology even encourages readers to “push back against the author’s interpretation to test the strength of their conclusions.” For example, if a study relied only on college students, how generalizable are the results? If a survey used narrowly framed questions, could that have biased the findings? Such probing questions sharpen your ability to separate solid evidence from weak inference.
At the same time, don’t be intimidated by prestige. Just because an article appears in a leading journal does not mean it is definitive. Two well-executed studies on the same topic may even report conflicting results. As a reader, your role is to weigh the evidence: consider credentials (peer review, author track record, journal standing) but also evaluate the content quality on its own merits. Finally, remember that being critical is not the same as being dismissive—minor issues (awkward phrasing, a mislabeled figure) should not invalidate an entire paper. Aim for respectful skepticism and focus on the bigger picture.
Approaches to Critical Review
Once you’ve selected an article and read it thoroughly, how do you formally review or critique it? Especially if you need to write a literature review or present an article in a seminar, it helps to use a structured approach. Here are three approaches, each with a different focus:
- Pro–Con (Comparison) Approach — Compare the article with other literature in relation to your own research model. Map the article’s variables, hypotheses, or findings against those in other studies to see where it agrees or differs. This technique is powerful if you already have a conceptual framework and want to position your work within ongoing debates (Kapoor et al., 2018).
- Structured Checklist (Formal) Approach — Evaluate each component in a predetermined order: citation details; introduction/purpose; objectives and research questions; literature review; analytical framework/model; hypothesis development; methodology; results and discussion; conclusion and implications. This ensures you don’t miss key elements and is particularly useful for beginners (Kristaung & Augustine, 2019).
- Three-Dimensional (Contemporary) Approach — Review along three dimensions:
- Technical/Format: clarity, organization, readability, adherence to style.
- Methodological: appropriateness and transparency of design, measures, sampling, and analysis; reproducibility.
- Scholarly/Content: theoretical soundness and contribution; implications for theory, instruments, practice, or policy (Marwick & boyd, 2011; Kietzmann, Paschen, & Treen, 2018).
Evaluation Criteria
To put the above into practice, consider an evaluation rubric that assigns weights to each aspect of a journal article:
- Title, Authors, Year, Institution, Abstract (5%) — Does the title clearly reflect the content? Is the abstract informative and concise?
- Introduction/Problem Statement (20%) — Is the theoretical and empirical problem presented clearly? Are research objectives or questions stated?
- Literature Review (20%) — Is it relevant, coherent, and aligned with the research questions?
- Analytical Framework/Model (5%) — Is the conceptual or mathematical model clear and logical?
- Hypotheses or Propositions (5%) — Are they well grounded in the literature?
- Methodology (10%) — Are design, measurement, sampling, data collection, and analysis described in sufficient detail and appropriate to the question?
- Results and Discussion (25%) — Are results presented clearly and interpreted thoughtfully, including comparisons to prior studies?
- Conclusion and Implications (10%) — Are takeaways, theoretical/practical implications, limitations, and future research directions articulated clearly?
After scoring each element, sum to 100 and categorize overall quality: Very Good (>80), Good (70–79), Fair (60–69), and Poor (<60). While any scoring is somewhat subjective, this structure ensures a comprehensive and fair evaluation.
Epilogue
“Journal reading” as an academic skill is all about efficiency and critical insight. In an era of information overload, knowing how to quickly filter credible, relevant research from the rest is invaluable. By selecting authoritative journals and using scanning techniques, you can rapidly build an understanding of the state of knowledge on a topic. By examining limitations and suggested future work, you identify where you can contribute new ideas—remembering to aim for novelty that journals value. And by reading critically—never assuming a published study is above scrutiny—you engage in the true scientific mindset of questioning and learning.
Different review approaches (Pro–Con comparisons, formal checklists, or multi-dimensional critiques) are tools to help you digest and evaluate what you read in a structured way. Ultimately, effective journal reading turns you from a passive consumer of information into an active participant in your field’s scholarly conversation. No matter your specialization—beauty and health business, entertainment and creative industries, communication and PR, finance and venture capital, or digital business and marketing—mastering journal reading will elevate your research and writing. Read widely, read critically, and let each article you engage with become a stepping stone toward your own scholarly contributions.
Notes
- Source of rubric concept: adapted from Kristaung & Augustine (2019).
- This article is an updated version of Journal Reading Re-Run Episode 2 (April 2021). The revision process was supported by Yandri A. Toar as editor, with additional assistance from AI ChatGPT to ensure alignment with international educational standards and the inclusion of up-to-date references from reputable journals.
References
- Alles, M. G., Kogan, A., & Vasarhelyi, M. A. (2002). Feasibility and economics of continuous assurance. Auditing: A Journal of Practice & Theory, 21(1), 125–138. https://doi.org/10.2308/aud.2002.21.1.125
- Appelbaum, D., & Nehmer, R. (2017). Using drones in internal and external audits: Concepts and cases. Journal of Emerging Technologies in Accounting, 14(1), 99–113. https://doi.org/10.2308/jeta-517
- Bai, C., Quayson, M., & Sarkis, J. (2021). COVID-19 pandemic digitization lessons for sustainable development of micro- and small-enterprises. Sustainable Production and Consumption, 27, 1989–2001. https://doi.org/10.1016/j.spc.2021.04.035
- Garcia, R., & Calantone, R. (2002). A critical look at technological innovation typology and innovativeness terminology: A literature review. Journal of Product Innovation Management, 19(2), 110–132. https://doi.org/10.1111/1540-5885.1920110
- Kapoor, K., Tamilmani, K., Rana, N. P., Patil, P., Dwivedi, Y. K., & Nerur, S. (2018). Advances in social media research: Past, present and future. Information Systems Frontiers, 20(3), 531–558. https://doi.org/10.1007/s10796-017-9810-y
- Kietzmann, J., Paschen, J., & Treen, E. (2018). Artificial intelligence in advertising: How marketers can leverage AI along the consumer journey. Journal of Advertising Research, 58(3), 263–267. https://doi.org/10.2501/JAR-2018-035
- Kristaung, R., & Augustine, Y. (2019). Metodologi Penelitian untuk Bisnis dan Akuntansi. Jakarta: Dian Rakyat.
- Liu, H., Wu, L., & Li, X. (2019). Big data-based organizational change and performance: Insights from the supply chain perspective. International Journal of Operations & Production Management, 39(6/7/8), 851–873. https://doi.org/10.1108/IJOPM-02-2019-0138
- Luo, X., Tong, S., Fang, Z., & Qu, Z. (2019). Frontiers: Machines vs. humans: The impact of artificial intelligence chatbot disclosure on customer purchases. Marketing Science, 38(6), 937–947. https://doi.org/10.1287/mksc.2019.1192
- Marwick, A., & boyd, d. (2011). To see and be seen: Celebrity practice on Twitter. Convergence, 17(2), 139–158. https://doi.org/10.1177/1354856510394539
- Podsakoff, P. M., MacKenzie, S. B., Bachrach, D. G., & Podsakoff, N. P. (2005). The influence of management journals in the 1980s and 1990s. Strategic Management Journal, 26(5), 473–488. https://doi.org/10.1002/smj.454
- Snyder, H. (2019). Literature review as a research methodology: An overview and guidelines. Journal of Business Research, 104, 333–339. https://doi.org/10.1016/j.jbusres.2019.07.039
