What specific quantitative method is used? How does a quantitative research design correspond with the research questions or hypotheses?
Can you determine whether the design was appropriate?
To what extent can the design answer the research questions or address the stated hypotheses? Elaborate.
• What were the variables under study? If relevant, identify the main dependent and independent variables. If not relevant, why are there no dependent and independent variables? What instruments or observations were used in the research? Explain why you do, or do not, think that the methods used to collect the data are described clearly enough to allow for replication. Be specific and please elaborate.
• Explain whether or not information was provided concerning the reliability and validity of these instruments or observations. Was this information adequate? How does the presence or absence of information about reliability and validity affect your confidence in the quality of the study? What have the authors done to address or strengthen internal validity? Be specific.
Sample
• How were the participants recruited or selected for the study? What sampling strategy was used? Is the sample large enough to address the hypotheses and research questions? Did the author(s) offer any justification for the sample size? Are you satisfied with the information reported about the sample? What questions might you have about the sample that were not addressed? Please be sure to provide an explanation for all of your answers.
• Are the demographics of the participants (e.g., background characteristics such as age, race, etc.) described in sufficient detail? If so, how is the presentation of this descriptive data useful in evaluating the research? If not, please explain how that may affect the evaluation of the research.
• Was the sample reflective of the population from which it was drawn? Is representativeness important in this research? Please explain.
• Please explain any ethical concerns you may have about the sample and how the sample was recruited.
Results
• How were the data analyzed? (What statistical techniques were used?) Be specific.
• Explain how easy or difficult it was for you to understand the reporting of results. What questions do you have after reading the results section? Please elaborate.
