Find your economic evaluation Choose a published evaluation of cost-effectiveness or cost-utility of a health intervention that interests you. Tip: In making your selection, bear in mind the definition of economic evaluation as a comparison of two or more options in terms of their costs and their benefits.
Tip: A google search will be more than adequate. I suggest you choose an article published in a public health or medical journal rather than an economics journal. And please obtain a pdf copy of your article that you can send to me. Step 2: Critically appraise the evaluation Use Drummonds ten-step checklist to structure your critical appraisal of the article. A copy of the checklist is attached to this document, or it can be found here: https://www.nlm.nih.gov/nichsr/edu/healthecon/drummond_list.html. Please use only this ten-question version. There are longer tick-box versions of the checklist available (see the reference to Drummond and Jefferson for example), which should not be used. Ive included the Drummond and Jefferson paper because it provides useful information about what to consider in your review. Feel free to use the 10 main questions as section headings to structure your review. The sub-questions should just be used as prompts to guide what to consider under each section heading. Tip: See the example by Chris Doran for what I have in mind, but note there will be no marks for anyone choosing the same article to critique as the one that Chris reviews! Note also that I am not endorsing his review. He may be wrong in what he says! When you have finished your critique assign a score from 0-100 to reflect your subjective assessment of the studys quality
give it a mark! Please do this before you consider step 3.
PHE5HEF 2016 Health Economics and Finance
2
Step 3: Score the article formally using the QHES The Quality of Health Economic Studies instrument is closely related to Drummonds ten-step checklist but it also allows you to score the quality of the study more formally. There are sixteen questions that you answer yes/ no according to whether you think the article meets the criteria. Each question then has a weight (see Table 1 in the article by Offman). Each yes answer scores 1 and you compute a total quality score for the article by multiplying each yes answer by the weight assigned to that question and summing the result. Step 4: Compare the results of your two assessments This step is optional it is not part of the assignment, but may be an interesting exercise. Compare your assessment of the articles merits in step 2 with the score that you arrive at in step 3. If there is a big difference, perhaps share your reflections on what might be causing it. Any questions of clarification? Pose them on LMS so that everyone can share the answers References: Chiou CF et al. Development and validation of a grading system for the quality of cost-effectiveness studies. Medical Care 2003; 41: 32-44. Doran C. Critique of an economic evaluation using the Drummond checklist. Applied Health Economics and Health Policy 2010; 8: 357-359. Drummond M et al. Methods for the Economic Evaluation of Health Care Programmes. 2nd ed. Oxford. Oxford University Press. 1997. Drummond MF, Jefferson TO. Guidelines for authors and peer reviewers of economic submissions to the BMJ. The Economic Evaluation Working Party. British Medical Journal 1996; 313: 275-283. Offman JJ et al. Examining the value and quality of health economic analyses: implications of utilizing the QHES. Journal of Managed Care Pharmacy 2003; 9: 53-61.
PHE5HEF 2016 Health Economics and Finance
3
Checklist for the Economic Evaluation of Health Care Programmes1
1. Was a well-defined question posed in answerable form? 1.1. Did the study examine both costs and effects of the service(s) or programme(s)? 1.2. Did the study involve a comparison of alternatives? 1.3. Was a viewpoint for the analysis stated and was the study placed in any particular decision-making context? 2. Was a comprehensive description of the competing alternatives given (i.e. can you tell who did what to whom, where, and how often)? 2.1. Were there any important alternatives omitted? 2.2. Was (should) a do-nothing alternative be considered? 3. Was the effectiveness of the programme or services established? 3.1. Was this done through a randomised, controlled clinical trial? If so, did the trial protocol reflect what would happen in regular practice? 3.2. Was effectiveness established through an overview of clinical studies? 3.3. Were observational data or assumptions used to establish effectiveness? If so, what are the potential biases in results? 4. Were all the important and relevant costs and consequences for each alternative identified? 4.1. Was the range wide enough for the research question at hand? 4.2. Did it cover all relevant viewpoints? (Possible viewpoints include the community or social viewpoint, and those of patients and third-party payers. Other viewpoints may also be relevant depending upon the particular analysis.) 4.3. Were the capital costs, as well as operating costs, included? 5. Were costs and consequences measured accurately in appropriate physical units (e.g. hours of nursing time, number of physician visits, lost work-days, gained life years)? 5.1. Were any of the identified items omitted from measurement? If so, does
