In 2004, the British Medical Journal published an article titled, “Resisting Cookbook Medicine,” which looked askance at the “routine use of predetermined directives” in clinical practice because it reduced doctors to practicing so-called cookbook medicine and eroded the art of medicine.1 Fast forward 15 years, and we find our appetite for “predetermined directives”—what we now call evidence-based practice guidelines—has never been greater. What changed?
Many things have changed, as we all know—not the least of which has been the exponential rise in medical knowledge, as demonstrated by a couple of staggering metrics: More than 25 million references to journal articles in the Medline bibliographic database and about 500,000 records added to PubMed each year.2,3 With so much information that is searchable and, seemingly, knowable, who really has the bandwidth to process it all? How do we expertly and comprehensively compare and weigh all the published evidence in our clinical decision making? The development of practice guidelines helps fill this growing need and support us in providing the best, state-of-the-art, evidence-based care for our patients.
To borrow from the old African proverb, the development of practice guidelines “takes a village.” At the ACR, our Committee on Quality of Care brings together such a village for the rigorous process of guideline development. It starts with carefully choosing the disease state for which a clinical guideline will be developed, with a focus on the major diseases we treat across the span of our specialty: rheumatoid arthritis, osteoarthritis, juvenile idiopathic arthritis, axial spondyloarthritis, gout and psoriatic arthritis, among others.4
The Process
For each disease, a guideline development group is assembled comprising up to 40 individuals and including content experts, methodologists, clinicians, patients and a literature review team. Once this group is convened, it adheres to the GRADE methodology for guideline development.5 GRADE, which stands for Grading of Recommendations, Assessment, Development and Evaluation, is currently the most widely accepted and used guideline methodology. Under GRADE, the key first step is to develop the PICO questions that must be answered in each of the final guideline recommendations, based on available literature. The PICO questions are formulated to identify each component of its acronym, namely: Which population? What intervention? Which comparator? And finally (and most importantly), what outcome?
Once the PICO questions are agreed upon, the literature review team begins its work, diligently reviewing all available evidence for the clinical questions identified within the specified disease or clinical domain. Initial searches often yield thousands of potentially relevant papers, which are screened to create a smaller list of included papers, which are then evaluated for scientific rigor. Data are extracted and summarized for each critical or important outcome listed for each question.
The published evidence is considered in the context of the development team’s experience and expertise, as well as patient values and preferences. A voting panel, with help from a GRADE methodologist to ensure the integrity of the process, evaluates the overall quality of the evidence and the balance between desirable and undesirable effects, while factoring in the subjective component of patient and clinician values and preferences. The final recommendations are always reported as either “in favor” or “against” the intervention, and then further qualified as strongly or conditionally recommended on the basis of all the factors considered.