|
|
GENERAL ARTICLE |
|
Year : 2017 | Volume
: 30
| Issue : 1 | Page : 84-88 |
|
Assessing reading levels of health information: uses and limitations of flesch formula
Pranay Jindal, Joy C MacDermid
Faculty of Health Sciences, School of Rehabilitation Sciences, McMaster University, Hamilton, ON, Canada
Date of Web Publication | 13-Jul-2017 |
Correspondence Address: Pranay Jindal 1280 Main Street West, McMaster University, Hamilton, ON Canada
 Source of Support: None, Conflict of Interest: None  | Check |
DOI: 10.4103/1357-6283.210517
Background: Written health information is commonly used by health-care professionals (HCPs) to inform and assess patients in clinical practice. With growing self-management of many health conditions and increased information seeking behavior among patients, there is a greater stress on HCPs and researchers to develop and implement readable and understandable health information. Readability formulas such as Flesch Reading Ease (FRE) and Flesch–Kincaid Reading Grade Level (FKRGL) are commonly used by researchers and HCPs to assess if health information is reading grade appropriate for patients. Purpose: In this article, we critically analyze the role and credibility of Flesch formula in assessing the reading level of written health information. Discussion: FRE and FKRGL assign a grade level by measuring semantic and syntactic difficulty. They serve as a simple tool that provides some information about the potential literacy difficulty of written health information. However, health information documents often involve complex medical words and may incorporate pictures and tables to improve the legibility. In their assessments, FRE and FKRGL do not take into account (1) document factors (layout, pictures and charts, color, font, spacing, legibility, and grammar), (2) person factors (education level, comprehension, health literacy, motivation, prior knowledge, information needs, anxiety levels), and (3) style of writing (cultural sensitivity, comprehensiveness, and appropriateness), and thus, inadequately assess reading level. New readability measures incorporate pictures and use complex algorithms to assess reading level but are only moderately used in health-care research and not in clinical practice. Future research needs to develop generic and disease-specific readability measures to evaluate comprehension of a written document based on individuals' literacy levels, cultural background, and knowledge of disease. Keywords: Flesch Reading Ease, Flesch–Kincaid Reading Grade level, health literacy, readability formulas
How to cite this article: Jindal P, MacDermid JC. Assessing reading levels of health information: uses and limitations of flesch formula. Educ Health 2017;30:84-8 |
Background | |  |
Patient education is an integral part of clinical practice. Allied health-care professionals (HCPs), physicians, and nurses commonly use written medical information materials for patient education. Many patients use the Internet for reading information about their health conditions and their treatment. The advantages of interactivity and anonymity [1] have made the Internet a prominent source of health information for both professionals and general public.[2],[3] The Internet has increased the volume of available text health information and consumers have increasingly gone online to search medical information.[2],[4],[5],[6],[7] Many health-care interventions, such as diabetes management, smoking cessation, and back pain rehabilitation, are now being delivered online for a variety of perceived benefits.[8] With the increasing push for self-management and home programs for many health conditions, there is a need for health information materials which can be easily read and understood by patients. However, there is a lack of evidence-based health information which can be accessed, read, and understood by the general public.[9]
Written health material is predominantly used in patient education and online health information. It is important for a patient to be able to read and understand the information for better engagement in his healthcare. Patient engagement is essential for meaningful health outcomes and to enhance patient satisfaction.[10] Researchers and clinicians also use written health information to assess patient recovery, satisfaction with care, and areas of improvement in services. Readability formulas are commonly used to evaluate the reading level of written health information which might include test protocols and instructions, home exercise and care instructions, information pamphlets, consent and assent forms, patient-reported outcome measures, and surveys. Easy to read and understand written document allows accurate reporting, active research participation, and enhanced clinical practice.
Despite increased use of the Internet by people and improved availability of online health information, many of these resources remain underutilized as they cannot be read and understood by common people.[11],[12],[13],[14] In the field of health-care research, many informed consent and patient reported outcome measures are above the level of reading ability of a common man [15],[16] which might yield inaccurate results. Readability is defined as “the sum total (including all the interactions) of all those elements within a given piece of printed material that affect the success a group of readers have with it. The success is the extent to which they understand it, read it at an optimal speed, and find it interesting.”[17]
Many readability formulas such as Flesch, Dale–Chall, and Gunning Fog Index exist for checking the readability of a text in English.[18] A few readability formulas are also available for checking the readability of non-English text, for example, READ-IT [19] (Italian), Spaulding, modified Fry graph, and Crawford formula [20] (Spanish), and Lix Readability Formula [21] (Swedish). Most reading formulas give scores by doing mathematical calculations based on the number of words per se ntence, mean word length, and number of syllables per word.[22] Due to the complexity involved in assessing reading ease, many researchers and health-care providers use multiple readability measures to more accurately evaluate the readability of a given written document.[23] The Flesch formula is most commonly used to assess the readability of written health-care information materials.[18],[24],[25],[26] In this article, we will critically analyze the credibility and role of Flesch formula in assessing the readability of written health information.
The Flesch formula
Rudolph Flesch developed the Flesch Reading Ease (FRE) formula in 1948. Flesch Reading Grade Level (FRGL) formula was built upon in FRE by Kincaid et al. in 197 5 for the US Navy to give a grade level to written material.[25] It is commonly referred as Flesch–Kincaid Reading Grade Level (FKRGL). Both FRE and FKRGL calculate the readability based on two variables: average sentence length (based on the number of words) and average word length (based on the number of syllables).
The validity of Flesch Reading Ease and Flesch–Kincaid Reading Grade Level
Both the FRE formula and FKRGL are valid for measuring the readability of a written text between US Grade 5 and college level.[24],[25] The FRE scores have been validated against 1950 McCall-Crabbs Standard Test in reading lessons,[27] and FRE scores correlate 0.6 with 1950 McCall-Crabbs Standard Test.[28] The FRE scores also correlate highly with Fry (0.96) and Simple Measure of Gobbledygook (0.95) readability formulas.[29] Since comprehension is an important aspect to understand the written findings, the FKRGL has also been validated against the cloze comprehension tests.[25],[30] Since FKRGL is validated against the cloze comprehension tests and they directly give a grade level (as opposed to an estimate in FRE), FKRGL is more commonly used in daily practice.[26]
Scoring
Both FRE and FKRGL can be calculated manually and electronically. The score derived from FRE ranges from 0 (unreadable) to 100 (very easy to read). FKRGL also gives a score that corresponds to the US grade level. For example, a FKRGL of 8.5 means that the text should be understood by people achieved US Grade 8. To reach people with low levels of literacy, it is suggested that written health-care information materials are to be targeted at Grade level 8 or less in the US [31],[32] and Grade level 12 in the UK.[31] Interpretations of FRE scores [28] and estimated grade level are in [Table 1].
Advantages and limitations
As both FRE and FKRGL are readily available within the MS Office suite, they are the most preferred readability formulas.[33] FRE and FKRGL exclude subtitles, captions, and headings.[34] Furthermore, the FRE and FKRGL scores cannot be calculated on tables, charts, and graphics.[35] MS Word recognizes each period as the end of a sentence. Thus, abbreviations, numbers with decimals, and bullet headings might reduce the reading level thus underestimating the grade level.[34]
Critical analysis
To understand written health-care information, patients need to go beyond reading and actually comprehend the information. Comprehension depends on various factors such as (a) text layout (title, font, colors, tables, graphics, spacing, and grammar),[31],[36] (b) patient motivation and prior knowledge of the subject which helps them to derive meaning from the written text,[37] and (c) patient anxiety levels.[38] FRE and FKRGL do not take prior knowledge, motivation, layout, grammar, and graphics into consideration; and rely only on word and sentence length.[34],[39]
Despite common use of FRE and FKRGL, its validation and scoring algorithm are still debated. Some authors suggest that there has been an inadequate validation of the FRE and FKRGL.[40] It is noteworthy that McCall-Crabbs Standard Test was never intended to be used as a criterion for reading formula.[40] Both medical and lay terminologies and vocabulary have changed greatly over the past 60 years, and 1950 standards of McCall-Crabbs test are outdated now.[27] Importantly, passages used while developing McCall-Crabbs test for comprehension were too short and simple [40] and do not have the necessary capacity to accurately assess the reading level of a document consisting of complex medical words. Due to the built-in availability within MS Office, the FRE and FKRGL have become a readily available option but provide lower estimates of readability as compared to other reading formulas.[41]
FRE and FKRGL scores are based on word or sentence length, thus including a complex medical word might increase the reading level of the document. However, patients with chronic health conditions may be familiar with the medical terms relating to their health condition. Using a simpler or uncommon word may decrease the grade level but might fail to capture the interest of patients, might undermine their confidence in its credibility, or might not provide the needed in-depth information.[39],[42] Furthermore, in a health information document, keywords are often repeated to reinforce learning, which will lead to inappropriately higher FRE and FKRGL scores for these texts.
Current options for readability formulae
Since the use of graphics influence readability, new readability measures such as Readability Assessment Instrument,[43] Ensuring Quality Information for Patients,[44] and Suitability Assessment of Materials [45] have been developed in the past decade to assess the effectiveness of diagrams and pictures with text. These measures can be used by health-care providers in conjunction with FRE and FKRGL to develop effective patient education materials. Often home programs and outcomes' measures use a combination of text, tables, and figures; these alternative readability measures may be more valid.
Researchers and clinicians can assess patient literacy and later combine readability formula findings with literacy assessment to develop audience-appropriate education materials. Patient literacy assessment tools such as Rapid Estimate of Adult Literacy in Medicine,[46] Test of Functional Health Literacy in Adults,[47] Brief Questions to Identify Patients With Inadequate health literacy,[48] Newest Vital Sign,[49] Health Activity Literacy Study,[50] and Wide Range Achievement Test-Revised [51],[52] can be used by clinicians and researchers to assess literacy levels of patients.
Recent scientific developments using computer linguistics have targeted the problems of outdated vocabulary and multiple meanings of the same word faced by FRE and FKRGL. New tools such as ATOS readability formula,[53],[54] Pearson Reading Maturity Metric,[55] the Coh-Metrix Text Easability Assessor,[56] and TextEvaluator [57] are online tools that constantly update their word vocabulary. These tools also use complex algorithms and measure semantic, structural, and vocabulary aspects to provide an accurate assessment of reading levels. These new tools have been used widely in classrooms by teachers to assess the reading level of books and passages in English; however, utilization and utility in health research are subject to further research.
Discussion | |  |
Assessment of reading grade level of written documents is a complex issue. It is influenced by factors related to the document (layout, color, font, spacing, legibility, and grammar); person (education, comprehension, health literacy, motivation, prior knowledge, information needs, anxiety levels); and style of writing (cultural sensitivity, context, comprehensiveness, and appropriateness). Reading formulas are inadequate objective measures but are being used as quick indicators to assist writers in targeting information to the lay public. Sole reliance on FRE and FKRGL or other reading formulas to assess the grade level can be misleading. It is important for HCPs and researchers to move beyond assessing reading grade level–simply can the patient read the document – toward assessing patient's understanding of the document. Assessing understanding is a complex process and is influenced by many intertwined variables. To develop a written document that is engaging to the reader, focuses on the key information, and is technically correct requires consideration of multiple factors related to the document, the target audience, and the information being provided.
Future directions
Multiple reading formulas exist; however, there is a lack of culturally sensitive, disease specific, and context-based readability measures. Future research should focus on developing generic and disease-specific online readability measures that can assess the comprehension of a written document based on individuals' literacy levels, cultural background, cognitive ability, vocabulary, and knowledge of the disease. Future readability measures should also be able to assess reading level of a document containing pictures and charts. Developing and using a measure that is customized to literacy levels, cultural background, and the disease knowledge might also help solve the ongoing problem of health-care information being written in a grade level higher than recommended level.
Financial support and sponsorship
Nil.
Conflicts of interest
There are no conflicts of interest.
References | |  |
1. | Cline RJ, Haynes KM. Consumer health information seeking on the internet: The state of the art. Health Educ Res 2001;16:671-92. |
2. | Baker L, Wagner TH, Singer S, Bundorf MK. Use of the internet and e-mail for health care information: Results from a national survey. JAMA 2003;289:2400-6. |
3. | Diaz JA, Griffith RA, Ng JJ, Reinert SE, Friedmann PD, Moulton AW. Patients' use of the Internet for medical information. J Gen Intern Med 2002;17:180-5. |
4. | Powell JA, Darvell M, Gray JA. The doctor, the patient and the world-wide web: How the internet is changing healthcare. J R Soc Med 2003;96:74-6. |
5. | Eysenbach G, Kohler CH. What is the prevalence of health-related searches on the World Wide Web? Qualitative and quantitative analysis of search engine queries on the internet. AMIA Annu Symp Proc 2003;225-9. |
6. | Spink A, Yang Y, Jansen J, Nykanen P, Lorence DP, Ozmutlu S, et al. Astudy of medical and health queries to web search engines. Health Info Libr J 2004;21:44-51. |
7. | Hamm MP, Chisholm A, Shulhan J, Milne A, Scott SD, Given LM, et al. Social media use among patients and caregivers: A scoping review. BMJ Open 2013;3. pii: E002819. |
8. | Griffiths F, Lindenmeyer A, Powell J, Lowe P, Thorogood M. Why are health care interventions delivered over the internet? A systematic review of the published literature. J Med Internet Res 2006;8:e10. |
9. | Jindal P, MacDermid J. Type and extent of knowledge translation resources published by peer-reviewed rehabilitation journals. Crit Rev Phys Rehabil Med 2015;27:105-22. |
10. | Coulter A. Patient engagement – What works? J Ambul Care Manage 2012;35:80-9. |
11. | Walsh TM, Volsko TA. Readability assessment of internet-based consumer health information. Respir Care 2008;53:1310-5. |
12. | Cotugna N, Vickery CE, Carpenter-Haefele KM. Evaluation of literacy level of patient education pages in health-related journals. J Community Health 2005;30:213-9. |
13. | McInnes N, Haglund BJ. Readability of online health information: Implications for health literacy. Inform Health Soc Care 2011;36:173-89. |
14. | Agarwal N, Hansberry DR, Sabourin V, Tomei KL, Prestigiacomo CJ. A comparative analysis of the quality of patient education materials from medical specialties. JAMA Intern Med 2013;173:1257-9. |
15. | Paz SH, Liu H, Fongwa MN, Morales LS, Hays RD. Readability estimates for commonly used health-related quality of life surveys. Qual Life Res 2009;18:889-900. |
16. | Paasche-Orlow MK, Taylor HA, Brancati FL. Readability standards for informed-consent forms as compared with actual readability. N Engl J Med 2003;348:721-6. |
17. | Dale E, Chall JS. The concept of readability. Natl Counc Teach Engl 1949;26:19-26. |
18. | Ley P, Florio T. The use of readability formulas in health care. Psychol Health Med 1996;1:7-28. |
19. | Read-It: Assessing Readability of Italian Texts with a View to Text Simplification. Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies: Association for Computational Linguistics; 2011. |
20. | Parker I Richard, Hasbrouck JE, Weaver L, Spanish readability formulas for elementary-level texts: A validation study. Read Writ Q 2001;17:307-22. |
21. | |
22. | Hansberry DR, Agarwal N, Baker SR. Health literacy and online educational resources: An opportunity to educate patients. AJR Am J Roentgenol 2015;204:111-6. |
23. | D'Alessandro DM, Kingsley P, Johnson-West J. The readability of pediatric patient education materials on the World Wide Web. Arch Pediatr Adolesc Med 2001;155:807-12. |
24. | Flesch R. A new readability yardstick. J Appl Psychol 1948;32:221-33. |
25. | Kincaid JP, Fishburne RP, Rogers RL, Chissom BS. Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel. Naval Technical Training, U. S. Naval Air Station; 1975. p. 1-48. |
26. | Wang LW, Miller MJ, Schmitt MR, Wen FK. Assessing readability formula differences with written health information materials: Application, results, and recommendations. Res Social Adm Pharm 2013;9:503-16. |
27. | Jacabson DM, Kirkland E, Selden WR. An examination of the McCall-Crabbs standard test lessons in reading. J Read 1978;22:224-30. |
28. | DuBay WH. The Principles of Readability. California: Impact Information; 2004. |
29. | Meade CD, Smith CF. Readability formulas: Cautions and criteria. Patient Educ Couns 1991;17:153-8. |
30. | Taylor WL. “Cloze procedure”: A new tool for measuring readability. Journal Q 1953;30:415. |
31. | Doak CC, Doak LG, Root JH. Teaching Patients with Low Literacy Skills. 2, Illustrated Edition. Philadelphia: J.B. Lippincott; 1996. |
32. | Kutner M, Greenberg E, Jin Y, Paulsen C. The Health Literacy of America's Adults: Results From the 2003 National Assessment of Adult Literacy. U.S. Department of Education; 2006. p. 1-60. |
33. | Stockmeyer NO. Using Microsoft word's readability program. Mich Bar J 2009;88:46. |
34. | Friedman DB, Hoffman-Goetz L. A systematic review of readability and comprehension instruments used for print and web-based cancer information. Health Educ Behav 2006;33:352-73. |
35. | Cherla DV, Sanghvi S, Choudhry OJ, Liu JK, Eloy JA. Readability assessment of internet-based patient education materials related to endoscopic sinus surgery. Laryngoscope 2012;122:1649-54. |
36. | Bernardini C, Ambrogi V, Fardella G, Perioli L, Grandolini G. How to improve the readability of the patient package leaflet: A survey on the use of colour, print size and layout. Pharmacol Res 2001;43:437-44. |
37. | Bailin A, Grafstein A. The linguistic assumptions underlying readability formulae: A critique. Lang Commun 2001;21:285-301. |
38. | Estey A, Musseau A, Keehn L. Patient's understanding of health information: A multihospital comparison. Patient Educ Couns 1994;24:73-8. |
39. | Pringle MB, Natesh BG, Konieczny KM. Patient information leaflet on mastoid surgery risks: Assessment of readability and patient understanding. J Laryngol Otol 2013;127:1078-83. |
40. | Stevens KC. Readability formulae and McCall-Crabbs standard test lessons in reading. Read Teach 1980;33:4:413-15. |
41. | Wilson M. Readability and patient education materials used for low-income populations. Clin Nurse Spec 2009;23:33-40. |
42. | Green GM, Olsen MS. Preferences for and Comprehension of Original and Readability-Adapted Materials. University of_ Illinois at Urbana-Champaign; 1986; Technical Report 393. |
43. | Singh J. Readability assessment instrument user's manual. 2 nd ed. Midlothian, VA: ONE Publications; 2005. |
44. | Moult B, Franck LS, Brady H. Ensuring quality information for patients: Development and preliminary validation of a new instrument to improve the quality of written health care information. Health Expect 2004;7:165-75. |
45. | Suitability Assessment of Materials (SAM). American Public Health Association Annual Meeting; 1994. |
46. | Murphy PW, Davis TC, Long SW, Jackson RH, Decker BC. Rapid estimate of adult literacy in medicine (REALM): A quick reading test for patients. J Read 1993;37:124-30. |
47. | Parker RM, Baker DW, Williams MV, Nurss JR. The test of functional health literacy in adults: A new instrument for measuring patients' literacy skills. J Gen Intern Med 1995;10:537-41. |
48. | Chew LD, Bradley KA, Boyko EJ. Brief questions to identify patients with inadequate health literacy. Fam Med 2004;36:588-94. |
49. | Weiss BD, Mays MZ, Martz W, Castro KM, DeWalt DA, Pignone MP, et al. Quick assessment of literacy in primary care: The newest vital sign. Ann Fam Med 2005;3:514-22. |
50. | Rudd RE. Health literacy skills of U.S. adults. Am J Health Behav 2007;31 Suppl 1:S8-18. |
51. | Robertson GJ. Wide-Range achievement test. Corsini Encyclopedia of Psychology. Wiley Online library; 2010. Vol. 1-2. |
52. | Reid N. Wide Range achievement test: 1984 revised edition. J Couns Dev 1986;64:538-9. |
53. | |
54. | |
55. | |
56. | McNamara DS, Graesser AC. Coh-Metrix: An Automated Tool for Theoretical and Applied Natural Language Processing. Applied Natural Language Processing and Content Analysis: Identification, Investigation, and Resolution. Hershey, PA: IGI Global; 2012. |
57. | Sheehan KM, Kostin I, Napolitano D, Flor M. The text evaluator tool. Elem Sch J 2014;115:184-209. |
[Table 1]
This article has been cited by | 1 |
Training workload in the investigational drug service of a university hospital center |
|
| Nicolas Martel-Côté, Rachel Choquette, Catherine Côté-Sergerie, Denis Lebel, Jean-François Bussičres, Cynthia Tanguay | | American Journal of Health-System Pharmacy. 2023; | | [Pubmed] | [DOI] | | 2 |
Characteristics of Prognostic Statements During Family Conferences of Critically Ill Children |
|
| Divya Gupta, Tessie W. October, Amy H. J. Wolfe | | Pediatric Critical Care Medicine. 2023; 24(1): 34 | | [Pubmed] | [DOI] | | 3 |
Quality and readability of online information on hand osteoarthritis |
|
| Seok Woo Hong, Jeong-Hyun Kang, Jun Hyoung Park, Hee Jin Park, Eugene Kim | | Health Informatics Journal. 2023; 29(1): 1460458223 | | [Pubmed] | [DOI] | | 4 |
Readability of Online Patient Education Materials for Congenital Hand Differences |
|
| Alexander J. Baldwin | | HAND. 2023; : 1558944723 | | [Pubmed] | [DOI] | | 5 |
Regulatory compliance and readability of informed consent forms in industry-sponsored drug development clinical trials |
|
| Nahathai Dukaew, Mingkwan Na Takuathung, Wannachai Sakuludomkan, Kanyarat Chairaksa, Preeyaporn Klinjan, Nimit Morakote, Nut Koonrungsesomboon | | Clinical Trials. 2023; : 1740774523 | | [Pubmed] | [DOI] | | 6 |
Features and characteristics of publicly available mHealth apps for self-management in chronic obstructive pulmonary disease |
|
| Shirley Quach, Adam Benoit, Ana Oliveira, Tara L. Packham, Roger Goldstein, Dina Brooks | | DIGITAL HEALTH. 2023; 9: 2055207623 | | [Pubmed] | [DOI] | | 7 |
Patient Information Resources on Cardiovascular Health After Cancer Treatment: An Audit of Australian Resources |
|
| Abbey Diaz, Jorja McErlane, Mi Hye Jeon, Joan Cunningham, Victoria Sullivan, Gail Garvey | | JCO Global Oncology. 2023; (9) | | [Pubmed] | [DOI] | | 8 |
International pharmacy students’ role in translating an HIV and Aging survey from English to French, Spanish, and Vietnamese |
|
| Kenric Ware | | Journal of International Students. 2023; 13(4) | | [Pubmed] | [DOI] | | 9 |
Health literacy interventions for reducing the use of primary and emergency services for minor health problems: a systematic review |
|
| Alicia O’Cathain, Alexis Foster, Christopher Carroll, Louise Preston, Margaret Ogden, Mark Clowes, Joanne Protheroe | | Health and Social Care Delivery Research. 2022; 10(38): 1 | | [Pubmed] | [DOI] | | 10 |
Development and Validation of a Clinical Practicum Assessment Tool for the NAACLS-Accredited Biomedical Science Program |
|
| Taghreed Abunada, Atiyeh M. Abdallah, Rajvir Singh, Marawan Abu-Madi | | International Journal of Environmental Research and Public Health. 2022; 19(11): 6651 | | [Pubmed] | [DOI] | | 11 |
Preliminary Indicators of EFL Essay Writing for Teachers’ Feedback Using Automatic Text Analysis |
|
| Rong Phoophuangpairoj, Piyarat Pipattarasakul* | | International Journal of Educational Methodology. 2022; 8(1): 55 | | [Pubmed] | [DOI] | | 12 |
The development and validation of the awareness and knowledge of diabetes distress questionnaire among doctors in Malaysia |
|
| Grace Jikinong, Pauline Siew Mei Lai, Ahmad Ihsan Abu Bakar, Tun Firzara Abdul Malik, Noorsuzana Mohd Shariff | | PLOS ONE. 2022; 17(8): e0272658 | | [Pubmed] | [DOI] | | 13 |
Readability of patient educational materials in venous thrombosis: analysis of the 2021 ESVS guidelines and comparison with other medical societies information |
|
| Enrique M. SAN NORBERTO, Elena GARCÍA-RIVERA, Álvaro REVILLA, James H. TAYLOR, Carlos VAQUERO | | International Angiology. 2022; 41(2) | | [Pubmed] | [DOI] | | 14 |
Discharge summaries provided to owners of pets newly diagnosed with cancer exceed recommended readability levels |
|
| Julia E. Medland, Steven L. Marks, Joanne L. Intile | | Journal of the American Veterinary Medical Association. 2022; : 1 | | [Pubmed] | [DOI] | | 15 |
ÜLKEMIZDE INGILIZCE TIP EGITIMINDE KULLANILAN NÖROANATOMI KITAPLARININ VE WIKIPEDIA’DAKI NÖROANATOMI SAYFALARININ OKUNABILIRLIGI |
|
| Kaan YÜCEL | | Izmir Democracy University Health Sciences Journal. 2022; | | [Pubmed] | [DOI] | | 16 |
Improving health literacy with mumps, measles and rubella (MMR) vaccination: comparison of the readability of MMR patient-facing literature and MMR scientific abstracts |
|
| Tina Downey, Beverley C. Millar, John E. Moore | | Therapeutic Advances in Vaccines and Immunotherapy. 2022; 10: 2515135522 | | [Pubmed] | [DOI] | | 17 |
How have governments supported citizens stranded abroad due to COVID-19 travel restrictions? A comparative analysis of the financial and health support in eleven countries |
|
| Pippa McDermid, Adam Craig, Meru Sheel, Holly Seale | | BMC Infectious Diseases. 2022; 22(1) | | [Pubmed] | [DOI] | | 18 |
Evaluation of a breastmilk hand expression toolkit: the M.I.L.K survey study |
|
| Kameela Miriam Alibhai, Malia S. Q. Murphy, Sandra Dunn, Erin Keely, Paloma O’Meara, Josdalyne Anderson, Darine El-Chaâr | | International Breastfeeding Journal. 2022; 17(1) | | [Pubmed] | [DOI] | | 19 |
The development of the Australian Unemployed Workers Union Rating Scale (AUWURS) of employment service providers |
|
| David O'Halloran, Louise Farnworth, Nikos Thomacos | | Australian Journal of Public Administration. 2022; | | [Pubmed] | [DOI] | | 20 |
Readability Analysis of Otolaryngology Consent Documents on the iMed Consent Platform |
|
| Kyle Hannabass, Jivianne Lee | | Military Medicine. 2022; | | [Pubmed] | [DOI] | | 21 |
Assessing the readability and quality of online information about benign prostatic hyperplasia |
|
| Tremearne Hotz, Maya T. Zhou, Molly E. Reissmann, Michel Apoj, Shaun E. L. Wason, David S. Wang | | World Journal of Urology. 2022; | | [Pubmed] | [DOI] | | 22 |
Academic and community hernia center websites in the United States fail to meet healthcare literacy standards of readability |
|
| S. Docimo, K. Seeras, R. Acho, A. Pryor, K. Spaniolas | | Hernia. 2022; | | [Pubmed] | [DOI] | | 23 |
Radiology Reporting in the Era of Patient-Centered Care: How Can We Improve Readability? |
|
| Siya Patil,Joseph H. Yacoub,Xue Geng,Susan M. Ascher,Ross W. Filice | | Journal of Digital Imaging. 2021; | | [Pubmed] | [DOI] | | 24 |
The Quality and Content of Internet-Based Information on Orthopaedic Sports Medicine Requires Improvement: A Systematic Review |
|
| Ilona Schwarz,Darby A. Houck,John W. Belk,Jack Hop,Jonathan T. Bravman,Eric McCarty | | Arthroscopy, Sports Medicine, and Rehabilitation. 2021; | | [Pubmed] | [DOI] | | 25 |
Quality and readability of online resources on chronic ankle instability |
|
| Gilbert Manuel Schwarz,Marcus Lisy,Stefan Hajdu,Reinhard Windhager,Madeleine Willegger | | Foot and Ankle Surgery. 2021; | | [Pubmed] | [DOI] | | 26 |
Sugammadex Effects on Hormonal Contraception Effectiveness: Implementation of Uniform Postoperative Teaching |
|
| Emily Hartman,Emily Funk,Guy Dear,Carol Wellman,Katherine Pereira | | Journal of PeriAnesthesia Nursing. 2021; | | [Pubmed] | [DOI] | | 27 |
Do hospital consent forms for cardiology procedures meet health literacy standards? Evaluation of understandability and readability |
|
| Ruwani Peiris,Samuel Cornell,Kim Greaves,Carissa Bonner | | Patient Education and Counseling. 2021; | | [Pubmed] | [DOI] | | 28 |
Developing person-centred goal setting resources with and for people with aphasia: a multi-phase qualitative study |
|
| Amanda Elston,Rebecca Barnden,Deborah Hersh,Erin Godecke,Dominique A. Cadilhac,Natasha A. Lannin,Ian Kneebone,Nadine E. Andrew | | Aphasiology. 2021; : 1 | | [Pubmed] | [DOI] | | 29 |
Accuracy of Google Translate in translating the directions and counseling points for top-selling drugs from English to Arabic, Chinese, and Spanish |
|
| Bernadette R Cornelison,Sulaiman Al-Mohaish,Yizhou Sun,Christopher J Edwards | | American Journal of Health-System Pharmacy. 2021; | | [Pubmed] | [DOI] | | 30 |
Manifestations of Pain During the COVID-19 Pandemic Portrayed on Social Media: A Cross-Sectional Study |
|
| Ryan S D’Souza, Anthony E Kilgore, Shawn D’Souza | | Pain Medicine. 2021; | | [Pubmed] | [DOI] | | 31 |
Training researchers in dissemination of study results to research participants and communities |
|
| Jennifer Cunningham-Erves,Elizabeth Stewart,Jillian Duke,Sylvie A Akohoue,Nicole Rowen,Omaran Lee,Stephania T Miller | | Translational Behavioral Medicine. 2021; | | [Pubmed] | [DOI] | | 32 |
A Mixed-Methods Evaluation of Patient Education Materials for Colorectal Cancer |
|
| Ravinder Kang,Catherine H. Saunders,Elizabeth A. Carpenter-Song,Kayla O. Moore,Spencer W. Trooboff,Jesse A. Columbo,Philip P. Goodney,Sandra L. Wong,Srinivas Joga Ivatury | | Diseases of the Colon & Rectum. 2021; 64(10): 1249 | | [Pubmed] | [DOI] | | 33 |
Addressing the Gap, Advancing the Knowledge: Guidance for the Abstract Reviewer |
|
| Gwendelyn S. Orozco,Rudy R. Barreras,Rodney W. Hicks | | AORN Journal. 2021; 114(4): 319 | | [Pubmed] | [DOI] | | 34 |
Communications in the time of a pandemic: the readability of documents for public consumption |
|
| Catherine Ferguson,Margaret Merga,Stephen Winn | | Australian and New Zealand Journal of Public Health. 2021; | | [Pubmed] | [DOI] | | 35 |
How to make study documents clear and relevant: the impact of patient involvement |
|
| Sagar Jilka, Georgie Hudson, Sonja M. Jansli, Esther Negbenose, Emma Wilson, Clarissa M. Odoi, Magano Mutepua, Til Wykes | | BJPsych Open. 2021; 7(6) | | [Pubmed] | [DOI] | | 36 |
Development and psychometric validation for evaluating written medicine information in Thailand: The Consumer Information Rating Form |
|
| Kamonphat Wongtaweepkij,Janet Krska,Juraporn Pongwecharak,Supawinee Pongpunna,Narumol Jarernsiripornkul | | BMJ Open. 2021; 11(10): e053740 | | [Pubmed] | [DOI] | | 37 |
The Patient Perspective: Evaluating the Accessibility of Transoral Robotic Surgery Online Resources |
|
| Monica H. Xing, Raymond L. Chai | | Annals of Otology, Rhinology & Laryngology. 2021; : 0003489421 | | [Pubmed] | [DOI] | | 38 |
Evaluating Readability Scores of Treatment Summaries and Cancer Survivorship Care Plans |
|
| Jennifer Kue,Dori L. Klemanski,Kristine K. Browning | | JCO Oncology Practice. 2021; 17(10): 615 | | [Pubmed] | [DOI] | | 39 |
Letramento em saúde de cuidadores domiciliares de uma capital brasileira |
|
| Thales Antônio Martins Soares, Virginia Visconde Brasil, Katarinne Lima Moraes, Laidilce Teles Zatta Santos, Vanessa da Silva Carvalho Vila, Laerte Honorato Borges | | Acta Paulista de Enfermagem. 2021; 34 | | [Pubmed] | [DOI] | | 40 |
Adaptation of a theory-based social networking and gamified app-based intervention to improve PrEP adherence among young men who have sex with men in Bangkok, Thailand (Preprint) |
|
| Wipaporn Natalie Songtaweesin,Sara LeGrand,Shashika Bandara,Caitlin Piccone,Prissana Wongharn,Juthamanee Moonwong,Thidarat Jupimai,Chutima Saisaengjan,Tuangtip Theerawit,Kathryn Muessig,Lisa Hightow-Weidman,Thanyawee Puthanakit,Nittaya Phanuphak,Arunrat Tangmunkongvorakul | | Journal of Medical Internet Research. 2020; | | [Pubmed] | [DOI] | | 41 |
Assessing how information is packaged in rapid reviews for policy-makers and other stakeholders: a cross-sectional study |
|
| Chantelle Garritty,Candyce Hamel,Mona Hersi,Claire Butler,Zarah Monfaredi,Adrienne Stevens,Barbara Nussbaumer-Streit,Wei Cheng,David Moher | | Health Research Policy and Systems. 2020; 18(1) | | [Pubmed] | [DOI] | | 42 |
Development and testing of a guideline document to provide essential information for patient decision making regarding cancer clinical trials |
|
| Chi-Yin Kao,Sanchia Aranda,Meinir Krishnasamy,Bridget Hamilton | | European Journal of Cancer Care. 2020; | | [Pubmed] | [DOI] | | 43 |
Stakeholder involvement in the development of trial material for a clinical trial |
|
| Jacqueline Rix,Jonathan Branney,Alexander C. Breen,Philip Sewell,Sharon Docherty | | Health Expectations. 2020; | | [Pubmed] | [DOI] | | 44 |
Employing computational linguistics techniques to identify limited patient health literacy: Findings from the ECLIPPSE study |
|
| Dean Schillinger,Renu Balyan,Scott A. Crossley,Danielle S. McNamara,Jennifer Y. Liu,Andrew J. Karter | | Health Services Research. 2020; | | [Pubmed] | [DOI] | | 45 |
Fair-y Tales: An analysis of children’s books about sun safety |
|
| Lindsay McCormack,Fiatsogbe S. Dzuali,Anna Tappel,Jennifer T. Huang | | Pediatric Dermatology. 2020; | | [Pubmed] | [DOI] | | 46 |
Evaluation of the reading level of commonly used
medication-related
patient education sources
|
|
| Emily J. Perez, Kelly L. Covert, Paul O. Lewis | | JACCP: JOURNAL OF THE AMERICAN COLLEGE OF CLINICAL PHARMACY. 2020; 3(8): 1434 | | [Pubmed] | [DOI] | | 47 |
Legibilidad de los consentimientos informados en cirugía vascular y análisis de su evolución en el tiempo |
|
| E. García Rivera,E.M. San Norberto,L. Fidalgo Domingos,N. Cenizo Revuelta,I. Estévez Fernández,C. Vaquero Puerta | | Journal of Healthcare Quality Research. 2020; | | [Pubmed] | [DOI] | | 48 |
Assessment of quality of information available over the internet about vegan diet |
|
| Olivia Genevieve El Jassar,Isobel Nadia El Jassar,Evangelos I. Kritsotakis | | Nutrition & Food Science. 2019; | | [Pubmed] | [DOI] | | 49 |
eH
ealth tool for patients with abdominal aortic aneurysm: development and initial evaluation |
|
| Olga Nilsson,Rebecka Hultgren,Anna Letterstĺl | | Scandinavian Journal of Caring Sciences. 2019; | | [Pubmed] | [DOI] | | 50 |
A Readability Analysis of Online Cardiovascular Disease-Related Health Education Materials |
|
| Varun Ayyaswami,Divya Padmanabhan,Manthan Patel,Arpan Vaikunth Prabhu,David R. Hansberry,Nitin Agarwal,Jared W. Magnani | | HLRP: Health Literacy Research and Practice. 2019; 3(2): e75 | | [Pubmed] | [DOI] | | 51 |
Readability of endoscopy information leaflets: Implications for informed consent |
|
| Matthew C. Mason,James M.L. Williamson | | International Journal of Clinical Practice. 2018; : e13099 | | [Pubmed] | [DOI] | | 52 |
What is the quality of drug safety information for patients: An analysis of REMS educational materials |
|
| Hilda W. Chan,Andrea M. Russell,Meredith Y. Smith | | Pharmacoepidemiology and Drug Safety. 2018; | | [Pubmed] | [DOI] | |
|
 |
 |
|