BACKGROUND: The Medication Therapy Management (MTM) Program Standardized Format (SF) is a written summary of a comprehensive medication review (CMR) that must be provided to Medicare Part D beneficiaries. Concerns have been raised regarding the number of pages of the SF, mailing costs, the static nature of the document, and the lack of integration into beneficiaries’ electronic health records. To date, limited research exists on beneficiaries’ perceptions of the SF.
OBJECTIVE: To evaluate the perspectives of beneficiaries regarding the utility of the SF to inform potential modifications for optimal use.
METHODS: An online survey, designed based on the standard approach to measuring patient satisfaction with health service attributes and previous qualitative research, was distributed through Medicare Part D plans to beneficiaries who had received a CMR in the past year. Survey distribution began July 1, 2018, and data collection ended on October 31, 2018. Descriptive statistics are reported for demographic information; health status; perceived value and helpfulness of the SF and its 3 components (cover letter, medication action plan [MAP], personal medication list [PML]); updates to the SF; alternate formatting; and integration of the SF into health records.
RESULTS: A total of 9,975 surveys were sent electronically by 4 Medicare Part D plans to beneficiaries who had received a CMR in the past year. Of the 434 unduplicated survey respondents (response rate of 4.3%), 58.5% were aged 65 to 84 years; 60% identified themselves as white; and 49.1% had at least a college education. The most commonly reported comorbidities were diabetes (50.5%) and high cholesterol (43.1%), with 10.7% of respondents rating their health as “very good” or “excellent” and 27.4% choosing “poor” or “fair.” Beneficiaries rated how well the SF helped improve different aspects of their medication management (e.g., solving medication-related problems, keeping track of medications, correctly using medications, and understanding why medications are being taken), with 40.8%-44.9% choosing “very good” to “excellent” for each aspect. Helpful sections included “What we talked about” and “What I need to do”for the MAP, and medication name, strength, dosage form, and “How and why I use the medication” for the PML. Less helpful were the fill-in sections of the MAP, with 48.6% reporting that they did not write in any information. In contrast, 44.7% of the participants noted that they updated their PML. A wallet card version of the PML, if available, would be used by 54.6% of participants. About one third of Medicare beneficiaries shared the SF with their doctor, and 26% of the participants gave copies of their medication summary to their relatives.
CONCLUSIONS: Fewer than half of the respondents perceived the SF as very good or excellent in helping them to manage their medications. This national survey provides Medicare beneficiary-focused evidence that more work is needed to improve the usability and portability of the SF. This can be achieved by allowing flexibility in the design of the SF, while including essential elements.
DISCLOSURES: This study was funded by the Academy of Managed Care Pharmacy (AMCP), which provided a grant to the University of Maryland School of Pharmacy to conduct this study. Carden and Kumbera are AMCP employees. Brandt reports a grant from IMPAQ and consulting fees from Rand, outside of this study. Pellegrin is a member of the AMCP MTM Advisory Board. The other authors have nothing to disclose.
What is already known about this subject
Medicare beneficiaries find the medication therapy management comprehensive medication review service valuable, yet the Standardized Format (SF) is not “memorable.”
There is limited evidence about which aspects of the SF are valuable to Medicare beneficiaries and how the SF could be improved.
What this study adds
This study found that only 40.8%-44.9% of participants rated the SF as “very good” or “excellent” in helping to improve their medication management.
Within the SF, beneficiaries perceived the medication action plan (MAP) to be less useful than the personal medication list (PML), with 48.6% not writing in any information in the fill-in sections of the MAP.
Study results showed that 44.7% of participants reported that they updated their PMLs and noted the most useful sections to be medication name, strength, dosage form, and “How and why I use the medication.”
In 2006, the Centers for Medicare & Medicaid Services (CMS) began offering a prescription drug benefit known as Part D to Medicare beneficiaries. In addition to managing the coverage of specified medications, participating sponsors in the Part D program must provide eligible Medicare beneficiaries with access to medication therapy management (MTM) services. According to the requirements for MTM programs under 42 CFR section 423.153(d) of the Medicare Prescription Drug Benefit Manual, a Part D sponsor must have established an MTM program that (a) ensures optimum therapeutic outcomes for targeted beneficiaries through improved medication use, (b) reduces the risk of adverse events, (c) is developed in coordination with licensed and practicing pharmacists and physicians, (d) describes the resources and time required to implement the program and establishes the fees for MTM providers, and (e) may be furnished by pharmacists or other qualified providers.1
One part of the MTM program is the comprehensive medication review (CMR), an interactive session with the beneficiary and qualified MTM provider where medications are reviewed; drug therapy problems are identified; and a plan for resolution is developed. The CMR must be delivered face to face or using telehealth technologies by a licensed pharmacist or other qualified provider, with a written medication review and action plan and input from the prescriber as necessary and practical. Since January 1, 2013, all beneficiaries receiving a CMR were required to receive a written summary of the encounter using the MTM Standardized Format (SF).1 The goal of this requirement was to advance consistency in the CMR service by providing a template of expected content.2
Despite this requirement, barriers such as integration of the SF into electronic medical records and its lack of portability have decreased the potential utility of the CMR. Although there has been increased provider demand for electronic access to medication history and increased electronic exchange of health information among providers,3,4 the SF remains separate from the electronic medical record.
Beneficiaries have shared their perspectives on portability with CMS. In 2015, a survey of Medicare beneficiaries who had received a CMR found that one third could not recall receiving an SF, and 28% of those who remembered receiving one stated that they preferred a shorter personal medication list (PML) when they are taking a large number of medications.3 The utility of a long PML was examined in another survey of 9 Medicare beneficiaries who had also received a CMR.5 In the survey, 67% of beneficiaries noted that they personally created a separate, smaller handwritten list of medications for reference, presumably because the PML was not meeting their needs.
Other stakeholders have also raised concerns about the SF. Sharing the perspective of those implementing the SF requirement, the Academy of Managed Care Pharmacy (AMCP) noted that the typical SF is “10+ pages and costs an average of $1.39 to mail to the beneficiary.”6 Furthermore, Snyder et al. (2018) noted that pharmacists and pharmacy staff at 3 of 4 MTM practices reported dissatisfaction with the SF, noting that it was cumbersome and overwhelming for patients.7
Because there is limited beneficiary-centered evidence about the SF, the objectives of this study were to understand beneficiary perceptions regarding the Medicare Part D MTM SF and to evaluate the utility of the SF to inform potential modifications for optimal use.
The survey design was based on the standard approach for measuring patient satisfaction with health service attributes, as well as results obtained from previous research.8,9 In this approach, survey items reflect specific features of the episode of care, which, in our case, were the various aspects of the structure of the SF from the most recent CMR. Where appropriate, the response format of “excellent,” “very good,” “good,” “fair,” and “poor” was used rather than “very satisfied” to “very dissatisfied” because the former has been found to produce better psychometric properties.10 Global satisfaction items were also used to determine if any specific items were unrelated, indicating that specific feature was not likely a critical component of satisfaction with the overall episode of care, and which specific items were most strongly correlated, indicating those were likely the most critical components of satisfaction with the overall episode and, thus, priorities for improvement.
The emergent themes from the qualitative work included usefulness of certain SF sections, such as names of medications and how the patient should take them, and suggestions for additional sections, such as drug interactions, cheaper alternatives, and a priority listing of drugs. Another key theme was the suggestion for alternative methods or formats of delivery and more frequent updates. These themes were used to construct survey questions with multiple choices in 4 key focus areas: (1) overall value of the SF, (2) content and usability of the SF and its different sections, (3) delivery methods and updates, and (4) portability and sharing of the SF.
The survey was pilot tested based on the recommendations from a convenience sample of Medicare beneficiaries (n =10) and selected committee members of the AMCP Advisory Group who had been involved with MTM research and survey design (authors Kumbera and Pellegrin). Testers were asked to comment on the flow, clarity, and time to complete the survey. The wording, content, and duration of the survey were revised. Another round of testing with Medicare beneficiaries (n = 5) and members of the MTM research and survey design team accepted the revised survey, noting that it took approximately 20 minutes to complete.
The final survey was a structured questionnaire with 42 multiple-choice questions that covered the value and perception of the SF components (i.e., cover letter, MAP [medication action plan], and PML); the utility of individual sections within each component; the delivery of the SF; updates to the SF; and integration with health records (see Appendix, available in online article). There were 8 questions related to utility, 4 questions on use-based rating of the SF, 12 questions on the 3 components of the SF, and 3 questions on each component on the delivery and overall rating of the document. Most questions were perception based and had the potential responses of “yes,” “no,” or “not sure.” For the rating questions, the participants could choose 1 of 5 options: “poor,” “fair,” “good,” “very good,” and “excellent.” Deidentified demographic information was also collected. Participants were not asked to provide any information about their Medicare Part D plan.
Medicare Part D prescription drug plans and Medicare Advantage prescription drug plans that had representatives serving in the AMCP MTM advisory group, who were able to participate in this research, distributed the surveys electronically to beneficiaries’ email addresses of record. Plans distributed the electronic link to the survey using SurveyMonkey to a sample of Medicare beneficiaries who had received a CMR in the past year. Survey distribution began on July 1, 2018, and data collection ended on October 31, 2018. There were no incentives offered; some plans sent reminder emails. Additionally, on the landing page before entering the survey, participants were directed to call the University of Maryland research team if assistance with completing the survey was desired.
The descriptive analysis included all unduplicated surveys in the counts, irrespective of the completeness or recollection of receiving the SF. Duplicated surveys were identified by the Internet protocol address of the electronic survey submission, and in all instances, the most complete (i.e., the survey with the highest number of answered questions) survey response was retained for inclusion in the analysis. Nonresponders (i.e., participants who skipped 1 or more questions) were included in the denominator and also described as a separate category (“Did not respond/Skipped”) for each question. Counts and percentages were reported for demographic and clinical information (i.e., age, race, gender, ZIP code, education, comorbidities, number of medications) and self-reported health status. Using participant-reported ZIP codes, the participant’s geographic state was identified and then categorized into geographic regions as delineated by the U.S. Census Bureau.11 Counts and percentages are also reported for the perceived value and helpfulness of the SF and its 3 components (cover letter, MAP, and PML), along with beneficiaries’ opinions on updates to the SF, alternate formatting of the SF, and integration of the SF with health records. Correlation analyses were conducted to assess the relationship between ratings of specific aspects of the SF and overall ratings of the CMR service and the overall rating of the MTM service with demographic information including age, race/ethnicity, gender, education, and specific variables of interest, such as number of medications and self-reported health status. For the correlation analyses, a Pearson’s coefficient of 0.70 or higher was noted and a P value of < 0.05 was considered significant. Statistical analyses were performed using SAS statistical software, version 9.4 (SAS Institute, Cary, NC). This study was reviewed and approved by the University of Maryland, Baltimore, Institutional Review Board (IRB#HP00077628).
From July 1, 2018, through October 31, 2018, 434 unduplicated surveys were received, resulting in a survey response of 4.3%. The completion rate for the 434 surveys was 71%.
Of the 434 electronic survey respondents, which included beneficiaries or their caregivers (n = 23), 37.8% were aged 65-74 years; 60% were white; and 49.1% had at least a college education (Table 1). The most commonly reported comorbidities were diabetes (50.5%) and high cholesterol (43.1%), with 10.7% rating their health as very good or excellent and 27.4% choosing poor or fair. About one fourth of respondents did not provide an answer for every question in this section, which may be partially explained by the fact that these questions were at the end of the survey.
|Baseline Characteristics||n (%)|
|< 65 years||45 (10.37)|
|65 -74 years||164 (37.79)|
|75-84 years||90 (20.74)|
|> 85 years||13 (3.00)|
|Prefer not to say||3 (0.69)|
|Did not respond||118 (27.42)|
|Black/African American||12 (2.76)|
|Hispanic or Latino||13 (3.00)|
|Native Hawaiian or Other Pacific Islander||0 (0.00)|
|American Indian or Alaska Native||2 (0.46)|
|Prefer not to say||18 (4.15)|
|Did not respond||117 (26.96)|
|Prefer not to say||2 (0.46)|
|Did not respond||118 (27.19)|
|Highest education completed|
|Primary school||2 (0.46)|
|Some high school, no diploma||6 (1.38)|
|High school diploma (or GED)||82 (18.89)|
|College or higher||213 (49.08)|
|Prefer not to say||12 (2.76)|
|Did not respond||119 (27.42)|
|Did not respond||140 (32.26)|
|Number of medications|
|Did not respond||163 (37.56)|
|Very good||43 (9.91)|
|Did not respond||116 (26.73)|
|Diabetes/high blood pressure||219 (50.46)|
|High cholesterol (dyslipidemia)||187 (43.09)|
|Heart problems||117 (26.96)|
|Chronic obstructive pulmonary disease||95 (21.89)|
|Irregular heart rate (atrial fibrillation)||72 (16.59)|
|Chronic heart failure||42 (9.68)|
|Rheumatoid arthritis||42 (9.68)|
|Memory problems (dementia)||19 (4.38)|
|Did not respond||124 (28.57)|
GED = general equivalency diploma.
The CMR had been conducted via telephone for 86.6% of respondents and completed by a pharmacist in 68.7% of surveys (Table 2). More than half of respondents had their last CMR within the past 3 months, but approximately 1 of every 5 (21.4%) could not recall when they had their last CMR. Although 75.4% noted they received an SF after their review, 11.8% said they had not received one, and another 11.1% were not sure. A majority of respondents (60.8%) kept their SFs. In terms of repeated use of the SF, 44.9% looked at the SF sometimes; 6.5% looked at it often; and 37.6% did not look at it at all.
|In person||36 (8.29)|
|Over the phone||376 (86.64)|
|Telehealth videoconference||2 (0.46)|
|Do not recall||17 (3.92)|
|Did not respond||3 (0.69)|
|Provider completing medication review|
|Do not recall||80 (18.43)|
|Did not respond||65 (1.15)|
|Time of last CMR|
|Within the past month||111 (25.58)|
|Within the past 3 months||123 (28.34)|
|Within the past 6 months||30 (6.91)|
|Within the past year||73 (16.82)|
|Do not recall||93 (21.43)|
|Did not respond||4 (0.92)|
|Receipt of summary after the CMR|
|Not sure||48 (11.06)|
|Did not respond||8 (1.84)|
|If you received a medication review summary, did you keep it?|
|Not sure||75 (17.28)|
|Did not respond||35 (8.06)|
|If you kept your summary, how often do you look at it?|
|Not at all||163 (37.56)|
|Did not respond||48 (11.06)|
CMR = comprehensive medication review.
There was a high degree of correlation between 7 questions evaluating the usefulness of the SF and the overall rating of the MTM service. There was a significant correlation between overall rating of the medication review and 4 questions based on various uses of the SF, that is, help in understanding the medications, keeping track of the medications, correct use of medications, and solving problems related to medications (r ≥ 0.70, P < 0.001) There was also a significant correlation (r ≥ 0.50, P <0.001) between 3 questions on usefulness of the MAP and overall rating of the medication review. There was no significant correlation between the overall rating of the service and demographic information (i.e., age, gender, or education level) or the number of medications.
Using “poor,” “fair,” “good,” “very good,” or “excellent,” survey respondents were asked to rate how well the SF helped them with managing their medications, such as providing a better understanding of the medications, using them correctly, and tracking and solving any potential medication-related problems (Figure 1). Responses of “very good” to “excellent” ranged from 40.8% to 44.9% for the 4 questions and “poor” to “good” from 43.8% to 48.4%. Approximately 10% did not respond.
Respondents rated MTM service “very good” to “excellent” (41.7%) and 31.3% “good” to “poor.” However, 63% of respondents would recommend the MTM service to friends or relatives who needed help with their medications.
Most respondents (52.5%) found the cover letter helpful, and 35.3% preferred that the cover letter be kept in the SF. Between 47.5% and 50.5% found the MAP and the sections “What we talked about” and “What I need to do” helpful. However, 48.6% reported they did not write anything in the fill-in sections of the MAP. Furthermore, only 35.5% of respondents preferred keeping the MAP in the SF, whereas 31.8% had no preference, and another 20.1% skipped the question or did not respond.
The PML garnered more long-term utility, with 44.7% of the respondents reporting that they update their PMLs, and 14.3% reporting that they do not. The most useful sections of the PML were medication name, strength, dosage form, and “How and why I use the medication” (Figure 2). One in 4 (25.8%) preferred a vertical page format, and 22.6% preferred a horizontal page format; approximately half had no preference or skipped the question.
Participants expressed interest in adding information to the PML on common drug interactions (39.6%), side effects (40.3%), and special instructions (40.3%). Furthermore, 34.8% requested information about alternative medications in the same class that could be cheaper.
When asked for their opinion regarding the integration of the medication summary into their health records, over half (55.3%) of respondents were in favor, while 9.4% were against it, and 9.9% were not sure (Table 3). In addition, 42.9% felt that an electronic copy of the SF would be helpful.
|Questions on Integration and Format (N = 434)||n (%)|
|Your opinion on the length of the summary|
|Too long||47 (10.83)|
|Too short||2 (0.46)|
|Just the right length||215 (49.54)|
|Not sure||58 (13.36)|
|Skipped/did not respond||112 (25.81)|
|Would you use a wallet card, if one was provided?|
|Skipped/did not respond||100 (23.04)|
|What information would you like to be included on the wallet card?|
|Prescription medications||278 (64.06)|
|Alert medications for emergency personnel (e.g., use of blood thinner)||208 (47.93)|
|Over-the-counter medications||110 (25.35)|
|Medical conditions||218 (50.23)|
|Other (please specify)||18 (4.15)|
|Skipped/did not respond||119 (27.42)|
|Do you bring your medication review summary to your doctor visit?|
|Not sure||22 (5.07)|
|Skipped/did not respond||109 (25.12)|
|Do you give copies of your medication summary to your relatives?|
|Not sure||10 (2.30)|
|Skipped/did not respond||111 (25.58)|
The majority (54.6%) of respondents reported that they would use a wallet card if available and would prefer it be filled out with their information before receiving it (62.4%). When they were asked about what information they would like included on the wallet card, the most popular responses were prescription medications (64.1%), followed by medical conditions (50.2%) and alerts for emergency personnel, such as “patient is receiving blood thinners” (47.9%).
Finally, 30% of respondents brought their SFs to their doctors, and 39.6% did not; 26% gave copies of their SFs to their relatives, and 46.1% did not.
If requirements for Medicare eligibility remain the same, the Medicare population is expected to increase from 54 million in 2015 to more than 80 million beneficiaries in 2030. This increased population will likely result in an increased number of beneficiaries receiving the SF as part of the CMR service. There is growing importance in understanding the Medicare beneficiary perspective on the value and utility of the SF, as well as the MTM service, to improve medication-related outcomes. The findings from this study, the largest study to date to gather beneficiary perceptions of the Medicare Part D MTM SF, can provide insight into modernizing the MTM program. Because there were significant correlations between overall rating and recommendation for the MTM service with key questions from the survey, these results suggest that the SF is a meaningful part of the medication review service and that improving sections of the SF may improve overall ratings of the MTM service. While 63% of the 434 respondents in this survey would recommend the MTM service to their friends or relatives if they needed help with their medications, only between 40% and 45% rated the SF as very good or excellent.
All components of the SF contained essential elements, but Medicare beneficiaries shared their perspectives on how to improve the SF. Based on the results of this study, there are several recommendations to address beneficiary needs for each component of the SF:
Cover Letter: No modifications suggested.
Medication Action Plan: Remove the sections “What I did and when I did it”; “My follow-up plan”; and “Questions I want to ask,” that is, all sections that require the beneficiary to fill them out.
Personal Medication List: Remove the sections “Date I started” and “Date I stopped and why.” Further evaluate the Prescriber field. Create beneficiary-friendly mechanisms for more timely updates (e.g., health record portal).
However, these recommendations appear to make cuts or additions to the existing SF that may be short sighted. This is not the intent of these recommendations, but a beginning to identify helpful data elements that are meaningful to beneficiaries and facilitate integration. Layout and design of health information are important; thus, we included such items as part of our approach to measuring specific features of SF.12 Beneficiaries and health care providers support the integration of the SF into existing electronic health and medication records, yet there is no consensus on what the SF should “look like.”7 Rather, action should be taken to have consistent domains (i.e., data elements) that can be adapted to meet the needs of the beneficiary and his or her caregiver. For example, these changes would allow a modifiable printout (e.g., wallet card) for beneficiary and/or caregiver access, such as the current program available at eMedicare. Transforming the SF into interoperable elements meaningful to the beneficiary would help address integration and improve goal attainment of increased medication effectiveness and safety for Medicare Part D beneficiaries.13,14 However, there were 9.4% of Medicare beneficiaries who did not want this information integrated into their medical records. These findings are consistent with previous research on consumer attitudes regarding health information exchange. Although a majority support the use of health information exchange owing to perceived benefits, there are those who do not, likely due to privacy/security concerns.15,16 Furthermore, engaging Medicare beneficiaries and/or caregivers with CMR follow-up and the SF encourages them to be active in their health care decisions and promotes patient-centered care.17
The primary limitation of this study is the response rate of 4.3%, which is lower than the historic rate for the Medicare prescription drug plan Consumer Assessment of Healthcare Providers and Systems survey.18 Web surveys such as ours are more efficient but typically have lower response rates compared with mailed surveys.19 As of 2016, approximately 65% of Medicare beneficiaries indicated that they use the Internet daily or almost daily,20 but it is unclear how many surveys reached the intended recipients, owing to the inaccuracy of email addresses on record, or were opened, owing to incompatibility with technology used to access emails.
Despite the relatively low response, the race, age, and other demographics presented are reflective of the greater Medicare beneficiary population. For instance, 60% of our respondents were white, and according to the Medicare Payment Advisory Committee report, 74% of beneficiaries are white. Further, 40% of our respondents had a college or postgraduate education, whereas 19% had a high school diploma only, compared with national estimates of 54% and 28% respectively.21 Additional research is needed to confirm these findings.
Although recall bias is a concern with surveys, this aspect was minimized by limiting those eligible for inclusion to those who had had a CMR within the past year. Participating Part D plans were asked to sample from those beneficiaries who had a CMR within the past year. Future studies should continue to engage the Medicare beneficiary in codesign of health care services and format of medication information.
Fewer than half of the Medicare beneficiary respondents perceived the SF as very good or excellent with helping to manage their medications. This national survey, the largest to date, provides Medicare beneficiary-focused evidence that more work needs to be done to improve the usability and portability of the SF. These aspects can be achieved by allowing flexibility in the design of the SF while requiring essential elements. MTM programs need to integrate the SF into health records and allow a modifiable printout available (e.g., wallet card and other digital, user-friendly formats).
|1.||Centers for Medicare & Medicaid Services. Part D medication therapy management (MTMP) program. Modified January 23, 2019. Available at: https://www.cms.gov/medicare/prescription-drug-coverage/prescription-drugcovcontra/mtm.html. Accessed February 6, 2019. Google Scholar|
|2.||Centers for Medicare & Medicaid Services. Medicare Part D medication therapy management standardized format. Revised August 15, 2012. Available at: https://www.cms.gov/Medicare/Prescription-Drug-Coverage/PrescriptionDrugCovContra/Downloads/MTM-Program-Standardized-Format-English-and-Spanish-Instructions-Samples-.pdf. Accessed February 6, 2019. Google Scholar|
|3.||Gabriel MH, Smith JY, Sow M, Charles D, Joseph S, Wilkins TL. Dispatch from the non-HITECH–incented Health IT world: electronic medication history adoption and utilization. J Am Med Inf Assoc. 2015;23(3):562-69. Crossref, Google Scholar|
|4.||Swain M, Charles D, Patel V, Searcy T. Health information exchange among US non-federal acute care hospitals: 2008-2014. ONC Data Brief No. 17. May 2014. Available at: https://www.healthit.gov/sites/default/files/oncdatabrief17_hieamonghospitals.pdf. Accessed February 6, 2019. Google Scholar|
|5.||Cooke C, Kaiser M, Natarajan N, Brandt N. Medicare beneficiary satisfaction with comprehensive medication review and the standardized format. J Manag Care Spec Pharm. 2015;21(10-a):S79-S80 [Abstract U29]. Available at: https://www.jmcp.org/doi/pdf/10.18553/jmcp.2015.21.10.S1. Google Scholar|
|6.||Cantrell SA; Academy of Managed Care Pharmacy. Re: CMS-10396 medication therapy management program improvements. December 30, 2016. Available at: http://www.amcp.org/WorkArea/DownloadAsset.aspx?id=21758. Accessed February 6, 2019. Google Scholar|
|7.||Snyder ME, Jaynes, HA Gernant SA, Lantaff WM, Hudmon KS, Doucette WR. Variation in medication therapy management delivery: implications for health care policy. J Manag Care Spec Pharm. 2018;24(9):896-902. Available at: https://doi.org/10.18553/jmcp.2018.24.9.896. Google Scholar|
|8.||Crow R, Gage H, Hampson S, et al. The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess. 2002;6(32):1-244. Crossref, Google Scholar|
|9.||Sharma K, Cooke CE, Howard A, Chater R, Vogler A, Brandt NJ. Beneficiary-driven changes to the Part D medication therapy management standardized format. J Manag Care Spec Pharm. 2018;24(10-a):S95 [Abstract U26]. Available at: https://www.jmcp.org/doi/pdf/10.18553/jmcp.2018.24.10-a.s1. Google Scholar|
|10.||Ware JE Jr, Hays RD. Methods for measuring patient satisfaction with specific medical encounters. Med Care. 1988;26(4):393-402. Crossref, Google Scholar|
|11.||U.S. Census Bureau. Geographic terms and concepts—census divisions and census regions. Revised February 9, 2015. Available at: https://www.census.gov/geo/reference/gtc/gtc_census_divreg.html. Accessed February 6, 2019. Google Scholar|
|12.||Centers for Disease Control and Prevention. Simply put: a guide for creating easy-to-understand materials. 2009. Available at: https://www.cdc.gov/healthliteracy/pdf/simply_put.pdf. Accessed February 6, 2019. Google Scholar|
|13.||Ogle SM, Cooke CE, Brandt NJ. Medication management and e-care planning: what are the opportunities for the future? J Geron Nur. 2015;41(10):13-17. Crossref, Google Scholar|
|14.||Look KA, Stone JA. Medication management activities performed by informal caregivers of older adults. Res Soc Admin Pharm. 2018;14(5):418-26. Crossref, Google Scholar|
|15.||Dimitropoulos L, Patel V, Scheffler SA, Posnack S. Public attitudes toward health information exchange: perceived benefits and concerns. Am J Manag Care. 2011;17(12 Spec No.):SP111-SP116. Google Scholar|
|16.||Ancker JS, Edwards AM, Miller MC, Kaushal R. Consumer perceptions of electronic health information exchange. Am J Prev Med. 2012;43(1):76-80. Crossref, Google Scholar|
|17.||Schulte N, Ruisinger JF, Prohaska ES, Steele KM, Melton BL. Comprehensive medication review recipients opinions, actions, and information recall. J Am Pharm Assoc. 2017;57(3):407-11. Crossref, Google Scholar|
|18.||Centers for Medicare & Medicaid Services. Medicare Advantage and prescription drug plan CAHPS survey. Modified January 30, 2019. Available at: https://www.ma-pdpcahps.org/en/historic-data/. Accessed February 6, 2019. Google Scholar|
|19.||Tesler R, Sorra J. CAHPS survey administration: what we know and potential research questions. Available at: https://www.ahrq.gov/sites/default/files/wysiwyg/cahps/about-cahps/research/survey-administration-literature-review.pdf. Accessed February 6, 2019. Google Scholar|
|20.||Centers for Medicare & Medicaid Services. eMedicare—another step to strengthening Medicare! [blog]. October 18, 2018. Available at: https://www.medicare.gov/blog/emedicare-another-step-to-strengthening-medicare. Accessed February 6, 2019. Google Scholar|
|21.||Medicare Payment Advisory Commission. A data book: healthcare spending and the Medicare program. June 2018. Available at: http://medpac.gov/docs/default-source/data-book/jun18_databookentirereport_sec.pdf?sfvrsn=. Accessed February 6, 2019. Google Scholar|