April 22, 2024

A Didactic and Case-Based Education Program for Pharmacists

Introduction

Pharmacogenomics (PGx) is a field of medicine and pharmacy that stands to reduce hospitalizations,1,2 improve drug efficacy and safety,3–5 and through these measures ultimately reduce patient morbidity and mortality. PGx accomplishes this by tailoring drug therapy to individual patient DNA sequences encoding for drug metabolizing enzymes, transporters, receptors, and other functional proteins.6,7 Published guidelines are available through the Clinical Pharmacogenetics Implementation Consortium (CPIC), the Dutch Pharmacogenetics Working Group (DPWG), the Canadian Pharmacogenomics Network for Drug Safety (CPNDS), and the French National Network of Pharmacogenetics (RNPGx). A compilation of these guidelines, along with dosing labels by the United States Food and Drug Administration (FDA) website, are available through the Pharmacogenomics Knowledge Base (PharmGKB) for the interpretation and application of PGx information.8,9 Furthermore, PGx information is now incorporated into the drug information available within commonly used online medication resources, such as Lexicomp and Micromedex.10 PGx reports typically provide phenotype interpretation from genotype to metabolizing enzymes, transporters, receptors, and other functional proteins, occasionally aided by the health-care provider’s assessment for phenoconversion. When used in conjunction with other factors such as organ function, laboratory test results, clinical symptoms, concomitant medications, and environment/lifestyle factors,11 health-care providers are able to tailor a drug therapy plan for the patient in what is known as precision medicine.12,13 While pharmacists are nominated and acknowledged to be the best-suited health-care provider to interpret PGx test results, and subsequently recommend appropriate drug therapy,14,15 few pharmacists have the training, knowledge, or confidence to do so currently (Table 1). Within the results of a recent scoping review on the implementation of pharmacogenomics in pharmacy practice,16 it was identified that settings with well-described pharmacist PGX education programs prior to providing such services saw greater prescriber acceptance of recommendations, compared to studies without pharmacist education. This demonstrates the improved ability of PGx-educated pharmacists to assess drug–gene interactions (DGIs) and communicate the appropriate management of these interactions to other health-care providers. Therefore, it is critical pharmacists are equipped with sufficient knowledge and understanding of pharmacogenomics in order to safely, effectively, and confidently assess medications with pharmacogenetic implications. Albeit the gap in pharmacogenomics education has improved in the last decade,17–19 currently practicing pharmacists and recent graduates alike will need to be provided with updated information in this rapidly evolving field through continuing education programs. By supplementing pharmacists’ established competencies in medication therapy management (MTM) and patient education,11,20 we can ensure the effective implementation of PGx within the pharmacy patient care process, to the betterment of patient drug therapy outcomes.

Table 1 Recent Survey Assessments of Pharmacist Knowledge, Confidence, and Training in Pharmacogenomics. While There Have Been Very Few Studies in Canada Analyzing This Data, Studies Globally Reflect the Current Landscape of Pharmacist Competence in Pharmacogenomics

There are important considerations in developing a PGx program for practicing pharmacists. One is that effectively studied and validated teaching methods should be utilized. Case-based learning has been shown to be highly effective in the education of pharmacists21–23 and pharmacy students24,25 in pharmacogenomics, and has demonstrated its utility in other therapeutic topics as well.26 While there are a few PGx education programs available for continuing education in Canada, only one of these has been evaluated to date.21 Teaching methods from these studies and other research in pharmacy education26–29 can be adopted, there is a need to develop and validate a new program for Alberta pharmacists specifically. In this province, practice is wider in scope compared to other Canadian provinces and to other countries, as it includes the additional authorization to independently prescribe.30 Other research in Alberta supports the benefit to patients that can be realized with pharmacist prescribing in chronic disease management. In another Alberta-based study, patients with hypertension managed directly by pharmacists (utilizing prescribing when required to titrate or change medications) experienced a 18.3±1.2mmHg reduction in systolic blood pressure, compared to the reduction of 11.8±1.9mmHg observed in a control group receiving standard education without pharmacist prescribing.31 This ability to ensure patients receive optimal pharmacotherapy can potentially extend into PGx services, as pharmacists can incorporate PGx test results into their medication therapy plan.

The aims of this study were to 1) establish an up-to-date, validated PGx webinar course that covered the competencies established by Roederer et al (Figure 1),32 key therapeutics identified in scoping the literature available on PGx in pharmacy practice,16 and insights shared by international PGx experts; 2) evaluate the impact of this course on the knowledge and confidence of Alberta pharmacists in PGx; 3) explore the baseline understanding of PGx among study participants; 4) develop a validated continuing education and course curriculum that can be shared with other Alberta pharmacists asynchronously for wider future implementation of PGx in Alberta.33

Figure 1 Pharmacogenomic competency domains, adapted from Roederer et al.32

Methods

General Design

This was a longitudinal survey-based observational study measuring the impact of a training program on pharmacists’ knowledge, confidence, and opinions of PGX delivered as either a live two-day webinar, or as a self-study course derived from recordings and written materials included in the live sessions. Participants served as their own control, answering the same survey prior to and after the education program. Instructors were invited from Canada, USA, Egypt and Qatar to facilitate incorporation of global perspectives in PGx.

Participants

Recruitment

Practicing pharmacists in the province of Alberta, Canada, were recruited through email correspondence with pharmacy managers, general social media posts, and word-of-mouth referrals for either synchronous, asynchronous, or mixed attendance. After expressing interest from a potential participant, a formal recruitment email was sent to the potential participant with details regarding both the research study and PGx course. The recruitment email contained a link to the implied consent form and pre-course survey. Recruitment commenced March 2021. Synchronous and mixed participants were accepted until the night before course commencement on June 12, 2021, and asynchronous participants were eligible for inclusion in primary outcome data analysis if pre-course and post-course surveys were completed prior to 23:59 September 20, 2021.

Inclusion Criteria

Any pharmacist with an active pharmacy practice Alberta license was eligible for inclusion, and there was no specific exclusion criteria. Pre-course surveys without a matched post-course survey were still eligible for inclusion in the secondary outcome analysis of baseline knowledge and confidence among practicing pharmacists.

Outcomes

The primary outcome of this research study was the change in median Likert Scale scores for opinion/confidence questions, as well as the change in mean knowledge quiz scores, in paired data analyses of pre-course and post-course surveys. The secondary outcomes of interest were the baseline demographic, individual opinion/confidence answers, and knowledge quiz scores in the pre-course survey only. The secondary outcomes were compared among subgroups of pharmacists based on prior training in pharmacy, years of practice, age, gender, and prior exposure to pharmacogenomics.

Survey Design

A survey was created to collect demographic and pharmacy education/experience pre-course and measure subjective and objective competency in pharmacogenomics both pre- and post-course. Education and experience questions focused on practice environment as well as prior exposure to PGx information. There were 11 questions on pharmacist opinions and confidence on pharmacogenomics, each to be rated on a Likert Scale, with possible answers consisting of “Strongly Agree,” “Agree,” “Neutral,” Disagree,” and “Strongly Disagree.” The survey closed with 7 exam-style questions testing pharmacogenomics knowledge, with varied question types that included single choice and multiple checkbox answers to total a maximum potential mark out of 14. Questions for both Likert Scale and knowledge quiz were created utilizing a review of similar research and consultation with experts. The topics addressed in these were considered of high importance for pharmacist PGx competencies according to the American Association of Colleges of Pharmacy.32 Survey questions underwent face validation by pharmacy educators and practicing pharmacists to ensure clarity of questions. The surveys took approximately 10 minutes for participants to complete. The full survey is available in Supplementary Materials 1.

Pharmacogenomics Education Course Content

The training program consisted of 11 lectures (Supplementary Materials 2, Table S2.1) by various experts covering the competences and therapeutics identified in Figure 132 and the scoping review,16 respectively, and 6 case studies developed by the research team (Supplementary Materials 2, Table S2.2). Speakers were invited by the research team based on their expertise in the field of PGx in pharmacy, with an aim to recruit experts from different countries to incorporate an international PGx approach. The therapeutic areas of focus for this course were selected based on a scoping review on the use of pharmacogenomics in pharmacy practices.16,28 Particularly, the applications of PGx in cardiovascular, psychiatric, and pain indications, which all have guidelines available from organizations such as the CPIC, were found in the literature to be feasible and clinically useful in the pharmacy setting.16 The AACP PGx Competency statement32 also informed the education sessions on basic genetic and pharmacogenetic knowledge, as well as the ethical, legal, social, and practical implications of use of PGx in pharmacy practice. The pharmacist patient care process11,34 was utilized within a dedicated session as well as throughout course and case-study design to emphasize the role of PGx information in concert with other patient characteristics and the larger clinical picture.

The preliminary design of this research study and course was a completely synchronous program to take place over two days, ideally in a live conference setting. However, due to the circumstances of the COVID-19 pandemic, the decision was made to utilize virtual venues in concordance with public health guidelines at the time. Participants were provided with the option to attend both days live (synchronous, virtually), self-study (asynchronous, online), or a combination of these options suitable to their schedule and commitments (mixed).

Synchronous Course

For participants able to attend some or all the content live, a virtual course was held over Zoom (Zoom Video Communications, Inc., San Jose, California) on June 12–13, 2021, for 5 hours each day. Handouts were provided the night prior to each day, containing lecture slides and case studies without answer keys. Within each major topic, case studies would be provided for participants to work through with the facilitators in between didactic sessions. Breakout rooms were included in half of the cases to allow participants to interact with one another and solve problems posed within the cases together with a course facilitator (a research team member and the invited speaker). Each didactic lecture included a question-and-answer period with the speaker, with questions from the chat-box read out by a moderator. The use of a chat-box was to ensure participant confidentiality in recordings of sessions in alignment with research ethics, as these recordings were used in the asynchronous course described below. The breakout rooms where discussions occurred between facilitators and speakers were not recorded. Live didactic sessions ran for 15–45 minutes per session (including the Q&A), and 15–30 minutes were spent on each of the case studies.

Asynchronous Course

For participants requiring self-study for some or all the course content, the live sessions were recorded and organized into individual modules. Case studies were provided with answer keys and instructions on the suggested timing to complete the case within the order of the video content. Mixed participants unable to attend the first day live were provided the session recordings, handouts, and case studies by email, with sufficient time to complete these before the second day sessions. Completely asynchronous participants were given access as “viewers” of a Google Drive folder (Google LLC, Mountain View, California) after completing the pre-course survey. The course folder contained instructions for completing the course, each individual session video with slide handout, case studies with answer keys, and supplementary materials such as additional readings and resources referenced in the course. Asynchronous participants were advised of a deadline of September 13, 2021, to complete the post-course survey.

Data Collection

Study data were collected and managed using REDCap electronic data capture tools hosted at the University of Alberta.35,36 REDCap (Research Electronic Data Capture) is a secure, web-based software platform designed to support data capture for research studies. Pharmacists who expressed interest in participating were sent a pre-course survey from REDCap prior to attending the live course or receiving access to the course materials depending on synchronous or asynchronous participation, respectively. After participants completed either synchronous or asynchronous learning, they received the post-course survey by email. Synchronous participants were given time before closing remarks to complete the post-course survey, and asynchronous participants were provided direction to complete the post-course survey as soon as reasonably possible after viewing all videos and completing all case studies. Participants were not provided with their answers to either survey after completion.

Statistical Analysis

Participant demographic data was summarized as mean ± standard deviation (SD), or n (%) for normally distributed numerical variables and categorical variables, respectively. The Central Limit Theorem (CLT) was applied to non-normal data with an n ≥ 30, while non-normal data with an n < 30 was summarized as median (interquartile range; IQR). Likert scale responses were coded as follows: Strongly Disagree (1), Disagree (2), Neutral (3), Agree (4), and Strongly Agree (5), with a higher number reflecting more positive opinions/greater self-confidence. Answers to these questions were analyzed for the primary outcome by paired Wilcoxon Rank Sum analysis for the Likert scales used, and the knowledge-based quiz was graded by the research team and compared pre- and post-education as mean ± SD in a paired Student’s t-test if distribution was normal or CLT could be applied. If these assumptions were not met, Wilcoxon Rank Sum was used for analysis. In the secondary analysis, individual responses to Likert scale and knowledge test questions were summarized as n (%). Subgroup comparisons of Likert-scale responses and non-normal knowledge test data were compared using Wilcoxon Rank Sum or Kruskal–Wallis test depending on the number of groups. If significance was found with Kruskal–Wallis, the Dunn test was used for multiple comparisons and adjusted p-values were manually calculated for the number of comparisons. A forward selection linear regression was built for knowledge test scores for all pre-course surveys received using demographic and education history data and mean value of confidence rated on the Likert-scale questions. A similar regression was built for mean confidence scores using demographic and education history data and knowledge test scores pre-course. The mean values were used in the linear regression on confidence scoring rather than median for higher sensitivity. Lastly, to validate the subjective survey administered, mean Likert responses were compared to mean test grades for participants in a linear analysis for all pre-course surveys, all post-course surveys, and the calculated difference in these values from pre-course to post-course. All statistical analyses were performed using STATA version 17 (StataCorp, College Station, Texas, USA), and a p < 0.05 was considered statistically significant.

Ethics Approval

Informed implied consent form was included on the cover page of both the pre-course and post-course surveys. Electronic Consent was implied by completion of the surveys, documented in the de-identified participant record by the completed status on the REDCap database. Written (wet ink) consent was not sought out due to the virtual nature of participation for live course participants from a broad geographical region, and due to the asynchronous nature of participation for self-study course participants. Within this study design, participants never met in person with the research team. However, the study procedures were explained to each participant through the invitation email approved through ethics, with a member of the research team responding to any potential participant queries in a timely manner. The study team’s contact information was provided to all participants within the implied consent form, which participants were advised to print for their records. This study and consent procedure was approved by the University of Alberta Research Ethics Board (Pro 0108818).

Results

Participants

Table 2 Demographics, Education, and Pharmacogenomics Exposure for Participating Pharmacists

At least 2000 pharmacists were reached through social media, email, and word of mouth referrals (Figure 2). While there is no method to determine the true number of potential participants reached by social media, interested pharmacists reached out through email and social media for more information, and were subsequently sent an email invitation to participate in the study. There were 69 Alberta pharmacists invited to complete the initial pre-course survey. A total of 36 pharmacists were included in the primary outcome analysis: 10 attended all live Zoom sessions synchronously, 9 participated through a combination of synchronous and asynchronous methods, and 17 completed the course asynchronously only. An additional 23 pre-course surveys without a matched post-course survey were included in the secondary analyses. Pharmacist demographics are summarized in Table 2. Most pharmacists who completed both surveys for primary analysis had community experience (88.9%) and over a third had worked in hospital settings. In the primary analysis, only 11 (30.6%) had no prior education or exposure to pharmacogenomics.

Figure 2 Pharmacists were recruited to participate through a variety of measures that resulted in 69 official study invitations. Of these, 85.5% completed the initial survey, and 52.2% completed both surveys.

Knowledge, Confidence, and Opinions

Survey Validation

In addition to face validation, simple linear regression analyses were performed to determine correlation between subjectively rated knowledge (mean Likert scale responses) and objectively tested knowledge (mean scoring on quiz portion of survey). Moderate, statistically significant relationships between subjective and objective knowledge was observed (pre-course r = 0.476, p < 0.001; post-course r = 0.401; p = 0.015). This indicated that a participant’s subjectively rated knowledge was proportional to their objectively tested knowledge, with this relationship slightly stronger prior to education.

Subjective Self-Rated Confidence

Impact of Pharmacogenomics Course on Confidence

Figure 3 Mean Likert responses in agreeance with confidence in pharmacogenomics increased by 0.12±0.20 points for every correct answer gained on the knowledge test after education (r = 0.516; p = 0.002; n = 34).

As noted in the statistical analysis, Likert Scale responses were coded 1 = “Strongly Disagree” to 5 = “Strongly Agree”. Pharmacist responses to Likert Scale statements changed from a median of “Disagree” (2 [2,3]) to “Agree” (4 [4,4]) after pharmacogenomics education (p < 0.001) in the 36 participants included in the primary analysis, indicating an overall improvement in participant self-rated knowledge. The improvement in mean subjectively rated knowledge (Likert scales) was determined to have a positive linear relationship with improvements in objective knowledge test grades with pharmacogenomics education (Figure 3), meaning those who experienced greater improvement in their own self-assessed competency, had also experienced greater improvement in their objectively tested knowledge. Statistically significant improvements in subjective responses were observed consistently among each individual question (Figure 4), showing global improvement among all PGx domains. There was no significant difference in the change in subjective knowledge or the final subjective knowledge as rated on the Likert scale based on course participation method, all methods demonstrated improvement in PGx subjective and objective knowledge. Furthermore, there were no identified participant characteristics such as experience, years of practice, or prior use of PGx that indicated a difference in final post-course confidence.

Figure 4 Frequencies of responses to 11 Likert scale (1–5) questions by participants (n = 36) before and after pharmacogenomics education. *One missing value in pre-course survey.

Baseline Confidence Assessment

Among the 59 pre-course surveys received, median responses for nearly all questions were “Disagree” (2) at baseline. Only the two opinion-based statements, “Pharmacogenomics can enhance the provision of medication-related services (eg, dispensing, care-planning)” and “Pharmacogenomics testing is cost-effective” received median responses greater than 2 (these were 4 and 3, respectively). There was a significant difference in baseline median confidence/opinions between pharmacists with prior PGx training in their degree program vs those without (2 [2,3] vs 2 [1.5,2]; p = 0.003); and in internationally educated pharmacists vs Canadian graduates (3 [2,4] vs 2 [2,2]; p = 0.005).

When a forward selection linear regression was built with the mean Likert responses, higher objective knowledge test scores (p = 0.001), international education (p = 0.006), prior experience with PGx testing (p = 0.137, included due to plausible effect), and prior PGx education in degree program (p = 0.002) and in continuing education (p = 0.021) were all found to fit a model that explained 53.1% of the variation in mean Likert responses agreeing with positive opinions and subjective knowledge in PGx pre-course (p < 0.001). Objective knowledge test scores alone appeared to account for 22.6% of the variation in Likert responses on its own in pre-course analysis. This relationship was slightly less strong post-course, with only 16.1% of variation in Likert responses explained by objective knowledge.

Objective Tested Knowledge

Impact of Pharmacogenomics Course on Knowledge

Figure 5 Pharmacists (n = 36) completed a knowledge test before and after pharmacogenomics education.

Mean participant grades in the knowledge test portion of the survey improved significantly pre-course vs post-course (20.8±21.9% vs 70.2±19.1%, p < 0.001; Figure 5). Each question saw significant improvement in correct responses post-course (Table 3). There was no difference between course participation methods and the quantitative test grade improvement of participants (synchronous, asynchronous, mixed; 64.3% [42.9, 78.6], 42.9% [42.9,57.1], 42.9% [35.7, 50.0]; p = 0.199), albeit synchronous participation had numerically greater test grade improvement than asynchronous and mixed methods. In comparing standalone post-course grades, there was only a significant difference in median grades between the synchronous and mixed groups (78.6% [78.6, 92.9] vs 64.3% [42.9, 78.6]; adj-p=0.014), while the difference in synchronous vs asynchronous (78.6 [57.1, 78.6]) approached significance (adj-p=0.091). The only demographic/exposure factor found to impact post-course grades was that hospital experience resulted in better post course grades (64.0±21.3% without hospital experience vs 80.1±8.5% with hospital experience; p = 0.003).

Table 3 Breakdown of Participant (n = 36) Responses to Knowledge Test Questions (in Bold Text) Pre Vs Post Course

Baseline Knowledge Assessment

In a forward selection linear regression analysis, practice experience less than 10 years (p = 0.034), hospital practice (p = 0.005), foreign pharmacy education (p = 0.209), and higher subjective self-assessments (p = 0.012) all predicted higher pre-course tested knowledge, accounting for 38.2% of variation in pre-course knowledge test scores (p < 0.001). While country of pharmacy education was not significant, it was included in the multivariate model due to its effect on other covariates (without interaction), and impact on r2. As noted in the subjective Likert response results, higher post-course subjective confidence/opinions predicted better post-test grades.

Discussion

Pharmacogenomics in clinical practice involves testing genes for certain metabolizing enzymes, receptors, and other functional proteins that are involved in drug disposition and/or effect.6,7 This information is used alongside other patient factors such as signs, symptoms, lab values, and preferences, to select optimal drug therapy.12,13 Other components of PGx include the education the HCP must provide the patient before and after testing, and the communication of PGx information with other health-care providers. Such clinical PGx use in pharmacy practice has increased dramatically over the last decade.16 This study resulted in the development of a two-day webinar-style course in PGX for practicing pharmacists to support future clinical implementation. This course was further adapted as a self-study program, and both methods of learning showed significant improvement in self-rated (subjective) knowledge as well as proportional improvement in tested (objective) knowledge. Interest in this course was relatively high considering the COVID-19 pandemic, wherein pharmacists’ priorities were already stretched in delivering vaccinations, asymptomatic testing, managing drug shortages exacerbated by the crisis, and patient education, all in addition to pre-existing clinical and distributive roles.37 In social-media and email communications, there were 69 pharmacists that reached out with interest in this research study, and of these, 85.5% completed the initial survey and 52.2% completed both pre- and post-course surveys. Anecdotally, many potential participants indicated that the flexibility provided by the self-study option suited their current practice and educational needs as they could complete the material between these competing priorities. While online learning has been present for much of the history of the internet, the recent COVID-19 pandemic has appeared to enhance learners’ ability to utilize this platform for education,38 and this benefit lends itself to this course in many ways. Due to the online nature, speakers were able to be recruited worldwide and as far away as USA, Egypt and Qatar. This allowed the facilitation of a global perspective on the emerging field of PGx, which truly has been an international effort over the last decade. It also brought in a diverse population of Alberta pharmacists within both the synchronous and asynchronous platforms. Participants varied in practice experience, education, and prior knowledge in PGx. Despite these differences, only hospital practice experience appeared to lead to the greatest retained PGx knowledge indicated by testing, and no participant characteristics affected the level of confidence experienced post-course.

The results of this study suggest a positive effect of this pharmacogenomics course on both subjective and objective short-term knowledge of pharmacists in pharmacogenomics. Pharmacists transitioned from a median of “Disagree” with competency statements pre-course, to a median “Agree” post-course, indicating positive opinions of their own abilities to manage, interpret, and communicate pharmacogenomic information after receiving education, ie, a greater level of confidence. Tested knowledge also improved by more than 3-fold, with participants answering on average 6.9±3.2 more questions correct (out of a total possible score of 14) in post-course surveys compared to pre-course. Furthermore, there is strong correlation (r = 0.516; p = 0.002) between improvements in pharmacists’ tested and self-rated knowledge assessments. This observation indicates two things: 1) improved knowledge was observed by participants themselves, therefore supporting pharmacists confidently applying PGx in practice; and 2) that high self-rated confidence after learning was not simply hubris. This correlation, in addition to moderately strong linear relationships between pre and post course subjective and objective knowledge measures validates pharmacists’ ability to recognize and accurately rate their own knowledge in pharmacogenomics using the survey in this study. Thus, they felt more confident in their knowledge and appear able to actualize this potential with the correct use of knowledge gained.

The course provided to study participants included a blend of didactic and case-based learning similar to those used by Zembles et al.,23 Kisor et al39 and Crown et al.21 The results of this research were congruent with the latter two studies in both subjective and objective measures.21,39 While Zembles did not report knowledge results, their study did reveal high satisfaction with this method of training congruent with findings of Crown.21,23 The mixture of learning methods in the presented study had also supported learning by providing the immediate opportunity within case studies to practice knowledge and skills gained in the lectures. Another study by Kisor et al indicated the critical need for experiential education in PGx training.40 While Kisor et al did see pharmacist knowledge improve in all domains of the AACP pharmacogenomics competencies without case-based learning,32,40 other research, including the results of this study, supports the use of case studies in long-term retention of knowledge gained. One study on pharmacist education in weight management saw the best subjective and objective knowledge four weeks after learning in the small-group discussions, closely followed by large-group discussions, compared to lecture-only groups, indicating better knowledge retention with peer-based learning.28 The size of the group discussions in the presented study was of similar size to the small-groups in Sarayani et al, with even smaller groups in the three break-out room portions of the live course. Other studies have proved the merits of peer discussion in pharmacist and pharmacy student education in pharmacogenomics,28,41 with particular interest in the “flipped classroom” concept, wherein lectures are delivered asynchronously while classroom time is entirely devoted to utilize critical thinking and application of knowledge gained from lectures.42 One such study on pharmacy students found that specific pharmacogenomic items with flipped content had significant improvement in correct responses on test questions compared to traditional didactic methods.43 Such a method could be adopted for future pharmacogenomics courses such as this, to allow more time for participant interaction, questions, and practice within cases while shortening the overall time required for live attendance. While asynchronous participants did not receive the benefit of a formal group discussion, the case studies were presented in a scripted format, allowing the participant to read the questions as if they were being asked by a facilitator. They would be asked to solve the question posed before turning to the answer key, then proceed with the next question, thus accomplishing the experiential component. One case study is provided, for example, in Supplementary Materials 3. This design of asynchronous case study appears to be effective in providing similar quality of education to live group discussion, as post-course knowledge and confidence did not appear to differ between synchronous and asynchronous participation methods. The difference in post-course grades seen between synchronous and mixed methods (78.6% [78.6, 92.9] vs 64.3% [42.9, 78.6]; adj-p=0.014), may be explained by the gap that many participants had between day 1 of live participation, and final course completion indicated by the date of the post-course survey (approximately 3 months). This suggests that future iterations of this course forgo the blended live/self-study route, opting for either a full synchronous or full asynchronous learning only.

Among the subgroup analyses, an interesting finding of this study was the high level of agreement among pharmacists with the statements “Pharmacogenomics can enhance the provision of medication-related services (eg, dispensing, care-planning)” and “Pharmacogenomics testing is cost-effective.” Many studies before this also show a high degree of support by pharmacists in the clinical utility and feasibility of pharmacogenomics even with low rated or tested knowledge.44,45,47–49 As with this study, other research has shown that subjective (self-rated) knowledge is greater in those with prior PGx training.49 However, this study conflicts with other findings that objective (tested) knowledge is also higher in those with prior PGx training,47 as this study did not find a difference in pre-course test scores between those with PGx education in degree, in continuing education, or prior use of PGx, compared to those with no prior exposure. Some potential explanations for this observation include the rapid changes occurring and quickly advancing technology in PGx, and/or possibly due to knowledge decay in unused information. Other medical skills, such as resuscitation, follow a trend wherein the skills learned in a course are lost after 12 months if not frequently used, whereas knowledge is retained better when it is utilized more frequently in practice.50

In 2015, the United States Accreditation Council for Pharmacy Education addressed the knowledge gap in pharmacists by adding pharmacogenomics to the required curricula of entry-level Doctor of Pharmacy programs.17 Although Canada has no formal requirement for PGx education in pharmacy schools at present, adoption of PGx has occurred across most of the country’s University pharmacy degree curricula. Therefore, incoming pharmacy graduates within North America are likely to have an acceptable base-level of knowledge of PGx applications.18,19 It should be noted, however, that pharmacogenomics is still a relatively new field, and as such, guidelines have been known to change as new evidence becomes available. One example of such is the CPIC guidelines for clopidogrel dosing in percutaneous coronary intervention (PCI) patients, which did not provide a phenotype for CYP2C19 *2/*17 in 2011, and therefore recommended clopidogrel therapy in these patients.51 In 2013, these guidelines were updated to interpret an “intermediate metabolizer” phenotype from this particular genotype based on more current evidence, thus changing the medication selection advice in these patients to an alternative antiplatelet therapy such as ticagrelor or prasugrel.52 It is due to frequent changes in evidence, such as this example, that even those with prior education in PGx will need ongoing updates to their knowledge through courses such as this.

While pharmacy curriculums are teaching pharmacogenomics to incoming pharmacists,19 Alberta currently has a limited ability to utilize this in practice. Green Shield, a Canadian pharmacy benefit manager, has only recently added PGx testing to their services while Alberta’s largest benefit manager, Alberta Blue Cross, has yet to provide these services to its beneficiaries. In part, this is due to the limited evidence available to support cost-efficacy to date, as one review found that within pharmacy practice, no research to date has followed real-world economic outcomes.16 With most patients required to pay for this out of pocket ($200–$1000), the demand for pharmacogenomics testing is currently limited. Furthermore, it is reasonable to assume that if the pharmacist population, as shown in this study, is not confident in their ability to manage, interpret, and educate patients and providers on PGx information, they likely will not recommend PGx testing in the first place. Therefore, in addition to recurring education to manage knowledge decay and the changes in information available, pharmacists must also have the opportunity to utilize learned PGx skills in practice, to the benefit of both their ability to provide care, and importantly, to the benefit that PGx can have on patient outcomes.

Limitations & Strengths

While this study demonstrates the effectiveness of a PGx course on pharmacist competency in this subject, the study and the course itself are not without limitations. A previously validated survey measuring the specific competencies identified by AACP32 and the therapeutics supported in the literature16 was not available, and thus had to be created for this study. In addition to undergoing face validation, the observation of congruency between self-reported competence (Likert Scales) and objective knowledge (quiz grades) in baseline, final, and changes between assessments indicates construct validity of the tool used in this study. Further to assessment of survey results, although instructions indicated these were to be completed to the best of the participant’s ability, there is no way to confirm that participants did not check resources or notes while completing the quiz. However, a strength of the quiz portion was the inclusion of an option for “I don’t know” with each question to minimize correct guesses that falsely overestimate knowledge. Another noted limitation of this study was its inability to measure long-term knowledge retention post-course. Despite longitudinal evaluation was not the focus of the research presented, where only short-term efficacy is reported in this study. Another future study within the same funding grant proposal will be recruiting those participants and their pharmacies to test and educate eligible patients about their PGX and drug gene possible interactions. They will also be responsible to point out possible interventions in their patients’ current therapy. This practical component in the upcoming study will test and reflect the long-term knowledge retention.

Another strength of this study was the utilization of current guidelines and resources in the generation of course content. These guidelines are subject to frequent updates and changes given the growing body of evidence in this relatively new field. Additionally, the AACP competencies32 themselves are likely to be updated in the near future. Thus, it is imperative that these clinical and competency updates reach all pharmacists in an accessible format to ensure that PGx practices remain current. This applies to all pharmacists regardless of prior education in pharmacogenomics, as evident by the lack of difference in pre-course objectively measured knowledge between pharmacists with prior PGx education and those without. Therefore, this study highlights the need for recurring PGx education for pharmacists regardless of PGx knowledge background. Another strength of this paper is the comparison between synchronous and asynchronous learning, something that has not been evaluated to date in the available literature of pharmacogenomics education in pharmacists. This study showed no difference in these different learning methods, which may support more accessible PGx education in the future.

Conclusions

A PGx course for pharmacists was developed using evidence-based resources and collaboration with field experts, utilizing a blend of didactic lectures with case studies for experiential education. This course was delivered to Alberta pharmacists in live and self-study formats and was found to significantly improve subjectively rated and objectively tested knowledge in PGx regardless of participation format among pharmacists with varying practice experience, education, and prior exposure to PGx information. Knowledge gained can be utilized in delivery of patient-centered, personalized medication therapy management in the pharmacy setting, and this course can be adopted for broader education of pharmacists regardless of current practice in both synchronous and asynchronous learning environments.

Acknowledgments

Drs. Hazem F. Elewa, Jai N. Patel, Susanne B. Haga, and Wafaa M. Rashed for their partial contribution to lectures and for feedback on case studies and knowledge questions; Clare Peters and Grant Wang for providing technical and logistic assistance with the virtual (Zoom) course, lecture recordings, video processing, and video editing.

Author Contributions

MH: MSc. student, methodology, data acquisition, statistical analysis, writing – original draft, writing- reviewing and revising; SHM: grant co-PI, conceptualization, methodology and study design, funding acquisition, statistical analysis, writing- reviewing and revising; DAH: grant PI and setting research study idea and design, conceptualization, main curricula setting and nominating speakers, methodology and study design, funding acquisition, writing- reviewing and revising. All authors made a significant contribution to the work reported, whether that is in the conception, study design, execution, acquisition of data, analysis and interpretation, or in all these areas; took part in drafting, revising or critically reviewing the article; gave final approval of the version to be published; have agreed on the journal to which the article has been submitted; and agree to be accountable for all aspects of the work.

Funding

This work was funded by the Alberta Pharmacists’ Association Pharmacy Practice Innovation Grant. The funding source had no involvement in any of the study activities (study design, collection, and interpretation of data).

Disclosure

The authors report no conflicts of interest in this work.

References

1. Brixner D, Biltaji E, Bress A, et al. The effect of pharmacogenetic profiling with a clinical decision support tool on healthcare resource utilization and estimated costs in the elderly exposed to polypharmacy. J Med Econ. 2016;19(3):213–228. doi:10.3111/13696998.2015.1110160

2. Elliott LS, Henderson JC, Neradilek MB, Moyer NA, Ashcraft KC, Thirumaran RK. Clinical impact of pharmacogenetic profiling with a clinical decision support tool in polypharmacy home health patients: a prospective pilot randomized controlled trial. PLoS One. 2017;12(2):e0170905. doi:10.1371/journal.pone.0170905

3. Papastergiou J, Quilty LC, Li W, et al. Pharmacogenomics guided versus standard antidepressant treatment in a community pharmacy setting: a randomized controlled trial. Clin Transl Sci. 2021;14(4):1359–1368. doi:10.1111/cts.12986

4. Cavallari LH, Lee CR, Beitelshees AL, et al. Multisite investigation of outcomes with implementation of CYP2C19 genotype-guided antiplatelet therapy after percutaneous coronary intervention. JACC Cardiovasc Interv. 2018;11(2):181–191. doi:10.1016/j.jcin.2017.07.022

5. Smith DM, Weitzel KW, Elsey AR, et al. CYP2D6-guided opioid therapy improves pain control in CYP2D6 intermediate and poor metabolizers: a pragmatic clinical trial. Genet Med. 2019;21(8):1842–1850. doi:10.1038/s41436-018-0431-8

6. Evans WE, McLeod HL. Pharmacogenomics — drug disposition, drug targets, and side effects. N Engl J Med. 2003;348(6):538–549. doi:10.1056/NEJMra020526

7. Zanger UM, Schwab M. Cytochrome P450 enzymes in drug metabolism: regulation of gene expression, enzyme activities, and impact of genetic variation. Pharmacol Ther. 2013;138(1):103–141.

8. Thorn CF, Klein TE, Altman RB. PharmGKB: the Pharmacogenomics Knowledge Base. In: Methods in Molecular Biology. Humana Press; 2013: 311–320.

9. Table of Pharmacogenomic Biomarkers in Drug Labeling. The United States food and drug administration; 2020. Available from: https://www.fda.gov/drugs/science-and-research-drugs/table-pharmacogenomic-biomarkers-drug-labeling. Accessed March 3, 2021.

10. Moorman KL, Macdonald EA, Trovato A, Tak CR. Assessment and use of drug information references in Utah pharmacies. Pharm. 2017;15(1):839.

11. Charrois TL. Introduction to the patient care process. In: Mahmoud SH, editor. Patient Assessment in Clinical Pharmacy. Springer International Publishing; 2019:3–12.

12. Johnson J, Weitzel K. Advancing pharmacogenomics as a component of precision medicine: how, where, and who? Clin Pharmacol Ther. 2016;99(2):154–156. doi:10.1002/cpt.273

13. Ahmed S, Zhou Z, Zhou J, Chen S-Q. Pharmacogenomics of drug metabolizing enzymes and transporters: relevance to precision medicine. Genom Proteom Bioinform. 2016;14(5):298–313. doi:10.1016/j.gpb.2016.03.008

14. Frigon MP, Blackburn ME, Dubois-Bouchard C, Gagnon AL, Tardif S, Tremblay K. Pharmacogenetic testing in primary care practice: opinions of physicians, pharmacists and patients. Pharmacogenomics. 2019;20(8):589–598. doi:10.2217/pgs-2019-0004

15. Streetman DS. Emergence and evolution of pharmacogenetics and pharmacogenomics in clinical pharmacy over the past 40 years. Ann Pharmacother. 2007;41(12):2038–2041. doi:10.1345/aph.1K273

16. Hayashi M, Hamdy DA, Mahmoud SH. Applications for pharmacogenomics in pharmacy practice: a scoping review. Res Soc Adm Pharm. 2021. doi:10.1016/j.sapharm.2021.08.009

17. ACPE. Accreditation Standards and Key Elements for the Professional Program in Pharmacy Leading to the Doctor of Pharmacy Degree. Chicago, Illinois: Education ACfP; 2015.

18. Haga SB, Moaddeb J. Pharmacogenomics courses in pharmacy school curricula. Pharmacogenomics. 2019;20(9):625–630. doi:10.2217/pgs-2019-0024

19. Kuželički NK, Žitnik IP, Gurwitz D, et al. Pharmacogenomics education in medical and pharmacy schools: conclusions of a global survey. Pharmacogenomics. 2019;20(9):643–657. doi:10.2217/pgs-2019-0009

20. Rivkin A. Thinking clinically from the beginning: early introduction of the pharmacists’ patient care process. Am J Pharm Educ. 2016;80(10):164. doi:10.5688/ajpe8010164

21. Crown N, Sproule BA, Luke MJ, Piquette-Miller M, McCarthy LM. A continuing professional development program for pharmacists implementing pharmacogenomics into practice. Pharmacy. 2020;8(2):55. doi:10.3390/pharmacy8020055

22. Formea CM, Nicholson WT, McCullough KB, et al. Development and evaluation of a pharmacogenomics educational program for pharmacists. Am J Pharm Educ. 2013;77(1):10. doi:10.5688/ajpe77110

23. Zembles T. An inservice program on pharmacogenetics to individualize drug therapy. Am J Pharm Educ. 2010;74(1):10. doi:10.5688/aj740110

24. Powers KE, Buffington TM, Contaifer D Jr, Wijesinghe DS, Donohoe KL. Implementation of an active-learning laboratory on pharmacogenetics. Am J Pharm Educ. 2019;83(3):6605. doi:10.5688/ajpe6605

25. Knoell DL, Johnston JS, Bao S, Kelley KA. A genotyping exercise for pharmacogenetics in pharmacy practice. Am J Pharm Educ. 2009;73(3):43. doi:10.5688/aj730343

26. Diamantouros A, Marchesano R, Geerts WH, Pennefather P, Zwarenstein M, Austin Z. Development and evaluation of a continuing pharmacy education (CPE) program in thrombosis management. Curr Pharm Teach Learn. 2017;9(5):911–917. doi:10.1016/j.cptl.2017.05.008

27. Cole JD, Ruble MJ, Wantuch G, et al. Effectiveness of a pharmacy teaching certificate program offered to practicing pharmacists. Curr Pharm Teach Learn. 2019;11(11):1152–1158. doi:10.1016/j.cptl.2019.07.002

28. Sarayani A, Rashidian A, Gholami K, Torkamandi H, Javadi M. Efficacy of continuing education in improving pharmacists’ competencies for providing weight management service: three-arm randomized controlled trial. J Contin Educ Health Prof. 2012;32(3):163–173. doi:10.1002/chp.21141

29. Davis P, Clackson J, Henry C, Bobyn J, Suveges L. Interprofessional continuing health education for diabetic patients in an urban underserved community. J Interprof Care. 2008;22(sup1):51–60. doi:10.1080/13561820802013115

30. Raiche T, Pammett R, Dattani S, et al. Community pharmacists’ evolving role in Canadian primary health care: a vision of harmonization in a patchwork system. Pharm Pract. 2020;18(4):2171. doi:10.18549/PharmPract.2020.4.2171

31. Tsuyuki RT, Houle SKD, Charrois TL, et al. Randomized trial of the effect of pharmacist prescribing on improving blood pressure in the community. Circulation. 2015;132(2):93–100. doi:10.1161/CIRCULATIONAHA.115.015464

32. Roederer MW, Kuo GM, Kisor DF, et al. Pharmacogenomics competencies in pharmacy practice: a blueprint for change. J Am Pharm Assoc. 2017;57(1):120–125. doi:10.1016/j.japh.2016.08.014

33. Barlow JF. Clinical decision support for personalized medicine: an opportunity for pharmacist-physician collaboration. Per Med. 2012;9(4):441–450. doi:10.2217/pme.12.38

34. Joint Commission of Pharmacy Practitioners. Pharmacists’ patient care process; May 29, 2014. Available from: https://jcpp.net/wp-content/uploads/2016/03/PatientCareProcess-with-supporting-organizations.pdf. Accessed April 4, 2021.

35. Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. doi:10.1016/j.jbi.2019.103208

36. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381. doi:10.1016/j.jbi.2008.08.010

37. Watson KE, Schindel TJ, Barsoum ME, Kung JY. COVID the catalyst for evolving professional role identity? A scoping review of global pharmacists’ roles and services as a response to the COVID-19 pandemic. Pharmacy. 2021;9(2):99. doi:10.3390/pharmacy9020099

38. Punjani KK, Mahadevan K. Transitioning to online learning in higher education: influence of awareness of COVID-19 and self-efficacy on perceived net benefits and intention. Educ Inform Technol. 2021;27(1):291–320.

39. Kisor DF, Bright DR, Chen J, Smith TR. Academic and professional pharmacy education: a pharmacogenomics certificate training program. Per Med. 2015;12(6):563–573. doi:10.2217/pme.15.31

40. Kisor DF, Farrell CL. Expanding pharmacist and student pharmacist access to genetics/genomics/pharmacogenomics competency education. J Med Educ Curric. 2019;6:2382120519834325.

41. Zhang B, Kim S, Xiao Y, et al. A student initiative to implement peer-led study groups for a pharmacogenomics course: evaluation of student performance and perceptions. Curr Pharm Teach Learn. 2020;12(5):549–557. doi:10.1016/j.cptl.2020.01.013

42. Bergmann J, Sams A. Flip Your Classroom: Reach Every Student in Every Class Every Day. International Society for Technology in Education; 2012.

43. Munson A, Pierce R. Flipping content to improve student examination performance in a pharmacogenomics course. Am J Pharm Educ. 2015;79(7):103. doi:10.5688/ajpe797103

44. Algahtani M. Knowledge, perception, and application of pharmacogenomics among hospital pharmacists in Saudi Arabia. Risk Manag. 2020;13:1279–1291.

45. Alsaloumi L, Abdi A, Tosun O, Basgut B. Pharmacogenomics-based practice in North Cyprus: its adoption by pharmacists and their attitudes and knowledge. Int J Clin Pharm. 2019;41(5):1299–1306. doi:10.1007/s11096-019-00868-6

46. Nagy M, Lynch M, Kamal S, et al. Assessment of healthcare professionals’ knowledge, attitudes, and perceived challenges of clinical pharmacogenetic testing in Egypt. Per Med. 2020;17(4):251–260. doi:10.2217/pme-2019-0163

47. Petit C, Croisetiere A, Chen F, Laverdiere I. Are pharmacists from the province of Quebec ready to integrate pharmacogenetics into their practice. Pharmacogenomics. 2020;21(4):247–256. doi:10.2217/pgs-2019-0144

48. Tsuji D, Saito Y, Mushiroda T, Miura M, Hira D, Terada T. Results of a nationwide survey of Japanese pharmacists regarding the application of pharmacogenomic testing in precision medicine. J Clin Pharm Ther. 2021;46(3):649–657. doi:10.1111/jcpt.13367

49. Hundertmark ME, Waring SC, Stenehjem DD, et al. Pharmacist’s attitudes and knowledge of pharmacogenomics and the factors that may predict future engagement. Pharm. 2020;18(3):2008.

50. Su E, Schmidt TA, Mann NC, Zechnich AD. A randomized controlled trial to assess decay in acquired knowledge among paramedics completing a pediatric resuscitation course. Acad Emerg Med. 2000;7(7):779–786. doi:10.1111/j.1553-2712.2000.tb02270.x

51. Scott SA, Sangkuhl K, Gardner EE, et al. Clinical pharmacogenetics implementation consortium guidelines for cytochrome P450-2C19 (CYP2C19) genotype and clopidogrel therapy. Clin Pharmacol Ther. 2011;90(2):328–332. doi:10.1038/clpt.2011.132

52. Scott SA, Sangkuhl K, Stein CM, et al. clinical pharmacogenetics implementation consortium guidelines for CYP2C19 genotype and clopidogrel therapy: 2013 update. Clin Pharmacol Ther. 2013;94(3):317–323. doi:10.1038/clpt.2013.105

53. Brown JT, Ramsey LB, Van Driest SL, Aka I, Colace SI. Characterizing Pharmacogenetic Testing Among Children’s Hospitals. Clin Transl Sci. 2021;14(2):692–701. doi:10.1111/cts.12931

54. Jarrar Y, Musleh R, Ghanim M, AbuKhader I, Jarrar Q. Assessment of the need for pharmacogenomics education among pharmacists in the West Bank of Palestine. Int J Clin Pract. 2021;75(9):e14435. doi:10.1111/ijcp.14435

55. Edris A, Vanoverschelde A, Bushaj P, Van Nieuwerburgh F, Lahousse L. Pharmacogenetics in clinical practice: current level of knowledge among Flemish physicians and pharmacists. Pharmacogenomics J. 2021;21(1):78–84. doi:10.1038/s41397-020-00180-x

56. Rahma AT, Elsheik M, Ali BR, et al. Knowledge, attitudes, and perceived barriers toward genetic testing and pharmacogenomics among healthcare workers in the United Arab emirates: a cross-sectional study. J Pers Med. 2020;10(4):9.

57. McMurdo A, Abou Alwan R, Mayo PR, Hamdy DA. Implementation of pharmacogenomics in community pharmacies in Alberta: perceptions and challenges. Pharmaceutical Sciences World Congress; 2020.

58. Karuna N, Tragulpiankit P, Mahasirimongkol S, Chumnumwat S. Knowledge, attitude, and practice towards pharmacogenomics among hospital pharmacists in Thailand. Pharmacogenet Genom. 2020;30(4):73–80. doi:10.1097/FPC.0000000000000399