Meaningful Use of Data in Care Coordination by the Advanced Practice RN: The TeleFamilies Project

Wendy S. Looman, PhD, RN, CNP; Mary M. Erickson, DNP, RN, CNP; Ann W. Garwick, PhD, RN; Rhonda G. Cady, PhD, RN; Anne Kelly, MD Carrie Pettey, MD; Stanley M. Finkelstein, PhD

CIN: Computers Informatics Nursing


Abstract

Meaningful use of electronic health records to coordinate care requires skillful synthesis and integration of subjective and objective data by practitioners to provide context for information. This is particularly relevant in the coordination of care for children with complex special healthcare needs. The purpose of this article is to present a conceptual framework and example of meaningful use within an innovative telenursing intervention to coordinate care for children with complex special healthcare needs. The TeleFamilies intervention engages an advanced practice nurse in a full-time care coordinator role within an existing hospital-based medical home for children with complex special healthcare needs. Care coordination is facilitated by the synthesis and integration of internal and external data using an enhanced electronic health record and telehealth encounters via telephone and videoconferencing between the advanced practice nurse and the family at home. The advanced practice nurse’s ability to maintain an updated plan of care that is shared across providers and systems and build a relationship over time with the patient and family supports meaningful use of these data.


According to the American Nurses Association (ANA), wisdom is the appropriate use of knowledge to manage and solve human problems between types of information.1 In clinical practice, the application of experience, intelligence, creativity, and knowledge enables the nurse to make timely clinical decisions based on wisdom, recognizing which information is most important to the plan of care.2 This article describes an innovative model of care that engages an advanced practice RN (APRN) in high-intensity care coordination for children with complex special healthcare needs (SHCNs). The value of this intervention is in matching the enhanced skills and role of the APRN with the level of complexity of data and information involved in coordination of care for this population. Through this intervention, the APRN applies wisdom to manage a complex plan of care.

The Affordable Care Act recognizes the value of coordinated care as essential for cost-effective delivery of healthcare in the United States.3 There is also support for using electronic health records (EHRs) to facilitate coordination of care across systems and at transitions of care, and EHRs are widely expected to improve provider decisions and patient outcomes.4 The HITECH portion of the American Recovery and Reinvestment Act mandated that incentives should be offered for meaningful use of EHRs.5 Meaningful use of EHRs refers to the ability to transmit information, use decision support, and generate information that is important to patients, healthcare practice, and public health.6 While policy development is essential in driving healthcare improvements, providers’ experiences do not match policymakers’ expectations of the role of EHRs in care coordination.7 A limitation of these expectations is an assumption that meaningful use of data is independent of the practitioner’s role, educational preparation, and ability to use knowledge to manage human problems.

Evidence suggests that while EHRs facilitate within-office communication, they are less useful in supporting coordination across settings and have limited ability to capture dynamic planning and the medical decision-making process.7 Another limitation of expectations for EHRs in care coordination is the time required to monitor, update, and interpret data in the EHR for patients with complex, chronic health conditions. This is particularly true for children who have SHCNs. Approximately 14% of all children have an SHCN, defined as having a chronic physical, developmental, behavioral, or emotional condition and requiring more services than typical children.8 A subset of these children has unique needs due to the complexity of their chronic conditions. Because of the higher need for and use of healthcare services, the costs per capita of healthcare for children with complex SHCNs are significantly higher than for children in the general population.9

Health records for individuals with SHCNs differ from those for children with periodic health needs or single chronic conditions. Children with complex health issues have numerous providers across multiple systems, frequent changes in health status, and multiple medications and problem lists that fluctuate, resulting in data spread across multiple EHR systems. Coordination of care for children with complex SHCNs requires the practitioner to have an advanced scope of knowledge and practice as well as dedicated time devoted to the care coordinator role. There is evidence that healthcare charges for typically high-cost patient groups are lower when APRNs have the autonomy to act upon their knowledge and clinical judgment and that savings are proportional to nurse dose (time and contacts).10 These factors, along with our experience with a pilot project designed to coordinate care for a cohort of children with complex SHCNs,11 were the catalysts for the ongoing TeleFamilies project.

The Telefamilies Project

TeleFamilies is a model of care currently being tested in a 4-year (2010–2014) randomized controlled trial (RCT) funded by the National Institutes of Health/National Institutes of Nursing Research (principal investigator, Finkelstein; R01NR010883). The aim of TeleFamilies is to evaluate the effect of increasing levels of telehealth technology on healthcare service utilization, child and family outcomes, and perceptions of telehealth technology among children with complex SHCNs and their families. Subjects are randomized into one of three groups: (1) a control group receiving usual care that includes LPN-delivered care coordination (n = 50), (2) an intervention group receiving APRN-delivered telephone care coordination (n = 50), and (3) an intervention group receiving APRN-delivered telephone plus video care coordination (n = 50). The duration of each family’s enrollment is 30 months, which includes 6 months of baseline data collection prior to randomization and 2 years in the usual care or intervention groups.

By design, the APRN’s caseload is limited to 100 families at any given time as he/she provides services to patients in the intervention arms of the study. The RCT tests the hypothesis that as the level of care coordination role preparation and telehealth use in coordination increases, unplanned healthcare service use will decrease and quality of life for the children and their families will improve. This article describes a conceptual framework for the APRN intervention in the TeleFamilies project.

Setting and Sample

The setting for this project is a large urban general pediatrics clinic affiliated with a children’s hospital. The clinic and hospital share an integrated, Certification Commission for Health Information Technology–certified EHR. Eight pediatricians and four APRNs provide primary care to approximately 10 000 children during 25 000 outpatient visits a year. A subset of this population is enrolled in a clinic-developed Special Needs Program (SNP), which serves approximately 600 children with complex SHCNs. The SNP is state-certified as a pediatric healthcare home (medical home), which is an approach to care in which providers and families work in partnership to improve health outcomes and quality of life for individuals with chronic health conditions.12 All subjects recruited for the study are enrolled in the SNP and are between the ages of 2 and 15 years at enrollment. Additional inclusion criteria are that the parent respondent speaks English, and the child meets four of five criteria for having an SHCN as defined by the SHCN screener.13

Telenursing Intervention: Telephone and Video Care Coordination

The APRN care coordinator is employed full-time in a care coordinator role with dedicated office space designed for telephone and videoconferencing. Whereas families of children receiving usual care in the SNP contact the clinic’s main number for all matters related to care coordination, families randomized into the APRN intervention groups contact the APRN directly using a dedicated telephone line. Families randomized to the video intervention also have the option of interacting with the APRN via videoconferencing. Families in this group receive a telehealth package free-of-charge that includes a netbook computer, Web camera, HIPAA-compliant videoconferencing software, and broadband Internet connection. Technical support is provided by the TeleFamilies project staff, who set up the netbook and Internet connection and provide a standardized testing protocol in the home at randomization to ensure functionality.

Enhances Functionality of the EHR for Care Coordination

Core objectives of the federal HITECH Act focus on EHR support to improve healthcare, including basic patient data entry, clinical decision support, electronic order entry, and providing patients with their health information.4 All of these objectives are encompassed in the APRN-administered intervention through the use of the clinic’s EHR. Within the TeleFamilies intervention, data such as demographics and laboratory results are recorded as structured data, and data on diagnoses, medications, and allergies are updated regularly by the APRN. Additionally, a current plan of care is provided to families and available to providers. Key information is electronically exchanged among EHR users. Privacy and security of data are ensured through data encryption and system-level security. Quality measures including functional status, healthcare service use, and the presence of an updated care plan are tracked and reported. As a certified healthcare home, the clinic maintains a list of patients with specific conditions for quality improvement and research.

The hospital and clinic use an integrated EHR that makes inpatient, outpatient, and family record viewing possible. The TeleFamilies project’s APRN, who has extensive experience with the health information technology suite, shaped the enhancements to the existing EHR for care coordination. In addition, adaptations were facilitated by TeleFamilies project personnel with telehealth and nursing informatics expertise. The enhancements were facilitated through collaboration with the hospital’s information technology staff and administrators.

All children enrolled in the SNP have a Patient Home Summary, which is a custom-built EHR-based plan of care. Data including demographics, problem lists, allergies, medications, and devices are auto-populated into this plan from structured EHR data. Patient Home Summary data that are not auto-populated but critical to coordinate a child’s care (eg, home treatments, external providers and relevant treatment information, community services, school) are synthesized and integrated from external documents and entered by the care coordinator. For children in the intervention groups, the EHR has an additional free-text form to document the process and outcomes of telehealthcare coordination. Based on evidence14,15 related to care coordination, a unique EHR documentation template (Table 1) was developed to reflect the critical elements of care coordination with prompts to facilitate updating chronic care plans. Like the care coordination template, the plan of care has customized pages and data fields to prompt documentation of critical elements of care. These decision support tools allow multiple providers involved in the child’s care (such as subspecialists, rooming staff, and primary care providers) to view critical information in a single summary, decreasing the need for the families to repeat their story and the child’s history.

 

The APRN uses the EHR to review clinic schedules and admissions and to identify opportunities to connect face-to-face and clarify progress toward family goals and needs for coordination. For example, when a child is scheduled for a well-child or acute care general pediatrics clinic visit with an SNP primary care provider, the APRN may touch base with the family before or after the visit to identify care coordination needs. When a child in the APRN’s caseload is hospitalized, the APRN may visit the family during the stay to ensure seamless transitions from care settings and minimal disruption of the child’s home care regimen.

Meaningful Use of Data in the Telefamilies Care Coordination Model

The TeleFamilies model of care coordination incorporates technology and engages the APRN in managing information in a way that supports a dynamic, meaningful, coordinated plan of care developed with the child and family. Figure 1 illustrates the conceptual model that depicts the nursing process of synthesizing and integrating data for care coordination. The ultimate aim of this coordination of care is improved health and quality of life for the child and family. At the systems level, the outcome is care that is effective, family centered, efficient, safe, timely, and equitable; these are core aspects of quality of care as defined by the Institute of Medicine.16 In this conceptual model, data are categorized as historic or current (represented by the left and right halves of the data circle) and as subjective or objective (represented by the top and bottom halves of the data circle). Subjective historic data are the patient’s perception of one’s history including health status, identity, experiences, relationships, and roles. Subjective current data are the patient’s current health-related experiences. Objective data also exist as historic or current; examples of current objective data include values, such as temperature, blood pressure, skin color, and qualities of a heart murmur. Once documented in a patient’s health record, these data become objective historic data. In the coordination of care for children with complex SHCNs, it is important to acknowledge the distinctions between historic and current data because health status is rarely static. Similarly, by appreciating the value of subjective data in the care of children in families, the nurse is able to include the child and family caregivers’ perceptions and experiences into the process of care. Furthermore, the APRN is able to synthesize and integrate data to develop and maintain a dynamic plan of care through her care coordination role that provides a platform for seamless, quality care by primary and specialty providers across settings.

 

The TeleFamilies model of care incorporates the core concepts of data, information, knowledge, and wisdom (DIKW) as described by the ANA2 in the DIKW framework. According to the DIKW framework, data are discrete facts that represent objects, events, and their properties as well as abstract concepts such as pain and spirituality.17Information is data that have been processed into a form that is meaningful. Knowledge is information in context, and wisdom is the appropriate use of knowledge to manage and solve human problems. Two features of professional nursing, according to the ANA,1 are (1) integration of objective data with the patient’s subjective experience and (2) application of knowledge to the processes of diagnosis and treatment through the use of judgment and critical thinking. The TeleFamilies intervention utilizes the APRN’s expanded knowledge as well as role autonomy and specialization to integrate data for meaningful use in care coordination. He/she does this by contextualizing knowledge of historic and current, objective, and subjective data.

The TeleFamilies intervention facilitates the contextualization of information in four important ways. First, the APRN practices full-time in her role as care coordinator (Figure 1, A). Her role allows her to develop relationships with families in the intervention groups over time and to gain an increasing awareness of the child and family’s perceptions of their history over time. The TeleFamilies intervention also contextualizes data by technology-enhanced interactions with families (Figure 1, B). Telehealth technology (telephone and videoconferencing) facilitates the APRN’s timely and integrated clinical decision making to coordinate care with families in an ongoing manner based on family needs and priorities. Through videoconferencing, the APRN can more readily assess the child and family situation. The APRN’s enhanced scope of knowledge and practice is the third way that TeleFamilies facilitates contextualization of information for care coordination (Figure 1, C). For example, the APRN can perform a comprehensive assessment that incorporates his/her knowledge of pathophysiology, pharmacology, and sociocontextual factors; he/she can use that assessment to diagnose and manage acute and chronic conditions as an autonomous practitioner while maintaining communication with the child’s regular providers. The fourth way that TeleFamilies aids in contextualizing information is through enhanced functionalities of the EHR (Figure 1, D), described above.

A standard template for documentation of the APRN’s encounter provides a way to consistently and comprehensively record the processes involved in the care coordination encounter (Table 1). This serves several purposes, including communication of the care coordination encounter to other providers, ensuring that the range and scope of care coordination activities are consistently documented for future tracking purposes, and guiding the APRN in a systematic process of care that is based on evidence for what works in care coordination for children with complex SHCNs.14,15 Because the TeleFamilies APRN has adequate time to review and update the EHR throughout an episode of care, information critical to care coordination and included in the Patient Home Summary is more complete and accurate over time.

Process Implementation

TeleFamilies recently completed year 2 of the 4-year RCT. Based on preliminary interviews with providers, it is evident that providers in the SNP have experienced positive changes in their ability to provide quality care to children in the intervention groups. These improvements include increased meaningful information in the EHR due to APRN synthesis and integration of internal and external data and efficiency in terms of communicating and triaging issues with patients and families. Additionally, the APRN’s scope of practice enables her to prescribe and refill medications in a timely manner. While quality outcomes related to safety have not been evaluated yet, providers posit that the APRN care coordinator increases safety by reducing risks related to inaccurate medication and problem lists and by improving completeness and timeliness in the transmission of information during transitions of care. To facilitate ongoing evaluation of the TeleFamilies intervention process and to document the roles and activities of care coordination, the APRN logs each encounter with a family in a study database. Over the first year of the intervention, the APRN had encounters with about one-quarter to one-third of her total caseload each month, with an average of two to three encounters per family per month. The families in the intervention groups value the availability of and access to the APRN care coordinator.

Telehealth technology has enhanced the APRN’s ability to collect, interpret, and communicate information across settings and providers. During a videoconferencing encounter, the APRN care coordinator facilitated decision making by capturing an image of a symptomatic child using a screenshot and e-mailed this to a provider on another campus. With this information, the team was able to manage the child’s symptoms without a visit to the clinic. For some families, child health crises that may have previously required hospitalization have been effectively managed at home through a series of interactions with the APRN over an episode of care. In another example, the APRN monitored and managed a child’s transition from intravenous to enteral feedings via telephone and e-mail and fax exchanges, with the parent and the care team over time. The child was able to remain at home while the APRN remained in the clinic.

Conclusion

Meaningful use of data requires the ability to generate, manage, and communicate information in ways that are important to patients, healthcare practice, public health, and policymakers.4 The conceptual model presented in this article provides a framework for understanding historic, current, objective, and subjective data in coordination of care for individuals with chronic health conditions and the role of the APRN in transforming these data into meaningful information that is shared with both providers and families. TeleFamilies’ model of care matches the enhanced scope of knowledge and practice of the APRN with the level of complexity inherent in coordinating care for children with complex health needs. The ongoing RCT aims to test the hypothesis that this model of care will result in improved outcomes in terms of quality of care and health for children and families. If this hypothesis is supported, project outcomes may inform payment models that include care coordination by an APRN as a covered service. Results will be disseminated following completion of the RCT.


References

1. American Nurses Association. Nursing’s Social Policy Statement: The Essence of the Profession. Silver Spring, MD: nursesbooks.org; 2010.

2. American Nurses Association. Nursing Informatics: Scope and Standards of Practice. Silver Spring, MD: nursesbooks.org; 2008.

3. Office of the Legislative Council, US House of Representatives. Compilation of Patient Protection and Affordable Care Act. 111th Congress 2nd Session. May 2010. Print 111-1. http://docs.house.gov/ energycommerce/ppacacon.pdf. Accessed July 27, 2012.

4. Blumenthal D, Tavenner M. The ‘‘meaningful use’’ regulation for electronic health records. N Engl J Med. 2010;363(6):501–504.

5. American Recovery and Reinvestment Act of 2009. Public Law 111-5; January 9, 2009. http://www.gpo.gov/fdsys/pkg/PLAW-111publ5/ pdf/PLAW-111publ5.pdf. Accessed July 27, 2012.

6. DesRoches CM, Campbell EG, Vogeli C, et al. Electronic health records’ limited successes suggest more targeted uses. Health Aff (Millwood). 2010;29(4):639–646.

7. O’Malley AS, Grossman JM, Cohen GR, Kemper NM, Pham HH. Are electronic medical records helpful for care coordination? Experiences of physician practices.J Gen Intern Med. 2010;25(3):177–185.

8. US Department of Health and Human Services. The National Survey of Children with Special Health Care Needs Chartbook 2005–2006. http://mchb.hrsa.gov/cshcn05/. Accessed July 27, 2012.

9. Wise PH, Huffman LC, Brat G. A critical analysis of care coordination strategies for children with special health care needs. 2007. Technical Review No. 14. AHRQ Publication 07-0054.

10. Brooten D, Youngblut JM. Nurse dose as a concept. J Nurs Scholarsh. 2006;38(1):94–99.

11. Cady R, Finkelstein S, Kelly A. A telehealth nursing intervention reduces hospitalizations in children with complex health conditions. J Telemed Telecare. 2009;15(6):317–320.

12. Minnesota Department of Health. Minnesota’s vision: a better state of health/Health care homes. 2011 www.health.state.mn.us/healthreform/ homes/certification. Accessed July 27, 2012.

13. Bethell CD, Read D, Stein RE, Blumberg SJ, Wells N, Newacheck PW. Identifying children with special health care needs: development and evaluation of a short screening instrument. Ambul Pediatr. 2002; 2:38–48.

14. McAllister JW, Presler E, Cooley WC. Practice-based care coordination: a medical home model. Pediatrics. 2007;120:e723–e733.

15. Antonelli RC, McAllister JW, Popp J. Making care coordination a critical component of the pediatric health system: a multidisciplinary framework. Commonwealth Fund. Publication 1277. 2009 www.commonwealthfund.org. Accessed July 27, 2012.

16. Institute of Medicine. Envisioning the National Health Care Quality Report. Washington, DC: National Academy Press; 2001

17. Matney S, Brewster PJ, Sward KA, Cloyes KG, Staggers N. Philosophical approaches to the nursing informatics data-informationknowledge-wisdom framework. ANS Adv Nurs Sci. 2011;34(1):6–18.

 

Group Comparisons

Independent-samples t tests were conducted to identify any differences among participants taking the eLearning based on demographics. The first group comparison analyzed the variables of confidence, satisfaction, and meeting the learning objectives of participants with (n = 57) and without (n = 18) Epic EMR experience. Results showed that with confidence (P = .44), satisfaction (P = .30), and whether the eLearning met the intended objectives (P = .13), no statistical differences were found (Table 4).

 

Next, participants were divided between those with 2 years of nursing experience or less (n = 27) and those with more than 2 years of experience (n = 19) to see if any differences existed among confidence, satisfaction, and meeting learning objectives. Results showed that confidence (P = .71) and satisfaction (P = .52) were not statistically different between the two groups at the 0.05 level, but less experienced participants had higher average scores regarding whether the lessons, topics, and content were directly related to the learning objectives (P = .0.04) (Table 5).

 

The ILT and eLearning results were further compared using one-sample t tests based on meeting course objectives and user satisfaction, which were present in both postcourse evaluations. One hundred thirty-seven ILT evaluations were used: 9 from Foundations, 33 from Admissions, 43 from Shift and 52 from Discharge. The ILT satisfaction mean was 4.41, and for meeting course objectives, the mean was 4.61. When the eLearning satisfaction mean of 3.87 was compared to ILT average of 4.41, statistical significance was found (P < .0001). Similarly, when the ILT mean for meeting the learning objectives (4.61) was compared to the eLearning (mean = 4.36), this demonstrated statistical significance (P = .0010) (Table 6).

 

Qualitative Data

The last item on the survey was an open-ended question that asked the participants to share feedback regarding what they liked about the eLearning and what could be improved for the future. These responses were sorted into common themes based on keywords that reflected effectiveness, efficiency, and satisfaction.

In order to further assess nursing satisfaction, participants offered feedback on what they liked about the eLearning. Eight participants responded to this question and the common theme was the positive review of the self-paced format. One participant stated, “I liked that it was go at your own pace.” A related common theme was that experienced users would like the opportunity to test out of content. However, even though self-paced was preferred by most, two participants stated that the content should be delivered as ILT.

Twenty-five participants offered qualitative feedback for what could be improved. The most common theme related to allotted time for completion of the eLearning. A participant stated, “Not enough time for the amount of education required.” Another said, “…no time for playground due to it taking the entire time to complete just the online course.” Another common theme related to the proctor overseeing the eLearning. One comment read, “I would have benefitted from communication from the staff person overseeing it at the beginning, giving us a welcome, overview, instructions, telling us what to expect, when to ask for help, basically any (communication)”.

Discussion

Project Outcomes

The eLearning usability goal was met and comparable to the inpatient nursing eLearnings for EMR training. The majority of participants were satisfied with the eLearning, even though the mean of 3.87 shows that there is room for improvement. The eLearning was found to be an effective tool for content delivery. The results confirmed that eLearning is more efficient than an ILT method of delivery. The 50% reduction in training time was achieved compared to ILT, which leads to a substantial ROI for the organization. Upon completion of the inpatient nurse curriculum via eLearning, this project showed no difference between nurses with and without prior Epic EMR experience related to confidence, satisfaction, and meeting eLearning objectives. Furthermore, no statistical difference was found between participants with less than 2 years of experience compared to participants who had more than 2 years ofexperience regarding satisfaction with the eLearning and future confidence to use the system. However, new participants reported that the eLearning objectives were met more often than did experienced participants.

Compared to eLearning, ILT was superior in terms of satisfaction and meeting course objectives. Qualitative feedback demonstrated that proctor performance affected learner satisfaction and that many participants liked the self-paced format of eLearning. Those who need more time can take it, while those who know the workflows can move faster. Improvements related to this feedback may raise satisfaction with eLearning to the ILT level.

Limitations

There were several identified limitations to this project. Some participants did not answer all of the questions, leading to missing data. Additionally, the course timings report pulled the amount of time that the learner had the eLearning lesson open. Because of this, it should be noted that the time for completion of the eLearning may actually be less than what was indicated in the course timings report. Finally, while 137 ILT evaluations were used, we do not know how many participants completed evaluations.

Conclusion

With the majority of inpatient nurses onboarding with Epic EMR experience, our inpatient nursing eLearning conversion allows our organization to capitalize on existing experience and increase satisfaction with a self-paced format. In the future, a mechanism to allow users with prior Epic EMR experience to test out of content would be beneficial and allow for an increased ROI. However, with the average time of completion at 8.09 hours, we need to provide some users with additional time. The eLearnings also provide a means for ongoing reference for nurses that was not possible with ILT. The important task of orienting newly hired nurses to an organization's information systems and workflows has grown more challenging in the increasing presence of electronic record technologies utilized with patient care.39 New nurse hires' EMR training has an important function of incorporating workflows and policies, in addition to introducing system functionality. This project has shown that an eLearning format does yield confident nurses who are equipped with the knowledge they need to be successful with patient care.


References

1. Baker AL, Dubose TJ. Electronic systems for student clinical records. J Diagn Med Sonogr. 2009;25(5):277–281.

2. Hatfield AJ, Bangert MP. Implementation of the Clinical Encounters Tracking System at the Indiana University School of Medicine. Med Ref Serv Q. 2005;24(4):41–58.

3. Kowlowitz V, Slatt LM, Kollisch DO, Strayhorn G. Monitoring students’ clinical experiences during a third-year family medicine clerkship. Acad Med. 1996;71(4):387–389.

4. Oliveri R. Clinical recordkeeping using a personal computer. Part 1: preparation. Nurse Educ. 1984;9(1):43–48.

5. Johnson JK, Michener JL. Tracking medical students’ clinical experiences with a computerized medical records system. Fam Med. 1994; 26(7):425–427.

6. Rowe BH, Ryan DT, Mulloy JV. Evaluation of a computer tracking program for resident-patient encounters. Can Fam Physician. 1995; 41:2113–2120.

7. Kuehn AF, Hardin LE. Development of a computerized database for evaluation of nurse practitioner student clinical experiences in primary health care: report of three pilot studies. Comput Nurs. 1999; 17(1):16–26.

8. Joy L, Berner B, Tarrant D. Evaluating the implementation of an online clinical log system for family nurse practitioner students. Comput Inform Nurs. 2012;30(1):1.

9. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: The National Academies Press; 2001.

10. USA.gov. Promoting innovation and competitiveness: President Bush’s Technology Agenda. The White House President George W. Bush. 2004. http://georgewbush-whitehouse.archives.gov/infocus/technology/ economic_policy200404/chap3.html. Accessed August 5, 2013.

11. Initiative TT. TIGER Informatics Competencies Collaborative (TICC) final report. 2009. http://tigercompetencies.pbworks.com/f/TICC_ Final.pdf. Accessed July 17, 2013.

12. USA.gov. Remarks of President Barack Obama—As Prepared for Delivery Address to Joint Session of Congress. February 24, 2009. http://www .whitehouse.gov/the_press_office/Remarks-of-President-Barack-ObamaAddress-to-Joint-Session-of-Congress/. Accessed August 5, 2013.

13. US Department of Health and Human Services, Health Resources and Services Administration. Nurse Practitioner Primary Care Competencies in Specialty Areas: Adult, Family, Gerontological, Pediatric, and Women’s Health. 2002. http://www.aacn.nche.edu/educationresources/npcompetencies.pdf. Accessed August 5, 2013.

14. National Organization of Nurse Practitioner Faculties. Nurse Practitioner Core Competencies. 2012. http://c.ymcdn.com/sites/www.nonpf .org/resource/resmgr/competencies/npcorecompetenciesfinal2012.pdf. Accessed August 5, 2013.

15. Cullen D, Stiffler D, Settles J, Pesut DJ. A database for nurse practitioner clinical education. Comput Inform Nurs. 2010;28(1):20–29; quiz 21–30.

16. Hallas D, Biesceker B, Brennan M, Newland JA, Haber J. Evaluation of the clinical hour requirement and attainment of core clinical competencies by nurse practitioner students. J Am Acad Nurse Pract. 2012;24(9):544–553.

17. McNelis AM. Improving quality and safety in graduate education using an electronic student tracking system. Arch Psychiatr Nurs. 2012;26(5):358.

18. Olson BD, Fauchald SK. A transdisciplinary approach to developing a Web-based nursing experiential log system for advanced practice nursing clinical experiences. Comput Inform Nurs. 2011;29(11): 630–636.

19. Walker DS. Web-based data collection in midwifery clinical education. J Midwifery Womens Health. 2003;48(6):437.

20. Fontana SA, Kelber ST, Devine EC. A computerized system for tracking practice and prescriptive patterns of family nurse practitioner students. Clin Excellence Nurse Pract. 2001;5(2):68–72.

21. Longworth JC, Lesh D. Development of a student nurse practitioner computerized clinical log. J Am Acad Nurse Pract. 2000; 12(4):117–122.

22. Melnyk BM, Fineout-Overholt E. Evidence-Based Practice in Nursing & Healthcare. Philadelphia, PA: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2011.

23. McMillan DE, Bell S, Benson EE, et al. Educational innovations. From anxiety to enthusiasm: facilitating graduate nursing students’ knowledge development in science and theory. J Nurs Educ. 2007; 46(2):88–91.

Loading