Theme Issue EditorialMeasuring team performance in healthcare: Review of research and implications for patient safety
Introduction
In this article, we discuss measures developed to study team performance in healthcare, based on (1) clinician surveys; (2) direct observation; and, (3) video-based analysis.
The strengths and weaknesses of these methods are presented, alongside future directions for improved measurement of performance of medical teams. The role of measurement of team behaviors in simulation and nontechnical skills training efforts is described. The increasing need for accurate performance-based criteria for teams in healthcare is highlighted.
The patient safety literature is littered with accounts of poor teamwork leading to adverse events. Increasing organizational and public demands have added pressure for change to occur; the inadequacy of clinician response has been compounded by growing complexity and interactions with technology in healthcare.
Although high reliability theory and advanced industries such as aviation provide lessons and tools to assist in the assessment and development of healthcare teams, the unique challenges in healthcare leave the industry lagging. In spite of these challenges (eg, transient teams and engrained medical cultures of autonomy and hierarchy), it is clear that quality interactions across, as well as within, teams are essential for patient safety.
Tested and proven methodologies for assessing and evaluating team performance are vital to enable measurement and monitoring of medical team effectiveness and results of training. Moreover, it is crucial for us to understand how to best educate the healthcare workforce in teamwork skills and how to subsequently maintain these skills. The first step is to determine the criteria that make “good” teams and good outcomes in the real world—before exploiting the potential that simulation promises for team training across healthcare.
Within this article a number of fundamental messages are discussed.
A richer understanding of team dynamics and effectiveness can benefit patient safety by assisting in team training development and can boost individual and team competencies in nontechnical aspects of care, such as prioritization, leadership, and decision making. The nature of anesthesiology makes it a rich test bed for team measurement because within the operating room environment, activities and decision making must be coordinated between anesthesiologists, surgeons and procedurists, and nurses, all of whom have their own group cultures and team dynamics.
The real world is the ultimate test bed for creating teamwork measures. These measures enable assessment of team behaviorial changes after medical team training has occurred. The questions to answer with regard to team training effectiveness is what would be the best way to train people to effect behavioral change—that is, behave more efficiently, consistently, and safely—within the real clinical environment and what would be the best method to measure such change? Examination of real-world behavior in the clinical domain can help us identify problem performance areas that can be recreated in a simulated environment which, in turn, would help us learn more about team dynamics in the real world.
The available tools are growing in number, in response to increasing need and demand for team performance measurement and monitoring. However, all remain rather rudimentary and most are, as yet, unable to appropriately inform team training schemes owing to a lack of reliability, validity, and ability to generalize.
Video recording enhances systematic feedback and performance review by providing precise analysis and repeated reviews by multiple observers (including the clinician's whose care is recorded). Direct observation cannot compete with such benefits, but is less intrusive and generally more accepted by clinicians.
Many team performance measurement tools are designed to be context or specialist service specific. For example, tools used to measure team performance for the operating room are different than those created for teams in the neonatal unit. As a result, comparison between tools is difficult and establishing generic processes and the supporting behaviors consistent with “good” teamwork is required. A consensus on a theoretical framework or model of team performance would provide researchers with the ability to describe and test hypotheses concerning the interrelationships of various performance measures, as well as the interdependencies of the predictors and the outcome criteria, across healthcare settings.
Even experienced health care professionals require continuous training and competency assessment to ensure patient safety and improvement and maintenance of performance standards. Team dynamics such as composition, coordination, and communication are fundamental skills to be incorporated into such training curricula, particularly through simulation involving interdisciplinary teams. There is also an understanding that expertise occurs independently of experience.
In the context of measuring team performance in the management of trauma patients for example, outcome measures are recorded at the point of discharge. This is in spite of the fact that the most intense and crucial teamwork functions occur in the initial resuscitation period (ie, up to 30 minutes after admission). During the succeeding period, a multitude of confounding variables makes the process of linking initial management with outcomes difficult. However, process-based measures may enable more effective correlation with team performance scores. These process measures might include time to execute key decisions or the number of repeated instructions or requests for clarity.
Section snippets
Team terminology
There is a general consensus that a team consists of 2 or more individuals, who have specific roles, perform interdependent tasks, are adaptive, and share a common goal [1]. Team work is distinct from task work and is defined as the set of interrelated knowledge, skills, and attitudes that facilitate coordinated, adaptive performance [2]. Team performance is then simply how effectively the team fulfils the function/s it serves [3].
Numerous medical team training programs have been developed and
Measuring healthcare teams
Team performance measurement is important to help determine how best to train clinicians for safe and effective patient care, in both real and simulated environments. Performance measurement before and after training must be comprehensive and accurate. Metrics should include all the dimensions that contribute to effective team work within specific clinical domains. Measures must be both reliable (ie, it should measure teamwork in a consistent manner) and valid (ie, it should be able to predict
Conclusions
Healthcare professionals recognize the importance of educating clinicians in nontechnical and teamwork skills. But the best ways to ensure that these competencies can be routinely and consistently measured in real and/or simulated environments have not been established. Impaired decision making, absence of situation awareness (or the “big picture”), and failures in interpersonal communication all contribute to failures that endanger patient safety in healthcare systems [11].
Anesthesia is prone
References (60)
- et al.
The role of non-technical skills in anaesthesia: a review of current literature
Br J Anaesth
(2002) - et al.
Retrospective data collection and analytical techniques for patient safety studies
J Biomed Inform
(2003) - et al.
Achieving housestaff competence in emergency airway management using scenario based simulation training: comparison of attending versus housestaff trainers
Chest
(2006) - et al.
Interdisciplinary communication: an uncharted source of medical error?
J Crit Care
(2006) - et al.
Operating room teamwork among critical care physicians and nurses: teamwork in the eye of the beholder
J Am Coll Surg
(2006) - et al.
Interdisciplinary communication in the intensive care unit
Br J Anaesth
(2007) - et al.
Anaesthetists' Non-Technical Skills (ANTS): evaluation of a behavioural marker system
Br J Anaesth
(2003) - et al.
Toward an understanding of team performance and training
(1992) - et al.
Defining competencies and establishing team training requirements
(1995) - et al.
The complexity of measuring interprofessional teamwork in the operating theatre
J Interprof Care
(2006)
Medical team training programs in health care
Adv Patient Saf
A conceptual framework for teamwork measurement: team performance assessment and measurement
Defining and assessing professional competence
JAMA
The human factor: the critical importance of effective teamwork and communication in providing safe care
Qual Saf Health Care
Team coordination and breakdowns in a real-life stressful environment
Communication failures in the operating room: an observational classification of recurrent types and effects
Qual Saf Health Care
Error reduction and performance improvement in the emergency department through formal teaching training: evaluation results of the MedTeams project
Health Serv Res
Translating teamwork behaviors from aviation to healthcare: development of behavioural markers for neonatal resuscitation
Qual Saf Health Care
Observational Teamwork Assessment for Surgery (OTAS): refinement and application in urological surgery
World J Surg
Communication and teamwork: essential to learn but difficult to measure
Anesthesiology
Development of an instrument for assessing trauma team performance
Effective teamwork in health care: a review of issues discussed in recent research literature
Health Care Anal
Interdisciplinary teams in health care and human services settings: are they effective?
Health Soc Work
Hospital acquired complications in a randomized controlled clinical trial of a geriatric consultation team
JAMA
Culture at work in aviation and medicine
Team training and resource management in health care: current issues and future directions
Harvard Health Policy Rev
The checklist—a tool for error management and performance improvement
J Crit Care
Real time patient safety audits: improving safety every day
Qual Saf Health Care
Teamwork as an essential component of high-reliability organizations
Health Serv Res
Cited by (68)
Suspicion, inclusive leadership and team innovation: A motivated information processing approach
2024, Journal of Business ResearchImportance of high-performing teams in the cardiovascular intensive care unit
2022, Journal of Thoracic and Cardiovascular SurgeryTranslating concepts to practice: Examining the synergy of interprofessional competencies and quality improvement
2021, Journal of Interprofessional Education and PracticeCitation Excerpt :For example, team assessment, norms and debriefs can support understanding and reflection on team process. Team assessments evaluate teamwork in healthcare and feedback results to enable reflection by team members.23 Team norms identify acceptable behaviors, traditions, and practices that are shared by a group's members and govern how a team functions.46
Avatar-based patient monitoring in critical anaesthesia events: a randomised high-fidelity simulation study
2021, British Journal of AnaesthesiaCitation Excerpt :The high number of participants and simulations reduced the probability that particular aspects of individual teams influenced the results. We used video analysis to meet the highest standard in evaluating simulation research.43 Finally, mixed model statistics controlled for numerous influencing factors and thus further increase the validity of the results.
Team innovative capability: Does positive mood unlock the innovative potential of environmental cues?
2021, Journal of Business ResearchKey performance indicators that are used to establish concurrent validity while measuring team performance in hospital settings – A systematic review
2021, Computer Methods and Programs in Biomedicine Update