Abstract
Performance testing is one of the most common and important measures used in sports science and physiology. Performance tests allow for a controlled simulation of sports and exercise performance for research or applied science purposes. There are three factors that contribute to a good performance test: (i) validity; (ii) reliability; and (iii) sensitivity. A valid protocol is one that resembles the performance that is being simulated as closely as possible. When investigating race-type events, the two most common protocols are time to exhaustion and time trials. Time trials have greater validity than time to exhaustion because they provide a good physiological simulation of actual performance and correlate with actual performance. Sports such as soccer are more difficult to simulate. While shuttle-running protocols such as the Loughborough Intermittent Shuttle Test may simulate physiology of soccer using time to exhaustion or distance covered, it is not a valid measure of soccer performance. There is a need to include measures of skill in such protocols. Reliability is the variation of a protocol. Research has shown that time-to-exhaustion protocols have a coefficient of variation (CV) of >10%, whereas time trials are more reliable as they have been shown to have a CV of <5%. A sensitive protocol is one that is able to detect small, but important, changes in performance. The difference between finishing first and second in a sporting event is <1%. Therefore, it is important to be able to detect small changes with performance protocols. A quantitative value of sensitivity may be accomplished through the signal : noise ratio, where the signal is the percentage improvement in performance and the noise is the CV.
Similar content being viewed by others
Notes
1 The use of trade names is for product identification purposes only and does not imply endorsement.
References
Jeukendrup A, Saris WHM, Brouns F, et al. A new validated endurance performance test. Med Sci Sports Exerc 1996; 28 (2): 266–70
Hopkins WG, Schabort EJ, Hawley JA. Reliability of power in physical performance tests. Sports Med 2001; 31 (3): 211–34
Atkinson G. Sport performance: variable or construct? J Sports Sci 2002; 20 (4): 291–2
Reilly T, Gilbourne D. Science and football: a review of applied research in the football codes. J Sports Sci 2003; 21 (9): 693–705
Halson SL, Bridge MW, Meeusen R, et al. Time course of performance changes and fatigue markers during intensified training in trained cyclists. J Appl Physiol 2002; 93 (3): 947–56
Hopkins WG. Measures of reliability in sports medicine and science. Sports Med 2000; 30 (1): 1–15
Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med 1998; 26 (4): 217–38
Thomas JR, Nelson JK. Research methods in physical activity. Champaign (IL): Human Kinetics, 1990
Thomas JR, Nelson JK. Research methods in physical activity. Champaign (IL): Human Kinetics, 2001
Hawley JA, Noakes TD. Peak power output predicts maximal oxygen uptake and performance time in trained cyclists. Eur J Appl Physiol 1992; 65 (1): 79–83
Williams C, Nute MG, Broadbank L, et al. Influence of fluid intake on endurance running performance: a comparison between water, glucose and fructose solutions. Eur J Appl Physiol Occup Physiol 1990; 60 (2): 112–9
Foster C, Green MA, Snyder AC, et al. Physiological responses during simulated competition. Med Sci Sports Exerc 1993; 25 (7): 877–82
Palmer GS, Hawley JA, Dennis SC, et al. Heart rate responses during a 4−d cycle stage race. Med Sci Sports Exerc 1994; 26 (10): 1278–83
Liedl MA, Swain DP, Branch JD. Physiological effects of constant versus variable power during endurance cycling. Med Sci Sports Exerc 1999; 31 (10): 1472–7
Palmer GS, Borghouts LB, Noakes TD, et al. Metabolic and performance responses to constant—load vs variable—intensity exercise in trained cyclists. J Appl Physiol 1999; 87 (3): 1186–96
Laursen PB, Rhodes EC, Langill RH, et al. Relationship of exercise test variables to cycling performance in an Ironman triathlon. Eur J Appl Physiol 2002; 87 (4-5): 433–40
Palmer GS, Dennis SC, Noakes TD, et al. Assessment of the reproducibility of performance testing on an air—braked cycle ergometer. Int J Sports Med 1996; 17 (4): 293–8
Russell RD, Redmann SM, Ravussin E, et al. Reproducibility of endurance performance on a treadmill using a preloaded time trial. Med Sci Sports Exerc 2004; 36 (4): 717–24
Smith MF, Davison RC, Balmer J, et al. Reliability of mean power recorded during indoor and outdoor self—paced 40 km cycling time—trials. Int J Sports Med 2001; 22 (4): 270–4
Elliott B, Lyttle A, Birkett O. The rowperfect ergometer; a training aid for on water single scull rowing. Sports Biomech 2002; 1 (2): 123–34
Helgerud J, Engen LC, Wisloff U, et al. Aerobic endurance training improves soccer performance. Med Sci Sports Exerc 2001; 33 (11): 1925–31
Zeederberg C, Leach L, Lambert EV, et al. The effect of carbohydrate ingestion on the motor skill proficiency of soccer players. Int J Sport Nutr 1996; 6 (4): 348–55
Di Salvo V, Collins A, Mc Neill B, et al. Validation of prozone: a new video based performance analysis system. Int J Perf Analysis Sport 2006; 6 (1): 108–19
Drust B, Reilly T, Cable NT. Physiological responses to laboratory—based soccer—specific intermittent and continuous exercise. J Sports Sci 2000; 18 (11): 885–92
Reilly T, Thomas V. A motion analysis of work—rate in different positional roles in professional football match play. J Hum Move Stud 1976; 2: 87–97
Thatcher R, Betterham A. Development and validation of a sport specific exercise protocol for elite youth players. J Sports Med Phys Fitness 2004; 44 (1): 15–22
MP G, Mc Naughton LR, Lovell R. Physiological and mechanical response to soccer specific intermittent activity and steady state activity. Res Sports Med 2006; 14 (1): 29–52
Nicholas CW, Nuttall FE, Williams C. The Loughborough Intermittent Shuttle Test: a field test that simulates the activity pattern of soccer. J Sports Sci 2000; 18 (2): 97–104
Bangsbo J, Lindquist F. Comparison of various exercise tests with endurance performance during soccer in professional players. Int J Sports Med 1992; 13 (2): 125–32
Rampinini E, Bishop D, Marcora S, et al. Validity of simple field tests as indicators of match related physical performance in top level professional soccer players. Int J Sport Med 2007; 28 (3): 228–35
Krustrup P, Mohr M, Amstrup T, et al. The yo—yo intermittent recovery test: physiological response, reliability, and validity. Med Sci Sports Exerc 2003; 35 (4): 697–705
Abt G, Zhou S, Weatherby R. The effect of a high—carbohydrate diet on the skill performance of midfield soccer players after intermittent treadmill exercise. J Sci Med Sport 1998; 1 (4): 203–12
Cox G, Mujika I, Tumilty D, et al. Acute creatine supplementation and performance during a field test simulating match play in elite female soccer players. Int J Sport Nutr Exerc Metab 2002; 12 (1): 33–46
Welsh RS, Davis JM, Burke JR, et al. Carbohydrates and physical/mental performance during intermittent exercise to fatigue. Med Sci Sports Exerc 2002; 34 (4): 723–31
Mc Gregor SJ, Nicholas CW, Lakomy HK, et al. The influence of intermittent high—intensity shuttle running and fluid ingestion on the performance of a soccer skill. J Sports Sci 1999; 17 (11): 895–903
Ostojic S, Mazic S. Effects of a carbohydrate—electrolyte drink on specific soccer tests and performance. J Sports Sci Med 2002; 1: 47–53
Vergauwen L, Spaepen AJ, Lefevre J, et al. Evaluation of stroke performance in tennis. Med Sci Sports Exerc 1998; 30 (8): 1281–8
Williams AM. Perceptual skill in soccer: implications for talent identification and development. J Sports Sci 2000; 18 (9): 737–50
Bagger M, Petersen PH, Pedersen PK. Biological variation in variables associated with exercise training. Int J Sports Med 2003; 24 (6): 433–40
Vincent W. Statistics in kinesiology. 3rd ed. Champaign (IL): Human Kinetics, 2005
Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; I (8476): 307–10
Lindsay FH, Hawley JA, Myburgh KH, et al. Improved athletic performance in highly trained cyclists after interval training. Med Sci Sports Exerc 1996; 28 (11): 1427–34
Coggan AR, Costill DL. Biological and technological variability of three anaerobic ergometer tests. Int J Sports Med 1984; 5 (3): 142–5
Graham K, Mc Lellan T. Variability of time to exhaustion and oxygen deficit in supramaximal exercise. Aust J Sci Med Sport 1989; 21 (4): 11–4
Billat V, Renoux JC, Pinoteau J, et al. Reproducibility of running time to exhaustion at V̇O2max in subelite runners. Med Sci Sports Exerc 1994; 26 (2): 254–7
Laursen PB, Francis GT, Abbiss CR, et al. Reliability of time to exhaustion versus time trial running tests in runners. Med Sci Sports Exerc 2007; 39 (8): 1374–9
Mc Lellan TM, Cheung SS, Jacobs I. Variability of time to exhaustion during submaximal exercise. Can J Appl Physiol 1995; 20 (1): 39–51
Krebs P, Powers S. Reliability of laboratory endurance tests [abstract]. Med Sci Sports Exerc 1989; 21: S10
Maughan RJ, Fenn CE, Leiper JB. Effects of fluid, electrolyte and substrate ingestion on endurance capacity. Eur J Appl Physiol Occup Physiol 1989; 58 (5): 481–6
Gleser MA, Vogel JA. Endurance exercise: effect of work—rest schedules and repeated testing. J Appl Physiol 1971; 31 (5): 735–9
Hickey MS, Costill DL, Mc Conell sGK, et al. Day to day variation in time trial cycling performance. Int J Sports Med 1992; 13 (6): 467–70
Hodges K, Hancock S, Currell K, et al. Pseudoephedrine enhances performance in 1500−m runners. Med Sci Sports Exerc 2006; 38 (2): 329–33
Jensen K, Johansen L. Reproducibility and validity of physiological parameters measured in cyclists riding on racing bikes placed on a stationary magnetic brake. Scand J Med Sci Sports 1998; 8 (1): 1–6
Nicholson RM, Sleivert GG. Indices of lactate threshold and their relationship with 10−km running velocity. Med Sci Sports Exerc 2001; 33 (2): 339–42
Currell K, Jentjens R, Jeukendrup A. Reliability of a cycling time trial in a glycogen depleted state. Eur J Appl Physiol 2006; 98 (6): 583–9
Tan F, Aziz A. Reproducibility of outdoor flat and uphill cycling time trials and their performance correlates with peak power output in moderately trained cyclists. J Sports Sci Med 2005; 4: 278–84
Laursen PB, Shing CM, Jenkins DG. Reproducibility of a laboratory—based 40−km cycle time—trial on a stationary wind—trainer in highly trained cyclists. Int J Sports Med 2003; 24 (7): 481–5
Widrick JJ, Costill DL, Fink WJ, et al. Carbohydrate feedings and exercise performance: effect of initial muscle glycogen concentration. J Appl Physiol 1993; 74 (6): 2998–3005
Schabort EJ, Hawley JA, Hopkins WG, et al. A new reliable laboratory test of endurance performance for road cyclists. Med Sci Sports Exerc 1998; 30 (12): 1744–50
Madsen K, Mac Lean DA, Kiens B, et al. Effects of glucose, glucose plus branched—chain amino acids, or placebo on bike performance over 100 km. J Appl Physiol 1996; 81 (6): 2644–50
Doherty M, Balmer J, Davison RC, et al. Reliability of a combined 3−min constant load and performance cycling test. Int J Sports Med 2003; 24 (5): 366–71
Paton CD, Hopkins WG. Ergometer error and biological variation in power output in a performance test with three cycle ergometers. Int J Sports Med 2006; 27 (6): 444–7
Bishop D. Reliability of a 1−h endurance performance test in trained female cyclists. Med Sci Sports Exerc 1997; 29 (4): 554–9
Schabort EJ, Hopkins WG, Hawley JA. Reproducibility of self—paced treadmill performance of trained endurance runners. Int J Sports Med 1998; 19 (1): 48–51
Hinckson EA, Hopkins WG. Reliability of time to exhaustion analyzed with critical—power and log—log modeling. Med Sci Sports Exerc 2005; 37 (4): 696–701
Jeukendrup AE, Currell K. Should time trial performance be predicted from three serial time—to—exhaustion tests? Med Sci Sports Exerc 2005; 37 (10): 1820; author reply 1821
Soper G, Hume PA. Reliability of power output during rowing changes with ergometer type and race distance. Sports Biomech 2004; 3 (2): 237–48
American College of Sports Medicine, American Dietetic Association, Dietitians of Canada. Joint position statement: nutrition and athletic performance. Med Sci Sports Exerc 2000; 32 (12): 2130–45
Rauch HG, St Clair Gibson A, Lambert EV, et al. A signalling role for muscle glycogen in the regulation of pace during prolonged exercise. Br J Sports Med 2005; 39 (1): 34–8
Schabort EJ, Hawley JA, Hopkins WG, et al. High reliability of performance of well—trained rowers on a rowing ergometer. J Sports Sci 1999; 17 (8): 627–32
Mohr M, Krustrup P, Bangsbo J. Match performance of high standard soccer players with special reference to developement of fatigue. J Sport Sci 2003; 21 (7): 519–28
Rampinini E, Coutts A, Castagna C, et al. Variation in top level soccer match performance. Int J Sport Med 2007; 28 (12): 1018–24
Di Salvo V, Baron R, Tschan H, et al. Performance characteristics according to playing position in elite soccer. Int J Sport Med 2007; 28 (3): 222–7
Weston M, Castagna C, Impellizzeri FM, et al. Analysis of physical match performance in English Premier League soccer referees with particular reference to first half and player work rates. J Sci Med Sport 2007; 10 (6): 390–7
Krustrup P, Mohr M, Nybo L, et al. The Yo—Yo IR2 test: physiological response, reliability, and application to elite soccer. Med Sci Sports Exerc 2006; 38 (9): 1666–73
Mc Gregor SJ, Hulse M, Strudwick A, et al. The reliability and validity of two tests of soccer skill [abstract]. J Sport Sci 1999; 17: 815
Avery C, Richardson P, Jackson W. A practical tennis serve test: measurement of skill under simulated game conditions. Res Q Exerc Sport 1998; 50: 554–64
Percell K. A tennis forehand—backhand drive skill test which measures ball control and stroke firmness. Res Q Exerc Sport 1981; 52: 238–45
Hopkins WG, Hawley JA, Burke LM. Design and analysis of research on sport performance enhancement. Med Sci Sports Exerc 1999; 31 (3): 472–85
Paton CD, Hopkins WG. Tests of cycling performance. Sports Med 2001; 31 (7): 489–96
Hopkins WG, Hewson DJ. Variability of competitive performance of distance runners. Med Sci Sports Exerc 2001; 33 (9): 1588–92
Jeukendrup AE, Martin J. Improving cycling performance: how should we spend our time and money. Sports Med 2001; 31 (7): 559–69
Jeukendrup AE. Carbohydrate intake during exercise and performance. Nutrition 2004; 20 (7-8): 669–77
Jeukendrup AE, Brouns F, Wagenmakers AJM, et al. Carbohydrate feedings improve 1 h trial cycling performance. Int J Sports Med 1997; 18: 125–9
Davis JM, Lamb DR, Pate RR, et al. Carbohydrate—electrolyte drinks: effects on endurance cycling in the heat. Am J Clin Nutr 1988; 48 (4): 1023–30
Carter J, Jeukendrup AE, Mundel T, et al. Carbohydrate supplementation improves moderate and high—intensity exercise in the heat. Pflugers Arch 2003; 446 (2): 211–9
Chryssanthopoulos C, Hennessy LC, Williams C. The influence of pre—exercise glucose ingestion on endurance running capacity. Br J Sports Med 1994; 28 (2): 105–9
Wilber RL, Moffatt RJ. Influence of carbohydrate ingestion on blood glucose and performance in runners. Int J Sport Nutr 1992; 2 (4): 317–27
Coggan AR, Coyle EF. Metabolism and performance following carbohydrate ingestion late in exercise. Med Sci Sports Exerc 1989; 21 (1): 59–65
Laursen PB, Shing CM, Peake JM, et al. Interval training program optimization in highly trained endurance cyclists. Med Sci Sports Exerc 2002; 34 (11): 1801–7
St Clair Gibson A, Noakes TD. Evidence for complex system integration and dynamic neural regulation of skeletal muscle recruitment during exercise in humans. Br J Sports Med 2004; 38 (6): 797–806
Hulleman M, De Koning JJ, Hettinga F, et al. The effect of extrinsic motivation on cycle time trial performance. Med Sci Sports Exerc 2007; 39 (4): 709–15
Atkinson G, Wilson D, Eubank M. Effects of music on work rate distribution during a cycling time trial. Int J Sports Med 2004; 25 (8): 611–5
Pujol TJ, Langenfeld ME. Influence of music on Wingate Anaerobic Test performance. Percept Mot Skills 1999; 88 (1): 292–6
Karageorghis CI, Terry PC. The psychological effects of music in sport and exercise: a review. J Sports Behav 1997; 20 (1): 54–68
Szmedra L, Bacharach DW. Effect of music on perceived exertion, plasma lactate, norepinephrine and cardiovascular hemodynamics during treadmill running. Int J Sports Med 1998; 19 (1): 32–7
Boutcher S, Trenske M. The effects of sensory deprivation and music on perceived exertion and affect during exercise. J Sport Exerc Psychol 1990; 12: 167–76
Nikolopoulos V, Arkinstall MJ, Hawley JA. Pacing strategy in simulated cycle time—trials is based on perceived rather than actual distance. J Sci Med Sport 2001; 4 (2): 212–9
Paterson S, Marino FE. Effect of deception of distance on prolonged cycling performance. Percept Motor Skills 2004; 98: 1017–26
Nethery VM. Competition between internal and external sources of information during exercise: influence on RPE and the impact of the exercise load. J Sports Med Phys Fitness 2002; 42 (2): 172–8
Jentjens RL, Jeukendrup AE. Effects of pre—exercise ingestion of trehalose, galactose and glucose on subsequent metabolism and cycling performance. Eur J Appl Physiol 2003; 88 (4-5): 459–65
Acknowledgements
No sources of funding were used to assist in the preparation of this review. The authors have no conflicts of interest that are directly relevant to the content of this review.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Currell, K., Jeukendrup, A.E. Validity, Reliability and Sensitivity of Measures of Sporting Performance. Sports Med 38, 297–316 (2008). https://doi.org/10.2165/00007256-200838040-00003
Published:
Issue Date:
DOI: https://doi.org/10.2165/00007256-200838040-00003