Skip to main content
Log in

Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Mixed-initiative problem solving lies at the heart of knowledge- based learning environments. While learners are actively engaged in problem-solving activities, learning environments should monitor their progress and provide them with feedback in a manner that contributes to achieving the twin goals of learning effectiveness and learning efficiency. Mixed-initiative interactions are particularly critical for constructivist learning environments in which learners participate in active problem solving. We have recently begun to see the emergence of believable agents with lifelike qualities. Featured prominently in constructivist learning environments, lifelike pedagogical agents could couple key feedback functionalities with a strong visual presence by observing learners' progress and providing them with visually contextualized advice during mixed-initiative problem solving. For the past three years, we have been engaged in a large-scale research program on lifelike pedagogical agents and their role in constructivist learning environments. In the resulting computational framework, lifelike pedagogical agents are specified by

(1) a behavior space containing animated and vocal behaviors,

(2) a design-centered context model that maintains constructivist problem representations, multimodal advisory contexts, and evolving problem-solving tasks, and

(3) a behavior sequencing engine that in realtime dynamically selects and assembles agents' actions to create pedagogically effective, lifelike behaviors.

To empirically investigate this framework, it has been instantiated in a full-scale implementation of a lifelike pedagogical agent for Design-A-Plant, a learning environment developed for the domain of botanical anatomy and physiology for middle school students. Experience with focus group studies conducted with middle school students interacting with the implemented agent suggests that lifelike pedagogical agents hold much promise for mixed-initiative learning.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Anderson, J., A. Corbett, K. Koedinger, and R. Pelletier: 1995, Cognitive tutors: lessons learned. Journal of the Learning Sciences 4(2), 167–207.

    Google Scholar 

  • Anderson, J. R.: 1983, The Architecture of Cognition. Harvard University Press.

  • André, E.,W. Finkler, W. Graf, T. Rist, A. Schauder, and W. Wahlster: 1993, WIP: The automatic synthesis of multi-modal presentations. In: M. T. Maybury (ed.): Intelligent Multimedia Interfaces. Cambridge, MA: MIT Press, pp. 94–116.

    Google Scholar 

  • André, E. and T. Rist: 1996, Coping with temporal constraints in multimedia presentation planning. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence. pp. 142–147.

  • Bates, J.: 1994, The role of emotion in believable agents. Communications of the ACM 37(7), 122–125.

    Google Scholar 

  • Blumberg, B. and T. Galyean: 1995, Multi-level direction of autonomous creatures for real-time virtual environments. In: Computer Graphics Proceedings. pp. 47–54.

  • Brown, J., A. Collins, and P. Duguid: 1989, Situated cognition and the culture of learning. Educational Researcher 18(1), 32–42.

    Google Scholar 

  • Brown, J. S. and R. R. Burton: 1978, Diagnostic models for procedural bugs in basic mathematical skills. Cognitive Science 2, 155–191.

    Google Scholar 

  • Brusilovsky, P.: 1992, A framework for intelligent knowledge sequencing and task sequencing. In: Proceedings of the Second International Conference, ITS '92. pp. 499–506.

  • Burton, R. R.: 1982, Diagnosing bugs in a simple procedural skill. In: D. Sleeman and J. S. Brown (eds.): Intelligent Tutoring Systems. London: Academic Press.

    Google Scholar 

  • Carberry, S.: 1989, Plan recognition and its use in understanding dialog. In: A. Kobsa and W. Wahlster (eds.): User Models in Dialog Systems. Berlin: Springer-Verlag, pp. 133–162.

    Google Scholar 

  • Carbonell, J. R.: 1970, AI in CAI: An artificial-intelligence approach to computer-assisted instruction. IEEE Transactions on Man-Machine Systems 4, 190–202.

    Google Scholar 

  • Carr, B. and I. P. Goldstein: 1977, Overlays: A theory of modelling for computer aided instruction. Technical Report AI Memo 406, Massachusetts Institute of Technology, Artificial Intelligence Laboratory.

  • Cassell, J., C. Pelachaud, N. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, and M. Stone: 1994, ANIMATED CONVERSATION: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In: SIGGRAPH '94.

  • Cauzinille-Marmeche, E. and J. Mathieu: 1988, Experimental data for the design of a microworldbased system for algebra. In: H. Mandl and A. Lesgold (eds.): Learning Issues for Intelligent Tutoring Systems. New York: Springer-Verlag, pp. 278–286.

    Google Scholar 

  • Cawsey, A.: 1992, Explanation and Interaction: The Computer Generation of Explanatory Dialogues. MIT Press.

  • Chu-Carroll, J. and S. Carberry: 1994, A plan-based model for response generation in collaborative task-oriented dialogues. In: AAAI-94: Proceedings of the Twelfth National Conference on Artificial Intelligence, vol. 1. pp. 799–805.

    Google Scholar 

  • Cohen, R., C. Allaby, C. Cumbaa, M. Fitzgerald, K. Ho, B. Hui, C. Latulipe, F. Lu, N. Moussa, D. Pooley, A. Qian, and S. Siddiqi: 1998, What is initiative? iUser Modeling and User-Adapted Interaction. 8(3–4), pp. ??-??.

  • Collins, J., J. Greer, V. Kumar, G. McCalla, P.Meagher, and R. Tkatch: 1997, Inspectable user models for just-in-time workplace training. In: Proceedings of the Sixth International Conference on User Modeling Chia Laguna, Italy. pp. 327–337.

  • Elhadad, M.: 1991, FUF: The universal unifier user manual version 5.0. Technical Report CUCS–038–91, Department of Computer Science, Columbia University.

  • Feiner, S. K. and K. R. McKeown: 1990, Coordinating text and graphics in explanation generation. In: Proceedings of the Eighth National Conference on Artificial Intelligence. Boston, MA, pp. 442–449.

  • Freedman, R. K.: 1996, Interaction of discourse planning, instructional planning and dialogue management in an interactive tutoring system. Ph.D. thesis, Northwestern University.

  • Green, N. and S. Carberry: 1999, A computational mechanism for initiative in answer generation. In this issue.

  • Grimes, J. E.: 1975, The Thread of Discourse. The Hague: Mouton.

    Google Scholar 

  • Guinn, C. I.: 1995, Meta-dialogue behaviors: Improving the efficiency of human-machine dialogue-A computational model of variable initiative and negotiation in collaborative problem-solving. Ph.D. thesis, Duke University.

  • Hale, C. R. and L. W. Barsalou: 1995, Explanation content and construction during system learning and troubleshooting. The Journal of the Learning Sciences 4(4), 385–436.

    Google Scholar 

  • Hill, R. W. and W. L. Johnson: 1995, Situated plan attribution. Journal of Artificial Intelligence in Education 6(1), 35–66.

    Google Scholar 

  • Hollan, J. D., E. L. Hutchins, and L. M. Weitzman: 1987, STEAMER: An interactive, inspectable, simulation-based training system. In: G. Kearsley (ed.): Artificial Intelligence and Instruction: Applications and Methods. Reading, MA: Addison-Wesley, pp. 113–134.

    Google Scholar 

  • Hovy, E. H.: 1993, Automated discourse generation using discourse structure relations. Artificial Intelligence 63, 341–385.

    Google Scholar 

  • Kurlander, D. and D. T. Ling: 1995, Planning-based control of interface animation. In: Proceedings of CHI '95. pp. 472–479.

  • Lawler, R. W. and G. P. Lawler: 1987, Computer microworlds and reading: An analysis for their systematic application. In: R. W. Lawler and M. Yazdani (eds.): Artificial Intelligence and Education, Vol. 1. Norwood, NJ: Ablex, pp. 95–115.

    Google Scholar 

  • Lesgold, A., S. Lajoie, M. Bunzo, and G. Eggan: 1992, SHERLOCK: A coached practice environment for an electronics trouble-shooting job. In: J. H. Larkin and R. W. Chabay (eds.): Computer-Assisted Instruction and Intelligent Tutoring Systems: Shared Goals and Complementary Approaches. Hillsdale, NJ: Lawrence Erlbaum, pp. 201–238.

    Google Scholar 

  • Lester, J. C., S. A. Converse, S. E. Kahler, S. T. Barlow, B. A. Stone, and R. Bhogal: 1997a, The persona effect: Affective impact of animated pedagogical agents. In: Proceedings of CHI'97 (Human Factors in Computing Systems). pp. 359–366.

  • Lester, J. C., S. A. Converse, B. A. Stone, S. E. Kahler, and S. T. Barlow: 1997b, Animated pedagogical agents and problem-solving effectiveness: A large-scale empirical evaluation. In: Proceedings of Eighth World Conference on Artificial Intelligence in Education. pp. 23–30.

  • Lester, J. C., P. J. FitzGerald, and B. A. Stone: 1997c, The pedagogical design studio: Exploiting artifact-based task models for constructivist learning. In: Proceedings of the Third International Conference on Intelligent User Interfaces. pp. 155–162.

  • Lester, J. C. and B. W. Porter: 1997, Developing and empirically evaluating robust explanation generators: The KNIGHT experiments. Computational Linguistics 23(1), 65–101.

    Google Scholar 

  • Lester, J. C. and B. A. Stone: 1997, Increasing believability in animated pedagogical agents. In: Proceedings of the First International Conference on Autonomous Agents. pp. 16–21.

  • Lester, J. C., B. A. Stone, M. A. O'Leary, and R. B. Stevenson: 1996, Focusing problem solving in design-centered learning environments. In: Proceedings of the Third International Conference on Intelligent Tutoring Systems. pp. 475–483.

  • Maes, P., T. Darrell, B. Blumberg, and A. Pentland: 1995, The ALIVE system: Full-body interaction with autonomous agents. In: Proceedings of the Computer Animation '95 Conference.

  • Mark, M. A. and J. E. Greer: 1995, The VCR tutor: Effective instruction for device operation. Journal of the Learning Sciences 4(2), 209–246.

    Google Scholar 

  • Maybury, M. T.: 1991, Planning multimedia explanations using communicative acts. In: Proceedings of the Ninth National Conference on Artificial Intelligence. Anaheim, CA, pp. 61–66.

  • Mittal, V., S. Roth, J. D. Moore, J. Mattis, and G. Carenini: 1995, Generating explanatory captions for information graphics. In: Proceedings of the International Joint Conference on Artificial Intelligence. pp. 1276–1283.

  • Mittal, V. O.: 1993, Generating natural language descriptions with integrated text and examples. Ph.D. thesis, University of Southern California.

  • Moore, J. D.: 1995, Participating in Explanatory Dialogues. MIT Press.

  • Murray, W. R.: 1990, A blackboard-based dynamic instructional planner. In: Proceedings of the Eighth National Conference on Artificial Intelligence. pp. 434–441.

  • Newell, A.: 1990, Unified Theories of Cognition. Harvard University Press.

  • Noake, R.: 1988, Animation Techniques. London: Chartwell.

    Google Scholar 

  • Papert, S.: 1991, Situating constructionism. In: I. Harel and S. Papert (eds.): Constructionism. Norwood, NJ: Ablex, pp. 1–12.

    Google Scholar 

  • Peachey, D. R. and G. I. McCalla: 1986, Using planning techniques in intelligent tutoring systems. International Journal of Man-Machine Studies 24, 77–98.

    Google Scholar 

  • Piaget, J.: 1954, The Construction of Reality in the Child. New York: Basic Books.

    Google Scholar 

  • Rich, C. and C. L. Sidner: 1998, COLLAGEN: A collaboration manager for software interface agents. User Modeling and User-Adapted Interaction. 8(3–4), 317–351.

    Google Scholar 

  • Rickel, J. and L. Johnson: 1997, Intelligent tutoring in virtual reality: A preliminary report. In: Proceedings of the Eighth World Conference on AI in Education. pp. 294–301.

  • Roth, S. F., J. Mattis, and X. Mesnard: 1991, Graphics and natural language as components of automatic explanation. In: J. W. Sullivan and S.W. Tyler (eds.): Intelligent User Interfaces. New York: Addison-Wesley, pp. 207–239.

    Google Scholar 

  • Simon, H. A.: 1981, The Sciences of the Artificial. Cambridge, MA: MIT Press.

    Google Scholar 

  • Smith, R. W. and D. R. Hipp: 1994, Spoken Natural Language Dialog Systems. Cambridge, Massachusetts: Oxford University Press.

    Google Scholar 

  • Stone, B. A. and J. C. Lester: 1996, Dynamically sequencing an animated pedagogical agent. In: Proceedings of the Thirteenth National Conference on Artificial Intelligence. pp. 424–431.

  • Suthers, D. D.: 1991, A task-appropriate hybrid Architecture for explanation. Computational Intelligence 7(4), 315–333.

    Google Scholar 

  • Thompson, P.W.: 1987, Mathematical microworlds and intelligent computer-assisted instruction. In: G. Kearsley (ed.): Artificial Intelligence and Instruction: Applications and Methods. Reading, MA: Addison-Wesley, pp. 83–109.

    Google Scholar 

  • Towns, S., C. Callaway, J. Voerman, and J. Lester: 1998, Coherent gestures, locomotion, and speech in life-like pedagogical agents. In: Proceedings of the Fourth International Conference on Intelligent User Interfaces. pp. 13–20.

  • Traum, D.: 1994, A computational theory of grounding in natural language generation. Ph.D. thesis, University of Rochester.

  • Walker, M.: 1993, Informational redundancy and resource bounds in dialogue. Ph.D. thesis, University of Pennsylvania.

  • Wenger, E.: 1987, Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge. Los Altos, California: Morgan Kaufmann.

    Google Scholar 

  • Wescourt, K. T., M. Beard, and A. Barr: 1981, Curriculum information networks for CAI: Research on testing and evaluation by simulation. In: P. Suppes (ed.): University-Level Computer-Assisted Instruction at Stanford: 1968–1980. Stanford, California: Stanford University, pp. 817–839.

    Google Scholar 

  • White, B. Y. and J. R. Frederiksen: 1987, Qualitative models and intelligent learning environments. In: R. W. Lawler and M. Yazdani (eds.): Artificial Intelligence and Education, vol. 1. Norwood, New Jersey: Ablex, pp. 281–305.

    Google Scholar 

  • Woolf, B. and D. D. McDonald: 1984, Building a computer tutor: Design issues. IEEE Computer 17(9), 61–73.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lester, J.C., Stone, B.A. & Stelling, G.D. Lifelike Pedagogical Agents for Mixed-initiative Problem Solving in Constructivist Learning Environments. User Modeling and User-Adapted Interaction 9, 1–44 (1999). https://doi.org/10.1023/A:1008374607830

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008374607830

Navigation