You are here

Home » Content

Modeling Cognitive Strategies during Complex Task Performing Process

Journal Name:

  • Turkish Online Journal of Qualitative Inquiry

Publication Year:

  • 2012

Key Words:

Author NameUniversity of Author
Abstract (2. Language): 
The purpose of this study is to examine individuals’ computer based complex task performing processes and strategies in order to determine the reasons of failure by cognitive task analysis method and cued retrospective think aloud with eye movement data. Study group was five senior students from Computer Education and Instructional Technologies Department at a state university. A computer based complex task including a logical reasoning process was developed and utilized. Data was collected with cued retrospective think aloud containing a gaze video replay and eye tracking. All the retrospective protocols were transcribed for analysis then a coding schema was developed iteratively from segments. By drawing area of interest fields(AOI) of task panel, eye movement data in specific processes and fields were analyzed by using fixation duration and fixation count metrics. None of the participants completed the task successfully within the given amount of time (max-10 min.). The findings yielded seven cognitive strategies (“information gathering-reviewing”, “identification well-defined instructions”, “cue-seeking”, “using cues”, “assumption”, “trial and error” and “crosschecking”) and their actions obtained from the task performing process. Furthermore, this process is modeled by defining sequences and the relations between the actions and cognitive strategies. It has been revealed that trial and error is the most employed strategy and participants used trial and error without reasoning. Moreover, it has been revealed out that participants mostly failed in choosing and using the right strategy.
Bookmark/Search this post with
FULL TEXT (PDF): 
PDF icon arastirmax-modeling-cognitive-strategies-during-complex-task-performing-process.pdf
  • 4
1
27
  • English

REFERENCES

References: 

Allen, R. & McGeorge, P. (2011). Enumeration: Experts Take Their Time, Applied Cognitive Psychology, 25.588–592
Bainbridge, L. (1997). The change in concepts needed to account for human behaviour in complex dynamic tasks. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 27, 351–359.
Branch, J. L. (2000). Investigating the information-seeking processes of adolescents: The value of using think-alouds and think afters. Library and Information Science Research, 22(4), 371–392.
Brand-Gruwel, S., Wopereis, I., & Vermetten, Y. (2005). Information problem solving by experts and novice: Analysis of a complex cognitive skill. Computers in Human Behavior, 21, 487–508.
Breslow, L. (2001). Transforming Novice Problem Solvers Into Experts. Teaching and LEarning Library. Vol: XIII, No. 3. Retrieved January 10, 2011, from http://web.mit.edu/tll/tll-library/teach-talk/transforming-novice.html.
Campbell, D. J. 1988. Task complexity: A review and analysis. Academy of Management Review, 13: 40-52.
Chipman, S. F., Schraagen, J. M., & Shalin, V. L. (2000) Introduction to cognitive task analysis. In J. M Schraagen, S. F. Chipman & V. J. Shute (Eds.), Cognitive Task Analysis (pp. 3- 23). Mahwah, NJ: Lawrence Erlbaum Associates.
Creswell, J. W. (2007). Educational research: Planning, condacting, and evaluating quantitative and qualitative research (2nd ed.). Upper Saddle River, New Jersey: Pearson Education, Inc.
Cooke, N. J. (1999). Knowledge elicitation. In F. T. Durso (Ed.), Handbook of applied cognition (pp. 479-509). New York: Wiley.
De Koning, B. B., Tabbers, H. K., Rikers, R. M. J. P., & Paas, F. (2010). Attention guidance in learning from a complex animation: seeing is understanding? Learning and Instruction, 20(2), 111-122.
Turkish Online Journal of Qualitative Inquiry, October 2012, 3(4)
25
De'Sperati, C. (2003). The inner working of dynamic visuo-spatial imagery as revealed by spontaneous eye movements. In “The mind's eye: Cognitive and applied aspects of eye movement research”. 119-142.
Dole, J. A., Nokes, J. D., & Drits, D. (2008). Cognitive strategy instruction. In S. E. Israel & G. G. Duffy (Eds.), Handbook of research on reading comprehension (pp. 347-372). New York: Rutledge.
Eger, N., Ball, L., Stevens, R., and Dodd, J. (2007). Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. HCI 2007 Proceedings.
Ertmer, P. et.al. (2008b). Ill-Structured Problem Solving: Helping Instructional Design Novices Perform Like Experts. AERA-2008. Retrieved from http://www.edci.purdue.edu/ertmer/docs/AERA08_ExpertNovice.pdf
Ertmer, P. et.al. (2008a) How instructional design experts use knowledge and experience to solve ill-structured problems. Performance Improvement Quarterly, 21, 17-42.
Funke, J. 1991. Solving complex problems: exploration and control of complex systems. In Complex Problem Solving: Principles and Mechanisms, Sternberg R, Frensch P. (eds). Lawrence Erlbaum Associates: Hillsdale, NJ.
Glaser, B. G., & Strauss, A. L. (1995). The discovery of grounded theory: strategies for qualitative research. Chicago: Aldine Pub. Co.
Guan, Z., Lee, S., Cuddihy, E., Ramey, J. (2006). The validity of the stimulated retrospective think-aloud method as measured by eye tracking. In: Proceedings of the SIGCHI conference on Human Factors in Computing Systems, 1253–1262.
Hackling, M. (1984). AARE Conference proceedings. 1(7). 304-309.
Hyönä, J. (2010) The use of eye movements in the study of multimedia learning. Learning and Instruction. 20(2). 172-176.
Hyrskykari, A., Ovaska, S., Majaranta, P., Räihä, K.-J. & Lehtinen, M. (2008). Gaze Path Stimulation in Retrospective Think-Aloud. Journal of Eye Movement Research, 2(4):5, 1-18.
Hill, J. R. & Hannafin, M.J. (1997). Cognitive strategies and learning from the World Wide Web. Educational Technology, Research and Development, 45(4). 37–64.
Jarodzka, H., Scheiter, K., Gerjets, P., & Van Gog, T. (2010). In the eyes of the beholder: how experts and novices interpret dynamic stimuli. Learning and Instruction, 20(2), 146-154.
Lazonder, A.W. (2000). Exploring novice users’ training needs in searching information on the WWW. Journal of Computer Assisted Learning, 16. 326–335.
Lincoln, Y.S., & Guba, E.G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage. Retrieved from http://www.google.com/books?hl=tr&lr=&id=2oA9aWlNeooC&oi=fnd&pg=
Marmaras, N. & Pavard. B. (1999). Problem-Driven Approach to the Design of Information Technology Systems Supporting Complex Cognitive Tasks. Cognition, Technology & Work, 1(4).
Miles, M. B., and A. M. Huberman. Qualitative Data Analysis: A Sourcebook of New Methods. Beverly Hills, Calif.: Sage, 1984.
Nakatani, C. & Pollatsek, A. (2004). An eye movement analysis of “mental rotation” of simple scenes. Perception & Psychophysics. 66(7). 1227-1245.
Turkish Online Journal of Qualitative Inquiry, October 2012, 3(4)
26
Patton, M. Q. (1990). Qualitative evaluation and research methods (2nd ed.). Newbury Park, CA: Sage Publications
Perone, J. and Tucker, L. (2003). An Exploration of Triangulation of Methodologies: Quantitative and Qualitative Methodology Fusion in an Investigation of Perceptions of Transit Safety. National Center for Transportation Research. University of South Florida. Retrieved from http://www.nctr.usf.edu/pdf/416-081-082.pdf.
Rayner, K. (1978). Eye Movements in Reading and Information Processing. Psychological Bulletin. 85(3). 618-660.
Rosenshine, B., Meister, C., & Chapman, S. (1996). Teaching students to generate questions: A review of the intervention studies. Review of Educational Research, 66, 181-221.
Russo, J. E. (1979). A software system for the collection of retrospective protocols prompted by eye fixations. Behavior Research Methods & Instrumentation, 11(2), 177-179.
Russo, J.E., Johnson, E.J. and Stephens, D.L. (1989). The Validity of Verbal Protocols. Memory and Cognition. 17,6. 759-769.
Seagull, F.J. & Xiao, Y. (2001). Using eye tracking video data to augment knowledge elicitation in cognitive task analysis. In Proceedings of the Human Factors and Ergonomics Society 45th Annual Meeting.
Strobel, J. & Pan, R.(2010) Compound Problem Solving: Insights from the Workplace for Engineering Education. Journal of Professional Issues in Engineering Education & Practice. doi:10.1061/(ASCE)EI.1943-5541.0000047.
Strube, G. (1991). The role of cognitive science in knowledge engineering, In: F. Schmalhofer, G. Strube (eds.), Contemporary knowledge engineering and cognition: First joint workshop, proceedings, 161-174.
Sweller, J. & Chandler, P. (1994). Why Some Material Is Difficult to Learn. Cognition and Instruction. 12(3). 185-23.
Sweller, J., van Merrienboer, J. J. G., & Paas, F. (1998). Cognitive architecture and instructional design. Educational Psychology Review, 10, 251–296.
van Gog, T. (2006). Uncovering the problem-solving process to design effective worked examples, Datawyse, Maastricht, The Netherlands.
van Merrienboer, J. J. G., Kster, L. & Paas, F. (2006). Teaching Complex Rather Than Simple Tasks: Balancing Intrinsic and Germane Load to Enhance Transfer of Learning. Applied Cognitive. Psychology. 20. 343–352 .
van Merrienboer, J. J. G., Clark, R. E., & de Croock, M. B. M. (2002). Blueprints for complex learning: The 4C/ID*-model. Educational Technology Research and Development, 50(2), 39-64.
van Merrienboer, J. J. G. (1997). Training complex cognitive skills: A four-component instructional design model for technical training. Englewood Cliffs, NJ: Educational Technology Publications.
van Merrienboer, J. J. G., Kirschner, P. A., & Kester, L. (2003). Taking the load of a learners’ mind: Instructional design for complex learning. Educational Psychologist, 38, 5–13.
Turkish Online Journal of Qualitative Inquiry, October 2012, 3(4)
27
van Someren, M. W., Barnard, Y. F., & Sandberg, J. A. C. (1994). The think-aloud method: A practical guide to modeling cognitive processes. San Diego, CA: Academic Press Ltd.Tobii, (2009). Retrospective Think Aloud and Eye Tracking – Comparing the value of different cues when using the retrospective think aloud method in web usability testing. Whitepaper of Retrospective Think Aloud and Eye Tracking.

Thank you for copying data from http://www.arastirmax.com