The following list of publications span 20 years of research experience and a myriad of topics. They represent a sampling of the types of work and research experience of TDS personnel.

 

 

Bibliography
Marvin Thordsen
President/Senior Researcher, Team Decision Solutions, Inc.

Publications
(lead authorship listed first followed by non-lead publications)

Thordsen, M. (1998). Display design for Navy landing signal officers: Supporting decision making under extreme time pressure. In E. Hoadley & I. Benbasat (Eds.), Proceedings of the Fourth Americas Conference on Information Systems (pp. 255-256). Madison, WI: Omnipress.

Thordsen, M., Galushka, J., Young, S., & Klein, G. A. (1987). Distributed decision making in a command and control planning environment (Contract MDA903-86-C-0170 for the U.S. Army Research Institute, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M., Hutton, R., & Anastasi, D. (1998). The cognitive function model. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1, 385-389.

Thordsen, M., Klein, G. A., Michel, R., & Sullivan, E. (1988). Methods for providing direct feedback about decision processes for command-and control classroom exercises (Final Technical Report Prepared for Contract MDA903-87-C-0523 for the U.S. Army Research Institute, Aviation Research and Development Activity, Ft. Rucker, AL). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Galushka, J., Klein, G. A., Young, S., & Brezovic, C. P. (1990). A knowledge elicitation study of military planning (Technical Report 876 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L. (1991). A comparison of two tools for cognitive task analysis: Concept mapping and the critical decision method. Proceedings of the Human Factors Society 35th Annual Meeting, 1, 283-285.

Thordsen, M. L. (1998). A test of a team performance error taxonomy: Including preliminary examination of the relationship between domain attribute and error distribution. Manuscript in preparation.

Thordsen, M. L., Brezovic, C. P., & Klein, G. A. (1988). A decision support quotient for evaluating the performance of decision support systems (Contract MDA903-86-C-0170 for the U. S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., & Calderwood, R. (1989). Protocol analysis of flight crew decision making during simulated malfunctions (Order No. A72145C for the NASA/Ames Research Center, Moffett Field, CA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Henke, A., King, J. A., & Stottler, R. H. (1989). A case-based reasoning system for conceptual design and software modeling (Contract F33657-88-C-2145 for USAF/AFSC, Aeronautical Systems Division/XRX, Wright-Patterson AFB, OH). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Henke, A., & Wolf, S. (1990). Case-based reassigning training estimation systems in manpower, personnel, and training (Final Report under Contract F41622-89-C-1009 for the AFHRL/MODJ, Brooks AFB, TX). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., & Klein, G. A. (1988). Methods for providing direct feedback about decision process for command and control classroom exercises (Final Report under Contract MDA903-86-C-0170 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., & Klein, G. A. (1989). Cognitive processes of the team mind. Paper presented at the Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, Cambridge, MA.

Thordsen, M. L., & Klein, G. A. (1990). Cognitive analysis of C2 decision making. Paper presented at the Proceedings of the Seventh Annual Workshop on Command-and-Control Decision Aiding, Dayton, OH.

Thordsen, M. L., & Klein, G. A. (1990). Cognitive features of team decision making. Proceedings of the 1990 NAECON Meeting, 891-893.

Thordsen, M. L., & Klein, G. A. (1991). Training implications of a team decision model. Paper presented at the Proceedings of the Sixth Industrial Symposium on Aviation Psychology, Columbus, OH.

Thordsen, M. L., Klein, G. A., & Wolf, S. (1990). Observing team coordination within Army rotary-wing aircraft crews (Contract MDA903-87-C-0523 for the U.S. Army Research Institute, Aviation Research and Development Activity, Ft. Rucker, AL). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Klein, G. A., & Wolf, S. P. (1991). Using a cognitive model to evaluate teamwork (Contract MDA903-90-C-0119 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Klein, G. A., Wolf, S. P., & Banks, J. (1993). Development of a cognitive model to evaluate teamwork in command-and-control teams (Contract MDA903-90-C-0119 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Kyne, M., & Klein, G. (1994). A model of advanced team decision making and performance (Contract MDA903-92-C-0098 for the U.S. Army Research Institute, Presidio-Monterey, CA). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., McCloskey, M. J., Heaton, J. K., & Serfaty, D. (1998). Decision-centered development of a mission rehearsal system (Technical Report 98-008). Orlando, FL: Naval Air Warfare Center Training Systems Division.

Thordsen, M. L., Militello, L. G., & Klein, G. (1992). Cognitive task analysis of critical team decision making during multiship engagements (Contract F33615-90-C-0005 for Williams AFB, AZ). Fairborn, OH: Klein Associates Inc.

Thordsen, M. L., Wolf, S. P., & Crandall, B. (1990). User-defined requirements for the JSTARS self-defense suite (Contract F33615-88-D-0536 in conjunction with the Unisys Corporation for the Armstrong Aerospace Medical Research Laboratory, Human Systems Division, Air Force Systems Command, Wright-Patterson AFB, OH). Fairborn, OH: Klein Associates Inc.

Anastasi, D., Hutton, R., Thordsen, M., Klein, G., & Serfaty, D. (1997). Cognitive function modeling for capturing complexity in system design. 1997 IEEE International Conference on Systems, Man, and Cybernetics, 1, 221-226.

Brezovic, C. P., Klein, G. A., & Thordsen, M. (1987). Decision making in armored platoon command (Contract MDA903-85-C-0327 for U.S. Army Research Institute, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Calderwood, R., & Thordsen, M. (1989). An evaluation of a crisis decision exercise at the NationalDefenseUniversity using a group protocol methodology (Contract MDA903-89-C-0077 for the U.S. Army Research Institute for the Behavioral and Social Sciences, Alexandria, VA). Fairborn: Klein Associates Inc.

Harris, D., Malek, D. A., Ross, K. G., & Thordsen, M. L. (2002). Developing a scenario-based training pedagogy for distributed teams (Final Report for Contract #F33615-02-M-6011 prepared for the Air Force Research Laboratory, Mesa, AZ). Fairborn, OH: Klein Associates Inc.

Hutton, R., Thordsen, M., & Mogford, R. (1997). En route air traffic controller decision making and errors: An application of the Recognition-Primed Decision model to error analysis. Paper presented at the Proceedings of Ninth International Symposium on Aviation Psychology, Columbus, OH.

Hutton, R. J. B., Anastasi, D., Thordsen, M. L., Copeland, R. R., Klein, G., & Serfaty, D. (1997). Cognitive function model: Providing design engineers with a model of skilled human decision making (Contract No. N00178-97-C-3019 for the Naval Surface Warfare Center, Dahlgren, VA). Fairborn, OH: Klein Associates Inc.

Hutton, R. J. B., Olszewski, R., Thordsen, M. L., & Kaempf, G. L. (1997). En route air traffic controller decision making model and decision maker vulnerabilities (Report prepared for NYMA Inc. under FAA Contract No. DTFA01-94-Y-01078). Fairborn, OH: Klein Associates Inc.

Hutton, R. J. B., Thordsen, M., Militello, L., & Heaton, J. (1995). Cognitive task analysis of drivers and traffic management personnel: Implications for human factors guidelines for advanced traveler information systems (Contract FHWA DTFH61-95-C-00017 for COMSIS Corporation). Fairborn, OH: Klein Associates Inc.

Kaempf, G. L., Klein, G., Thordsen, M. L., & Wolf, S. (1996). Decision making in complex command-and-control environments. Human Factors, 38, 220-231.

Kaempf, G. L., Klein, G. A., & Thordsen, M. L. (1991). Applying recognition-primed decision making to man-machine interface design (Contract NAS2-13359 for NASA-Ames Research Center, Moffett Field, CA). Fairborn, OH: Klein Associates Inc.

Kaempf, G. L., Thordsen, M. L., & Klein, G. A. (1991). Application of an expertise-centered taxonomy to training decisions (Contract MDA903-C-91-0050 for the U.S. Army Research Institute). Fairborn, OH: Klein Associates Inc.

Kaempf, G. L., Thordsen, M. L., McCloskey, M., & Johnson, I. (1995). Situational filters for battle command information displays (Technical Report under Contract DAAL01-95-C-0041 for the U.S. Army Research Laboratory, Ft. Huachuca, AZ). Fairborn, OH: Klein Associates Inc.

Kaempf, G. L., Wolf, S., Thordsen, M. L., & Klein, G. (1992). Decision making in the AEGIS combat information center (Contract N66001-90-C-6023 for the Naval Command, Control and Ocean Surveillance Center). Fairborn, OH: Klein Associates Inc.

Klein, G., Kaempf, G., Wolf, S., Thordsen, M., & Miller, T. E. (1997). Applying decision requirements to user-centered design. International Journal of Human-Computer Studies, 46, 1-15.

Klein, G., Pliske, R., Wiggins, S., Thordsen, M. L., Green, S. L., Klinger, D., & Serfaty, D. (1999). A model of distributed team performance (Final Report Contract N61339-98-C-0062 for NAWCTSD). Fairborn, OH: Klein Associates Inc.

Klein, G., Pliske, R. M., Thordsen, M. L., Hutton, R. J. B., Lake, P. L., & Woods, D. (1998). Evaluation of a process model of problem detection (Report for Japan Atomic Research Institute). Fairborn, OH: Klein Associates Inc.

Klein, G. A., & Thordsen, M. (1988). Use of progressive deepening in battle management. Paper presented at the Proceedings of the 11th Biennial DoD Psychology Conference, Colorado Springs, CO.

Klein, G. A., & Thordsen, M. L. (1988). Evaluation of performance during a training exercise at an emergency operations center (Contract for Monsanto Corporation). Fairborn, OH: Klein Associates Inc.

Klein, G. A., & Thordsen, M. L. (1989). Recognitional decision making in C2 organizations. Proceedings of the 1989 Symposium on Command-and-Control Research, 239-244.

Klein, G. A., & Thordsen, M. L. (1990). A cognitive model of team decision making. Proceedings of the JDL 1990 Symposium on C2 Research, 270-274.

Klein, G. A., & Thordsen, M. L. (1991). Representing cockpit crew decision making. Paper presented at the Proceedings of the Sixth Industrial Symposium on Aviation Psychology, Columbus, OH.

Klein, G. A., Zsambok, C. E., & Thordsen, M. L. (1993). Team decision training: Five myths and a model. Military Review(April), 36-42.

Klinger, David W., Thordsen, Marvin L., & Lewis, Robert W. (2003). Cognitive Task Analysis in the Joint Air Operations Center: Contributing to the Design of the Time Sensitive Targeting Cell. Prepared for Applied Research Associates Inc. Panama City, FL.

Klinger, D. W., & Hahn, B. B. (2003). Handbook of team CTA (Manual developed under prime contract F41624-97-C-6025 from the Human systems Center, Brooks AFB, TX). Fairborn, OH: Klein Associates Inc.

Klinger, D. W., & Thordsen, M. (1998). Team CTA applications and methodologies. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1, 206-209.

Klinger, D. W., Thordsen, M. L., & Copeland, R. R. (1998). A cognitive task analysis of surveillance personnel onboard AWACS aircraft (Final Technical Report Contract P.O. P3805, Prime Contract F41624-95-D-6026). Fairborn, OH: Klein Associates Inc.

McDermott, P., Klein, G., Thordsen, M., & Paley, M. (2000). Representing the Cognitive Demands of New Systems: A Decision-Centered Design Approach (Final Report under Contract F41624-99-C-6029 for the AFRL/HECI, Wright Patterson AFB, OH). Fairborn, OH: Klein Associates Inc.

McDermott, P., Klein, G., Thordsen, M., Ransom, S., & Paley, M. (2000). Representing the cognitive demands of new systems: A decision-centered design approach (Technical Report AFRL-HE-WP-TR-2000-0023). Wright-Patterson AFB, OH: Human Effectiveness Directorate, Crew System Interface Division.

Militello, L. G., Heaton, J. K., Lake, P. L., Thordsen, M., & Klein, G. (1998). Author aid: Self-CTA for authors of tactical documents (Final Report Contract No. N61339-97-C-0026 prepared for Naval Air Warfare Center Training Systems Division). Fairborn, OH: Klein Associates Inc.

Militello, L. G., Kyne, M. M., Klein, G., Getchell, K., & Thordsen, M. L. (1999). A synthesized model of team performance. International Journal of Cognitive Ergonomics, 3(2), 131-158.

Militello, L. G., Kyne, M. M., Klein, G., Getchell-Reiter, K., & Thordsen, M. L. (1994). Comparing models of team performance (Contract MDA903-92-C-0098 for the U.S. Army Research Institute). Fairborn, OH: Klein Associates Inc.

Miller, T. E., Wolf, S. P., Thordsen, M. L., & Klein, G. (1992). A decision-centered approach to storyboarding anti-air warfare interfaces (Contract No. N66001-90-C-6023 for the Naval Command, Control and Ocean Surveillance Center, San Diego, CA). Fairborn, OH: Klein Associates Inc.

Morphew, M. E., Thordsen, M. L., & Klein, G. (1998). The development of cognitive analysis methods to aid interface design. Proceedings of the Human Factors and Ergonomics Society 42nd Annual Meeting, 1, 305-307.

Phillips, J., McDermott, P. L., Thordsen, M., McCloskey, M. J., & Klein, G. (1998). Cognitive requirements for small unit leaders in military operations in urban terrain (Army Research Report 1728). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences.

Phillips, J. K., McCloskey, M. J., McDermott, P. L., Wiggins, S. L., Battaglia, D. A., & Thordsen, M. L. (2001). Decision-centered MOUT training for small unit leaders (Research Report 1776 for Contract DASW01-99-C-0002 for U.S. Army Research Institute for the Behavioral and Social Sciences). Fairborn, OH: Klein Associates.

Stanard, T., Thordsen, M. L., Lewis, W. R., Klinger, D. W., & (2004). Coordination requirements for the IW Flight. (Prepared under Subcontract No. 10901-9093-1201 (Sytronics, Inc.) Prime Contract: F33615-98-D-60000 (DO 0009) for Eletronic Systems Center/SRT, Lackland AFB, TX). Fairborn, OH: Klein Associates Inc.

Stanard, T., McDermott, P. L., Thordsen, M. L., & Militello, L. G. (1998). Advancing TRIAD through knowledge elicitation, training, and security protocol (Technical Report under Subcontract 98-10337 for Sonalysts, Inc., Waterford: CT). Fairborn, OH: Klein Associates Inc.

Stanard, T., Thordsen, M., & McDermott, P. (2000). Developing a TACMEMO taxonomy to support an electronic TACMEMO authoring environment. Paper presented at the Threats, Countermeasures, and Situational Awareness: Teaming for Survivability Symposium and Exhibition, Virginia Beach, VA.

Stanard, T. W., Thordsen, M. L., & McCloskey, M. J. (2001). Cognitive task analysis and work-centered support system recommendations for a deployed network operations support center (NOSC-D) (Technical Report F33615-99-D-6001). Wright-Patterson AFB, Ohio: Air Force Research Laboratory.

Stottler, R., & Thordsen, M. L. (1997). Artificial intelligence techniques for the Pilot Approach Decision Aid Logic (PADAL) System (Contract No. 68335-96-C-0205 for Naval Air Warfare Center, Aircraft Division, Lakehurst, NJ). San Mateo, CA: Stottler Henke Associates Inc.

Taynor, J., Klein, G. A., & Thordsen, M. (1987). Distributed decision making in wildland firefighting (Contract MDA903-85-C-0327 for U.S. Army Research Institute, Alexandria, VA). Fairborn, OH: Klein Associates Inc.

Wolf, S., Klein, G., Thordsen, M., & Klinger, D. (1991). Factors affecting the decision making of fire direction officers (Contract DAA15-90-C-1054 for the U. S. Army Ballistics Research Laboratory). Fairborn, OH: Klein Associates Inc.

* This list represents approximately 90% of M. Thordsen’s publications. The remaining ones have been misplaced or forgotten over the years.

Partial List of Tools, Displays, and Training developed.

Stabalization and Support Operations (SASO) Electronic Decision Exercise. This tool is a web based, collaborative tool and includes support materials. It is currently being used in some classes at the U.S. Army’s Command and General Staff College to support training for “peacekeeping missions” such as Bosnia & Kosovo.

Mission Rehearsal tool. This web-accessible tool was developed for the navy as part of a project to train individuals on the challenges inherent in working on distributed teams.

Electronic Decision Games (eDG). These represent a variety of scenario based “immersive training” tools that are built around real world incidents and situations. They are generally web-based and the participants find themselves in situations that have high cognitive fidelity that helps them begin to better understand the “problem and decision” spaces they will be working in. These address a variety of domains from urban and wildland firefighting to military operations.

Multinational Training Tool. This tool was developed to help individuals in multinational environments (such as the forces at the NATO headquarters in Sarajevo, Bosnia- Herzegovina. The focus was to help individuals better understand the cultural differences that exist in multinational environments so they can reduce the negative impact of these differences on the team’s performance.

“Jump Seat” Pilot Aid. This tool is in development. TDS is collaborating with two commercial airline senior pilots to develop an aid for less experienced pilots. The concept is to understand the unique and challenging aspects of flying approaches to specific airfields from the point of view of experienced pilots (for that airfield), the air traffic controllers in that area, the specific airlines “company policies”, and finally airfield specific security issues. The tool is designed to be web based which will afford access to any pilot from anywhere that has access to the web as preparation for flying into an airport they are not familiar with. The idea is to capture these four different types of expertise and knowledge and make it accessible, much as if these individuals were sitting in the jump seat in the cockpit as you were making the approach. Note that the preliminary development is for marketing purposes. Since September 11 th, Airlines themselves have little money, however, their endorsement and perceived need for a product can have lot of influence at the FAA level, who can support further development. Therefore, a demo version is being developed based on one airport to use to generate support and demonstrate needs.

Law Enforcement Training Supplement. This is another product being developed for marketing purposes. Like the airlines, local law enforcement agencies do not have a lot of money but the Department of Justice does. This tool is scenario based with the aim to put new cadets into the decision and problem spaces they will confront and to pass off to them some of the lessons learned by more experienced officers. This differs from current training in that it will also incorporate concepts from military lessons learned, such as “putting yourself in the place of the enemy,” rather than just looking at the situation from your own perspective.

Methods & Models
(developed or contributed to)

Model of Advance Team Performance
Team Mind
Model of Problem Detection
Contribution to model of Advanced Team Decision Making
Contribution to model of Adaptive Teams
Contribution to later versions of the model(s) of Recognition Primed Decisionmaking
Taxonomy of Types of Distributed Team Tasks
Taxonomy of Types of Distributed Teams
Data analysis and collection techniques (e.g., Team Cognitive Task Analysis methodologies)
Model of Errors that are Unique to Team

 

 

Home | About Us | Domains | Approach | Publications | Gallery | Contact Us

© Marv Thordsen, 2004