Supporting collaborative information analysis using interactive visualization: A design research
Open Access
- Author:
- Chen, Dong
- Graduate Program:
- Information Sciences and Technology
- Degree:
- Doctor of Philosophy
- Document Type:
- Dissertation
- Date of Defense:
- February 08, 2021
- Committee Members:
- Jack Carroll, Dissertation Advisor/Co-Advisor
Jack Carroll, Committee Chair/Co-Chair
Alan M Mac Eachren, Committee Member
Xiaolong Zhang, Committee Member
Mary Beth Oliver, Outside Member
Mary Beth Rosson, Program Head/Chair - Keywords:
- collaboration
visualization
visual analytics
information analysis
classroom study - Abstract:
- Collaborative information analysis is a form of sensemaking that involves modeling and representation of complex information space through synchronous and asynchronous team interactions over extended periods. The effectiveness of collaboration determines team performance, which directly impacts the justice of decisions made or solutions proposed. Effective collaboration is challenging because extra efforts are required to develop and maintain team awareness on top of the information analysis task, which itself demands a high need for cognition. A large number of researches have been conducted to support collaboration and information analysis separately. For example, numerous tools and techniques have been developed to facilitate the processing and visualization of information analysis, but the majority are designed for individual use rather than for collaborative use. On the other hand, collaborative tools, also known as groupware, are developed to improve team effectiveness, yet they often lack support for advanced information modeling and representation. A gap exists between the two research areas, a design space yet to be explored when a team is engaged in collaboratively analyzing a set of data. Simply applying design implications from both areas together should not work because we must address the tension of need for cognition between them. To some extent, the task of collaborative information analysis is a different activity from either. People are engaged in a different workflow and face new challenges, which this research tries to understand and support. Evaluating effective tool support for collaborative information analysis is another multifaceted and complex problem. Researchers often reduce the complexity of the analytic task for the sake of ease of measurement. In practice, it is challenging to model complex analytic scenarios in lab studies, which span only a couple of hours. Meanwhile, real cases and professional analysts are often limited to access in reality. However, the level of task complexity directly determines the need for cognition in analysis and influences the collaboration strategy teams will employ. This research addresses the challenge of empirical evaluation and targets situations in which professionals need to both analyze complex information and collaborate. My research starts with a task analysis of an example of collaborative information analysis in the real world: an undergraduate course of Intelligence Analysis at Pennsylvania State University. I described student analysts' workflow and their team behavior with current tooling. Specifically, the study observes that structured techniques are frequently employed but lack serious collaborative support. Based on the observation, five design objectives are proposed for a better collaborative tool. These objectives drive the design and development of a new tool out from this dissertation, CAnalytics, an integrated analytic workspace that supports real-time collaborative data annotation for information modeling and collaborative data visualization for information analysis. CAnalytics is evaluated in two classroom studies, in which students are being trained to become professional information analysts. I did a quantitative analysis of system logs and student reports, as well as a qualitative analysis of questionnaires. The first study emphasizes the assessment of integrating structured information modeling and visualization in a single collaborative workspace. I analyze different team behaviors in multiple dimensions and their interaction with team performance. The second study focuses on supporting a higher-order information analysis activity, i.e. collaborative hypothesis development, using a structured approach. Both studies contribute to the understanding of analysts' team behavior in collaborative information analysis and the role of computing tools in support of both collaboration and information handling. In summary, this dissertation contributes an understanding of how analysts use computing tools for collaboratively analyzing information in the real world. The research produces a collaborative visualization tool that leverages structured techniques from the intelligence community as well as design knowledge of team awareness from the CSCW (Computer-Supported Collaborative Work) community. The classroom studies evaluate design choices and help identify emerging design challenges. The dissertation ends with design implications and proposes that structured techniques and collaboration be enablers for each other.