Evaluating Visual Analytics at the 2007 VAST Symposium Contest

Journal Article · Sat Mar 01 04:00:00 EST 2008 · IEEE Computer Graphics and Applications, 28(2):12-21

DOI:https://doi.org/10.1109/MCG.2008.27· OSTI ID:926929

Plaisant, Catherine; Grinstein, Georges; Scholtz, Jean; Whiting, Mark A; O'Connell, Theresa; Laskowski, Sharon; Chien, Lynn; Tat, Annie; Wright, William; Gorg, Carsten; Lui, Zhicheng; Parekh, Neel; Singhal, Kanupriya; Stasko, John T

The second Visual Analytics Science and Technology (VAST) contest was held in conjunction with the 2007 IEEE VAST Symposium. A synthetic data set was created containing a known scenario with embedded threats, therefore providing ground truth. Participants used visual analytic tools to explore the heterogeneous data collection and find the evidence of illegal and possible terrorist activities in the data. We describe the contest and the evaluation methodology, then provide details on the results and the two winning entries. Lessons learned are reported from different points of view: contest committee, participants, judges, stake holders and other researchers.

• Research Organization: Pacific Northwest National Laboratory (PNNL), Richland, WA (US)
• Sponsoring Organization: USDOE
• DOE Contract Number: AC05-76RL01830
• OSTI ID: 926929
• Report Number(s): PNNL-SA-58089; 400904120
• Journal Information: IEEE Computer Graphics and Applications, 28(2):12-21, Journal Name: IEEE Computer Graphics and Applications, 28(2):12-21
• Country of Publication: United States
• Language: English

Related Subjects

VAST contest
evaluation
threat stream generator
visual analytics