Analyzing Enron Data: Bitmap Indexing Outperforms MySQL Queries bySeveral Orders of Magnitude

Technical Report · Sat Jan 28 00:00:00 EST 2006

DOI:https://doi.org/10.2172/881612· OSTI ID:881612

Stockinger, Kurt; Rotem, Doron; Shoshani, Arie; Wu, Kesheng

FastBit is an efficient, compressed bitmap indexing technology that was developed in our group. In this report we evaluate the performance of MySQL and FastBit for analyzing the email traffic of the Enron dataset. The first finding shows that materializing the join results of several tables significantly improves the query performance. The second finding shows that FastBit outperforms MySQL by several orders of magnitude.

• Research Organization: Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
• Sponsoring Organization: USDOE; Department of Homeland Security
• DOE Contract Number: DE-AC02-05CH11231
• OSTI ID: 881612
• Report Number(s): LBNL-59437; R&D Project: KWC061; BnR: 400470000; TRN: US200612%%853
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE
PERFORMANCE
DATA ANALYSIS
F CODES
M CODES
DATA TRANSMISSION
COMPUTER NETWORKS
INFORMATION RETRIEVAL