ColdRoute: effective routing of cold questions in stack exchange sites

Sun, Jiankai; Vishnu, Abhinav; Chakrabarti, Aniket; Siegel, Charles; Parthasarathy, Srinivasan

doi:10.1007/s10618-018-0577-7

Title: ColdRoute: effective routing of cold questions in stack exchange sites

Journal Article · 29 June 2018 · Data Mining and Knowledge Discovery

DOI: https://doi.org/10.1007/s10618-018-0577-7 · OSTI ID:1460547

^[1]; Vishnu, Abhinav ^[2]; Chakrabarti, Aniket ^[3]; Siegel, Charles ^[2]; Parthasarathy, Srinivasan ^[1]

The Ohio State Univ., Columbus, OH (United States)
Pacific Northwest National Lab. (PNNL), Richland, WA (United States)
Microsoft, Albuquerque, NM (United States)

Routing questions in Community Question Answer services such as Stack Exchange sites is a well-studied problem. Yet, cold-start—a phenomena observed when a new question is posted is not well addressed by existing approaches. Additionally, cold questions posted by new askers present significant challenges to state-of-the-art approaches. We propose ColdRoute to address these challenges. ColdRoute is able to handle the task of routing cold questions posted by new or existing askers to matching experts. Specifically, we use Factorization Machines on the one-hot encoding of critical features such as question tags and compare our approach to well-studied techniques such as CQARank and semantic matching (LDA, BoW, and Doc2Vec). Furthermore by using data from eight stack exchange sites, we are able to improve upon the routing metrics (Precision@1, Accuracy, MRR) over the state-of-the-art models such as semantic matching by 159.5, 31.84, and 40.36% for cold questions posted by existing askers, and 123.1, 27.03, and 34.81% for cold questions posted by new askers respectively.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)

Sponsoring Organization:: USDOE

Grant/Contract Number:: AC05-76RL01830

OSTI ID:: 1460547

Journal Information:: Data Mining and Knowledge Discovery, Journal Name: Data Mining and Knowledge Discovery Journal Issue: 5 Vol. 32; ISSN 1384-5810

Country of Publication:: United States

Language:: English

References (47)

Modeling problem difficulty and expertise in stackoverflow Hanrahan, Benjamin V.; Convertino, Gregorio; Nelson, Les Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion - CSCW '12 https://doi.org/10.1145/2141512.2141550	conference	January 2012
Ranking user authority with relevant knowledge categories for expert finding Zhu, Hengshu; Chen, Enhong; Xiong, Hui World Wide Web, Vol. 17, Issue 5 https://doi.org/10.1007/s11280-013-0217-5	journal	April 2013
Exploring user expertise and descriptive ability in community question answering Yang, Baoguo; Manandhar, Suresh 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2014 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM 2014) https://doi.org/10.1109/ASONAM.2014.6921604	conference	August 2014
Predicting Best Answerers for New Questions: An Approach Leveraging Distributed Representations of Words in Community Question Answering Dong, Hualei; Wang, Jian; Lin, Hongfei 2015 Ninth International Conference on Frontier of Computer Science and Technology (FCST) https://doi.org/10.1109/FCST.2015.56	conference	August 2015
Factorization Machines Rendle, Steffen 2010 IEEE 10th International Conference on Data Mining (ICDM), 2010 IEEE International Conference on Data Mining https://doi.org/10.1109/ICDM.2010.127	conference	December 2010
Scalable Coordinate Descent Approaches to Parallel Matrix Factorization for Recommender Systems Yu, Hsiang-Fu; Hsieh, Cho-Jui; Si, Si 2012 IEEE 12th International Conference on Data Mining (ICDM) https://doi.org/10.1109/ICDM.2012.168	conference	December 2012
Hierarchies in Directed Networks Tatti, Nikolaj 2015 IEEE International Conference on Data Mining (ICDM) https://doi.org/10.1109/ICDM.2015.12	conference	November 2015
Expert Finding for Question Answering via Graph Regularized Matrix Completion Zhao, Zhou; Zhang, Lijun; He, Xiaofei IEEE Transactions on Knowledge and Data Engineering, Vol. 27, Issue 4 https://doi.org/10.1109/TKDE.2014.2356461	journal	April 2015
Social Recommendation with Cross-Domain Transferable Knowledge Jiang, Meng; Cui, Peng; Chen, Xumin IEEE Transactions on Knowledge and Data Engineering, Vol. 27, Issue 11 https://doi.org/10.1109/TKDE.2015.2432811	journal	November 2015
Topic-Level Expert Modeling in Community Question Answering Zhao, Tong; Bian, Naiwen; Li, Chunping Proceedings of the 2013 SIAM International Conference on Data Mining https://doi.org/10.1137/1.9781611972832.86	conference	December 2013
Expertise networks in online communities: structure and algorithms Zhang, Jun; Ackerman, Mark S.; Adamic, Lada Proceedings of the 16th international conference on World Wide Web - WWW '07 https://doi.org/10.1145/1242572.1242603	conference	January 2007
Identifying authoritative actors in question-answering forums: the case of Yahoo! answers Bouguessa, Mohamed; Dumoulin, Benoît; Wang, Shengrui Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD 08 https://doi.org/10.1145/1401890.1401994	conference	January 2008
Tapping on the potential of q&a community by recommending answer providers Guo, Jinwen; Xu, Shengliang; Bao, Shenghua Proceeding of the 17th ACM conference on Information and knowledge mining - CIKM '08 https://doi.org/10.1145/1458082.1458204	conference	January 2008
The anatomy of a large-scale social search engine Horowitz, Damon; Kamvar, Sepandar D. Proceedings of the 19th international conference on World wide web - WWW '10 https://doi.org/10.1145/1772690.1772735	conference	January 2010
Routing questions to appropriate answerers in community question answering services Li, Baichuan; King, Irwin Proceedings of the 19th ACM international conference on Information and knowledge management - CIKM '10 https://doi.org/10.1145/1871437.1871678	conference	January 2010
Competition-based user expertise score estimation Liu, Jing; Song, Young-In; Lin, Chin-Yew Proceedings of the 34th international ACM SIGIR conference on Research and development in Information - SIGIR '11 https://doi.org/10.1145/2009916.2009975	conference	January 2011
I want to answer; who has a question? Dror, Gideon; Koren, Yehuda; Maarek, Yoelle Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining https://doi.org/10.1145/2020408.2020582	conference	August 2011
Question routing in community question answering: putting category in its place Li, Baichuan; King, Irwin; Lyu, Michael R. Proceedings of the 20th ACM international conference on Information and knowledge management - CIKM '11 https://doi.org/10.1145/2063576.2063885	conference	January 2011
Towards expert finding by leveraging relevant categories in authority ranking Zhu, Hengshu; Cao, Huanhuan; Xiong, Hui Proceedings of the 20th ACM international conference on Information and knowledge management - CIKM '11 https://doi.org/10.1145/2063576.2063931	conference	January 2011
Modeling problem difficulty and expertise in stackoverflow Hanrahan, Benjamin V.; Convertino, Gregorio; Nelson, Les Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion - CSCW '12 https://doi.org/10.1145/2141512.2141550	conference	January 2012
Factorization Machines with libFM Rendle, Steffen ACM Transactions on Intelligent Systems and Technology, Vol. 3, Issue 3 https://doi.org/10.1145/2168752.2168771	journal	May 2012
A classification-based approach to question routing in community question answering Zhou, Tom Chao; Lyu, Michael R.; King, Irwin Proceedings of the 21st international conference companion on World Wide Web - WWW '12 Companion https://doi.org/10.1145/2187980.2188201	conference	January 2012
Discovering value from community activity on focused question answering sites: a case study of stack overflow Anderson, Ashton; Huttenlocher, Daniel; Kleinberg, Jon Proceedings of the 18th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '12 https://doi.org/10.1145/2339530.2339665	conference	January 2012
Dual role model for question recommendation in community question answering Xu, Fei; Ji, Zongcheng; Wang, Bin Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '12 https://doi.org/10.1145/2348283.2348387	conference	January 2012
Adapting vector space model to ranking-based collaborative filtering Wang, Shuaiqiang; Sun, Jiankai; Gao, Byron J. Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12 https://doi.org/10.1145/2396761.2398458	conference	January 2012
Topic-sensitive probabilistic model for expert finding in question answer communities Zhou, Guangyou; Lai, Siwei; Liu, Kang Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12 https://doi.org/10.1145/2396761.2398493	conference	January 2012
Learning to rank for hybrid recommendation Sun, Jiankai; Wang, Shuaiqiang; Gao, Byron J. Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12 https://doi.org/10.1145/2396761.2398610	conference	January 2012
Question-answer topic model for question retrieval in community question answering Ji, Zongcheng; Xu, Fei; Wang, Bin Proceedings of the 21st ACM international conference on Information and knowledge management - CIKM '12 https://doi.org/10.1145/2396761.2398669	conference	January 2012
Competition-based networks for expert finding Aslay, Çiğdem; O'Hare, Neil; Aiello, Luca Maria Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval - SIGIR '13 https://doi.org/10.1145/2484028.2484183	conference	January 2013
Ad click prediction: a view from the trenches McMahan, H. Brendan; Golovin, Daniel; Chikkerur, Sharat Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining - KDD '13 https://doi.org/10.1145/2487575.2488200	conference	January 2013
When relevance is not enough: promoting diversity and freshness in personalized question recommendation Szpektor, Idan; Maarek, Yoelle; Pelleg, Dan Proceedings of the 22nd international conference on World Wide Web - WWW '13 https://doi.org/10.1145/2488388.2488497	conference	January 2013
CQArank: jointly model topics and expertise in community question answering Yang, Liu; Qiu, Minghui; Gottipati, Swapna Proceedings of the 22nd ACM international conference on Conference on information & knowledge management - CIKM '13 https://doi.org/10.1145/2505515.2505720	conference	January 2013
SocialTransfer: Transferring Social Knowledge for Cold-Start Cowdsourcing Zhao, Zhou; Cheng, James; Wei, Furu Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management - CIKM '14 https://doi.org/10.1145/2661829.2661871	conference	January 2014
Mining Shapes of Expertise in Online Social Q&A Communities Kumar, Varun; Pedanekar, Niranjan E. Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion - CSCW '16 Companion https://doi.org/10.1145/2818052.2869096	conference	January 2016
A Comprehensive Survey and Classification of Approaches for Community Question Answering Srba, Ivan; Bielikova, Maria ACM Transactions on the Web, Vol. 10, Issue 3 https://doi.org/10.1145/2934687	journal	August 2016
node2vec: Scalable Feature Learning for Networks Grover, Aditya; Leskovec, Jure Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining - KDD '16 https://doi.org/10.1145/2939672.2939754	conference	January 2016
Summarizing Answers in Non-Factoid Community Question-Answering Song, Hongya; Ren, Zhaochun; Liang, Shangsong Proceedings of the Tenth ACM International Conference on Web Search and Data Mining - WSDM '17 https://doi.org/10.1145/3018661.3018704	conference	January 2017
Learning to Recommend Accurate and Diverse Items Cheng, Peizhe; Wang, Shuaiqiang; Ma, Jun Proceedings of the 26th International Conference on World Wide Web - WWW '17 https://doi.org/10.1145/3038912.3052585	conference	January 2017
Breaking Cycles In Noisy Hierarchies Sun, Jiankai; Ajwani, Deepak; Nicholson, Patrick K. Proceedings of the 2017 ACM on Web Science Conference - WebSci '17 https://doi.org/10.1145/3091478.3091495	conference	January 2017
A Data-Driven Approach to Question Subjectivity Identification in Community Question Answering Zhou, Tom Chao; Si, Xiance; Chang, Edward Y. Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 26, Issue 1 https://doi.org/10.1609/aaai.v26i1.8111	journal	September 2021
Learning to Rank Effective Paraphrases from Query Logs for Community Question Answering Figueroa, Alejandro; Neumann, Guenter Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 27, Issue 1 https://doi.org/10.1609/aaai.v27i1.8453	journal	June 2013
Question/Answer Matching for CQA System via Combining Lexical and Sequential Information Shen, Yikang; Rong, Wenge; Sun, Zhiwei Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 29, Issue 1 https://doi.org/10.1609/aaai.v29i1.9178	journal	February 2015
Learning Entity and Relation Embeddings for Knowledge Graph Completion Lin, Yankai; Liu, Zhiyuan; Sun, Maosong Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 29, Issue 1 https://doi.org/10.1609/aaai.v29i1.9491	journal	February 2015
Community-Based Question Answering via Heterogeneous Social Network Learning Fang, Hanyin; Wu, Fei; Zhao, Zhou Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 30, Issue 1 https://doi.org/10.1609/aaai.v30i1.9972	journal	February 2016
Community-Based Question Answering via Asymmetric Multi-Faceted Ranking Network Learning Zhao, Zhou; Lu, Hanqing; Zheng, Vincent Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 31, Issue 1 https://doi.org/10.1609/aaai.v31i1.10999	journal	February 2017
Labeled LDA: a supervised topic model for credit attribution in multi-labeled corpora Ramage, Daniel; Hall, David; Nallapati, Ramesh Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing Volume 1 - EMNLP '09 https://doi.org/10.3115/1699510.1699543	conference	January 2009
A Regularized Competition Model for Question Difficulty Estimation in Community Question Answering Services Wang, Quan; Liu, Jing; Wang, Bin Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP) https://doi.org/10.3115/v1/D14-1118	conference	January 2014

Similar Records

CHQ- SocioEmo: Identifying Social and Emotional Support Needs in Consumer-Health Questions

Journal Article · 2023 · Scientific Data · OSTI ID:2425611

Alasmari, Ashwag; Kudryashov, Luke; Yadav, Shweta; +2 more

An approach for collaborative development of a federated biomedical knowledge graph-based question-answering system: Question-of-the-Month challenges

Journal Article · 2023 · Journal of Clinical and Translational Science · OSTI ID:2283388

Fecho, Karamarie; Bizon, Chris; Issabekova, Tursynay; +39 more

Routing of ultrahazardous materials - More questions than answers

Conference · 1987 · Nucl. Mater. Manage. Annu. Meet. Proc.; (United States) · OSTI ID:6241472

Rhyne, W R

Related Subjects

96 KNOWLEDGE MANAGEMENT AND PRESERVATION
Cold-start problem
Expert finding
Question answering services
Question routing

Title: ColdRoute: effective routing of cold questions in stack exchange sites

Citation Formats

References (47)

Similar Records

Related Subjects