Prioritization of the Factors Affecting the Use of Query Suggestions through the Fuzzy Analytical Hierarchy Process

Document Type : Original Article

Authors

1 Abadan university of medical sciences, Abadan, Iran

2 Department of Knowledge and Information Science, Faculty of Education and Psychology, University of Isfahan, Iran

3 Department of Knowledge and Information Science, Faculty of Education and Psychology, University of Isfahan, Iran,

Abstract

Objective: Query suggestions are a supporting tool in information search tools that help users query formulation. The purpose of this study was to prioritize the factors affecting the use of query suggestions through the Fuzzy Analytical Hierarchy Process (FAHP).
Methodology: This study is an applied quantitative research that used a researcher-made questionnaire as instrument to collect the data. Five experts in data retrieval were asked to consider its items and comment on their relevance to the topic under study to ensure the validity of the questionnaire. The inconsistency rate was also used to verify the reliability of the questionnaire items. The questionnaire was distributed to 12 experts to gather the data for this study. To analyze the data, the FAHP was used in which the experts compared the pair of the main criteria, the sub-criteria of each criterion, and the final priority of the sub-criteria.
Findings: In this study, the criteria were classified into two categories: criteria related to the query suggestions system and criteria related to the user. Among the criteria related to the user criteria of domain knowledge and expertise, level of linguistic knowledge, and user’s query and among the criteria related to the query suggestions system the criteria of "source of creation of query suggestions (main and contextual), semantic features of query suggestions, and ease of use of query suggestions were the first to third priorities. Moreover, based on the final weight of each sub-criterion, the sub-criterion ‘the level of user’s expertise in the field of search’ was placed in the first priority; while ‘the difference between the user’s original language and the search information’ received the second priority; ’source of creation of query suggestions’ was in the third place; ‘providing semantic correlation between user’s queries and the query suggestions including broad, specific, related, and synonyms’ was placed in the fourth priority, and Providing a list of query suggestions in order of relevance placed in the fifth priority,  respectively.
Conclusion: The results of this study showed that ‘source of creation query suggestions’ and ‘domain knowledge and expertise’ was ranked first in prioritizing the main criteria. This finding suggests that the designers of the query suggestions should make a good choice of sources. Besides, prioritizing the factors affecting the use of query suggestions provides valuable information to designers and researchers in query suggestions. They can identify essential factors by prioritizing the factors affecting query suggestions and applying them in practice. Though the factors influencing the use of question suggestions are prioritized in this study, all factors are, in turn, important and should be considered when creating a question proposal to make high-quality suggestions.

Keywords


آذرگون، مریم؛ شعبانی، احمد؛ چشمه سهرابی، مظفر؛ عاصمی، عاصفه (1398). عوامل مؤثر بر استفاده از پیشنهاد پرسش: ارائه مدل تأثیر و تأثر با رویکرد مدل­سازی ساختاری تفسیری. مطالعات ملی کتابداری و سازماندهی اطلاعات، 30(3)، 94-116.
احسان­فر، محمدحسین؛ اثنی عشری امیری، ابوالقاسم؛ مطیعی، رضا (1396). رتبه­‌بندی عوامل کلیدی مؤثر بر به کارگیری نظام آموزشی در ترویج آموزه­‌های اقتصاد اسلامی در ایران. اقتصاد و بانکداری اسلامی، 6(18)، 61-82.
حبیبی، آرش؛ ایزدیار، صدیقه؛ سرافرازی، اعظم (1393). تصمیم‌­گیری چندمعیاره فازی. رشت: انتشارات کتیبه گیل.
حیاتی، زهیر؛ طاهریان، آمنه سادات (1388). بررسی مقایسه‌ای الگوی جستجوی کلیدواژه‌ای با دریافت کمک و الگوی جستجوی بدون دریافت کمک در موتور کاوش گوگل از دیدگاه کاربران. مطالعات تربیتی و روان‌شناسی دانشگاه فردوسی مشهد، 10(2)، 112-91.
خسروی، عبدالرسول؛ فتاحی، رحمت‌الله؛ پریرخ، مهری؛ دیانی، محمدحسین (1392). بررسی کارآمدی کلیدواژه‌ها و عبارت‌های پیشنهادی موتور کاوش گوگل در بسط جستجو و افزایش ربط از دیدگاه دانشجویان تحصیلات تکمیلی. پژوهش‌نامه کتابداری و اطلاع‌رسانی، 3(1)، 133-150.
دلبری، سید علی؛ داودی سید علیرضا (1391). کاربرد تکنیک فرایند تلیل سلسله مراتبی (AHP) در رتبه‌­بندی شاخص‌­های ارزیابی جاذبه‌­های توریستی. تحقیق در عملیات و کاربردهای آن، 9(2)، 57-79.
شعبانی، احمد؛ آذرگون، مریم؛ چشمه سهرابی، مظفر؛ عاصمی، عاصفه (1398). شناسایی بافت­‌های مؤثر در ایجاد پیشنهادهای پرسش: مرور نظام‌مند. پردازش و مدیریت اطلاعات، 35(1)، 141-172.
References
Azargoon, M., Shabani, A., Cheshmehsohrabi, M., & Asemi, A. (2019). Factors affecting the use of Query suggestion systems: proposing a model based on Interpretive Structural Modelling Approach. Journal of National Studies on Librarianship and Information Organization, 30(3), 94-116. (in Persian)
Azargoon, M., Shabani, A., Cheshmehsohrabi, M., & Asemi, A. (2019). Identification of effective factors on the use of “query suggestions” through Fuzzy Delfi method. Library Philosophy and practice journal (e-journal). Retrieval from https://digitalcommons.unl.edu/libphilprac/2259/
Cai, F., Liang, S., & de Rijke, M. (2014). Time-sensitive personalized query uto-completion. In Proceedings of the 23th ACM International Conference on Information and Knowledge Management (1599-1608). New York: ACM.  
Chang, D. Y. (1996). Theory abd methodology application of the extent analysis method on fuzzy AHP. European journal of operational research, 95, 649-655.
Chen, H., Cai, F., & De Rijke, M. (2018). Attention-based hierarchical neural query suggestion. In Proceedings of the 41th Intrnational ACM SIGIR Conference on Research and Development in Information Retrieval (1093-1096). New York: ACM.
Delbari, S. A., & Davoodi, S. A. (2012). Application of Analytic Hierarchy Process (AHP) technique in ranking tourist attraction evaluation indicators. Journal of Operational Research in Its Applications, 2(9), 57-79. (in Persian)
Ehsanafar, M. H., Esna Ashari, A., & Motii, R. (2017). Ranking of key factors affecting the use of the educational system in promoting Islamic economic teachings in Iran. Islamic Economics & Banking, 6(18), 61-82. (in Persian)
Fattahi, R., Parirokh, M., Dayyani, M. H., Khosravi, A., & Zareivenovel, M. (2016). Effectiveness of Google keyword suggestion on user’s relevance judgment. The Electronic Library, 34(2), 302-314. Retrieved From https://www.emerald.com/insight/content/doi/10.1108/EL-03-2015-0035-fa.pdf.
Gogus, O., & Boucher, T. O. (1998). Strong transitivity, rationality and weak monotonicity in fuzzy pairwise comparison. Fuzzy sets and systems, 94(1), 133-144.
Habibi, A., Izadiar, S., & Sarafrazi, A. (2014).  Fuzzy Multi Criteria Decision Making. Rasht: Katibeye Gil. (in Persian).
Hayati, Z., & Taherian, A. S. (2009). Comparative survey of keyword search pattern with help and search pattern without help in Google search engine from users' point of view. Educational and Psychological Studies of Ferdowsi University of Mashhad, 10(2), 91-111. (in Persian)
Hu, S., Xiao, C., & Ishikawa, Y. (2018). An efficient algorithm for location-aware query autocompletion. IEICE Transactions Information and Systems, 101(1), 181-192. https://doi.org/10.1587/transinf.2017EDP7152
Jansen, B. J., Spink, A., & Saracevic, T. (2000). Real life, real users, and real needs: a study and analysis of user queries on the web. Information Processing and Management, 36(2), 207-227. https://doi.org/10.1016/S0306-4573(99)00056-4
Joho, H., Coverson, C., Sanderson, M., & Beaulieu, M. (2002). Hierarchical presentation of expansion terms. In proceeding of 2th ACM Symposium on Applied Computing (645-649). New York: ACM. https://doi.org/10.1145/508791.508916
Kato, M. P., Sakai, T., & Tanaka, K. (2012). Structured query suggestion for specialization and parallel movement: Effect on search behaviors. In Proceedings of the 21th International Conference on World Wide Web (389-398), New York: ACM. https://doi.org/10.1145/2187836.2187890
Kato, M. P., Sakai, T., & Tanaka, K. (2013). When do people use query suggestion? A query suggestion log analysis. Information Retrieval, 16(6), 725-746.
Kelly, D., Cushing, M. D., Niu, V., & Gyllstrom, K. (2010). Effect of popularity and quality on the usage of query suggestion during information search. In Proceeding of the 28th ACM Conference on Huma`n Factors in Computing Systems (45-54). New York: ACM. https://doi.org/10.1145/1753326.1753334.
Khosravi, A., Fattahi, R., Parirokh, M., & Dayyani, M. H. (2013). Survey of effectiveness of suggested phrases and keywords by Google search engine in search expansion and relevance increase from point of view graduate students. Journal of Library and Information Science, 3(1), 133-150. (in Persian)
Koshman, S., Spink, A., & Jensen, J. (2006). Web search on the Vivisimo search engine. Journal of the American Society for Information Science and Technolog, 57(14),1875-1887. https://doi.org/10.1145/1753326.1753334.
Liu, Y., Song, R., Chen, Y., Nie, J. Y., & Wen, J. R. (2012). Adaptive query suggestion for difficult queries”. In SIGIR '12 Proceedings of the 35th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (15-24), New York: ACM. https://doi.org/10.1145/2348283.2348289.
Liu, Y., Eckert, C., & Earl, C. (2020). A review of fuzzy AHP methods for decision-making with subjective judgements. Expert Systems with Applications, 161. https://doi.org/10.1016/j.eswa.2020.113738.
Niu, X., & Kelly, D. (2014). Use of query suggestions during information search. Information Processing and Management, 50(1), 218-234. https://doi.org/10.1016/j.ipm.2013.09.002.
Parikh, N., Singh, G., & Sundaresan, N. (2013). Query suggestion with large scale data. Handbook of Statistics, 31, 493-518. Retrieved from file:///C:/Users/AS/AppData/Local/Temp/IranDoc-v35n1p141-fa.pdf.
Putra, M. S. D., Andryana, S. F., & Gunaryati, A. (2018). Fuzzy analytical hierarchy process method to determine the quality of gemstones. Advances in fuzzy systems, 1-6. https://doi.org/10.1155/2018/9094380.
Shabani, A., Azargoon, M., Cheshmesohrabi, M., & Asemi, A. (2019). Identification of effective contexts in creation of query suggestions: A systematic review. Iranian Journal of Information Processing and Management, 35(1), 141-172. (in Persian).
Shokouhi, M. (2013). Learning to personalize query auto-completion. In Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval (103-112). New York: ACM. https://doi.org/10.1145/2484028.2484076.
Tahery, S., & Farzi, S. (2020). Customized query quto-completion suggestion-A review. Information Systems, 87, 1-18. https://doi.org/10.1016/j.is.2019.101415.
Ward, D., Hahn, J., & Feist, K. (2012). Autocomplete as research tool: A study on providing search suggestion. Information Technology and Libraries, 31(4), 6-19. https://doi.org/10.6017/ital.v31i4.1930.
Whiting, S., McMinn, J., & Jose, J. M. (2013). Exploring real-time temporal query auto-completion. In the 13th Dutch-Belgian Workshop on Information Retrieval (12-15). Retrieved from http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.310.385.
Zhang, X., & Peng, L. (2018). Time-aware diversified queyr suggestion. In Proceedings of the 18th ACM/IEEE on joint Conference on Digital Libraries (399-400). New York: ACM. https://doi.org/10.1145/3197026.3203901.
Zhang, X., Jiang, X., & Qin, J. (2020). Time-aware query suggestion diversification for temporally ambiguous queries. Electronic Library, 38(4), 725-744. https://doi.org/10.1108/EL-12-2019-0296.