CFP last date
20 August 2024
Reseach Article

Using Knowledge Graphs and LLMs to Enhance Natural Language Understanding on Voice Assistants

by Ashlesha Vishnu Kadam
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 185 - Number 27
Year of Publication: 2023
Authors: Ashlesha Vishnu Kadam
10.5120/ijca2023923019

Ashlesha Vishnu Kadam . Using Knowledge Graphs and LLMs to Enhance Natural Language Understanding on Voice Assistants. International Journal of Computer Applications. 185, 27 ( Aug 2023), 20-24. DOI=10.5120/ijca2023923019

@article{ 10.5120/ijca2023923019,
author = { Ashlesha Vishnu Kadam },
title = { Using Knowledge Graphs and LLMs to Enhance Natural Language Understanding on Voice Assistants },
journal = { International Journal of Computer Applications },
issue_date = { Aug 2023 },
volume = { 185 },
number = { 27 },
month = { Aug },
year = { 2023 },
issn = { 0975-8887 },
pages = { 20-24 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume185/number27/32860-2023923019/ },
doi = { 10.5120/ijca2023923019 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T01:27:11.445562+05:30
%A Ashlesha Vishnu Kadam
%T Using Knowledge Graphs and LLMs to Enhance Natural Language Understanding on Voice Assistants
%J International Journal of Computer Applications
%@ 0975-8887
%V 185
%N 27
%P 20-24
%D 2023
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Both, Large Language Models (LLMs) and Knowledge Graphs (KGs) are used in various Natural Language Understanding (NLU) tasks. However, each has some benefits and disadvantages. This paper explores the pros and cons of each, and demonstrates how the two used together can help overcome some of the shortcomings. It also identifies specific applications of KG-enhanced LLMs for music-related user experiences on voice assistants. Finally, it enlists the challenges in KG-enhanced LLM applications.

References
  1. Roberto Navigli, Natural Language Understanding: Instructions for (Present and Future) Use, Proceedings of the Twenty Seventh International Joint Conference on Artificial Intelligence (IJCAI-18)
  2. A Lenci - arXiv preprint arXiv:2303.04229, 2023 - arxiv.org
  3. Manaal Faruqui, Dilek Hakkani-Tür, Revisiting the Boundary between ASR and NLU in the Age of Conversational Dialog Systems, Computational Linguistics (2022) 48 (1): 221–232.
  4. Samuel R. Bowman, George E. Dahl, What Will it Take to Fix Benchmarking in Natural Language Understanding?
  5. Amit Singhal. 2012. Introducing the Knowledge Graph: things, not strings. Google Blog. https://www.blog.google/products/search/introducing-knowledge-graph-things-not/
  6. Aidan Hogan, Eva Blomqvist, Michael Cochez, et all. Knowledge Graphs, arXiv:2003.02320
  7. Shaoxiong Ji, Shirui Pan, Erik Cambria, Pekka Marttinen, Philip S. Yu, A Survey on Knowledge Graphs: Representation, Acquisition and Applications. IEEE TNNLS 2021.
  8. Zhao, W. X. et al. (2023, March 31). A Survey of Large Language Models, https://doi.org/10.48550/arXiv.2303.18223
  9. Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed Representations of Words and Phrases and their Compositionality. Advances in Neural Information Processing Systems, 26. https://doi.org/10.48550/arXiv.1310.4546
  10. https://snorkel.ai/large-language-models-llms/
  11. https://www.tasq.ai/blog/large-language-models/
  12. https://www.boost.ai/blog/a-hybrid-llm-chat-experience
  13. https://machinelearningmastery.com/a-gentle-introduction-to-hallucinations-in-large-language-models/
  14. https://spectrum.ieee.org/ai-hallucination
  15. Furkan Ufuk, The Role and Limitations of Large Language Models Such as ChatGPT in Clinical Settings and Medical Journalism, https://doi.org/10.1148/radiol.230276
  16. https://towardsdatascience.com/overcoming-the-limitations-of-large-language-models-9d4e92ad9823
  17. Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Daniel Y. Fu, Zhiqiang Xie, Beidi Chen, Clark Barrett, Joseph E. Gonzalez, Percy Liang, Christopher Re´, Ion Stoica, Ce Zhang, FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU, arXiv:2303.06865v2 [cs.LG] 12 Jun 2023
  18. https://engineb.com/2021/02/8-key-benefits-of-knowledge-graphs/
  19. Ciyuan Peng, Feng Xia, Mehdi Naseriparsa, and Francesco Osborne, Knowledge Graphs: Opportunities and Challenges, doi: 10.1007/s10462-023-10465-9
  20. Bilal Abu-Salih, Domain-specific Knowledge Graphs: A survey, King Abdullah II School of Information TechnologyThe University of Jordan
  21. Mahfouz, Mahmoud & Nourbakhsh, Armineh & Shah, Sameena. (2021). A Framework for Institutional Risk Identification using Knowledge Graphs and Automated News Profiling.
  22. Corbin L Rosset, Chenyan Xiong, Minh Phan, Xia Song, Paul N. Bennett, Saurabh Tiwary, Pretrain Knowledge-Aware Language Models, ICLR 2021 Conference
  23. Yu, Donghan & Zhu, Chenguang & Yang, Yiming & Zeng, Michael. (2020). JAKET: Joint Pre-training of Knowledge Graph and Language Understanding.
  24. Ashlesha V Kadam, “Applications of AI and NLP to advance Music Recommendations on Voice Assistants”, International Journal of Engineering, Business and Management (IJEBM), ISSN: 2456-7817 [Vol-7, Issue-3, May-Jun, 2023]
  25. Christophe Van Gysel, “Modeling Spoken Information eries for Virtual Assistants”, https://arxiv.org/abs/2304.13149v1
Index Terms

Computer Science
Information Sciences

Keywords

LLMs NLU NLP voice assistants knowledge graphs