CFP last date
20 January 2025
Reseach Article

Summa: A Text Summarizer using LSTM based Encoder - Decoder Architecture with Attention Mechanism

by Digvijay S. Patil, Rahul M. Samant, Abhin A. Shetty, Danish S. Shaikh, Shrinath G. Gutte
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 185 - Number 15
Year of Publication: 2023
Authors: Digvijay S. Patil, Rahul M. Samant, Abhin A. Shetty, Danish S. Shaikh, Shrinath G. Gutte
10.5120/ijca2023922837

Digvijay S. Patil, Rahul M. Samant, Abhin A. Shetty, Danish S. Shaikh, Shrinath G. Gutte . Summa: A Text Summarizer using LSTM based Encoder - Decoder Architecture with Attention Mechanism. International Journal of Computer Applications. 185, 15 ( Jun 2023), 1-6. DOI=10.5120/ijca2023922837

@article{ 10.5120/ijca2023922837,
author = { Digvijay S. Patil, Rahul M. Samant, Abhin A. Shetty, Danish S. Shaikh, Shrinath G. Gutte },
title = { Summa: A Text Summarizer using LSTM based Encoder - Decoder Architecture with Attention Mechanism },
journal = { International Journal of Computer Applications },
issue_date = { Jun 2023 },
volume = { 185 },
number = { 15 },
month = { Jun },
year = { 2023 },
issn = { 0975-8887 },
pages = { 1-6 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume185/number15/32769-2023922837/ },
doi = { 10.5120/ijca2023922837 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-07T01:26:07.331198+05:30
%A Digvijay S. Patil
%A Rahul M. Samant
%A Abhin A. Shetty
%A Danish S. Shaikh
%A Shrinath G. Gutte
%T Summa: A Text Summarizer using LSTM based Encoder - Decoder Architecture with Attention Mechanism
%J International Journal of Computer Applications
%@ 0975-8887
%V 185
%N 15
%P 1-6
%D 2023
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Due to the exponential growth of online textual data, and rapid expansion of internet usage, tasks such as document management, text classification, and information retrieval have been significantly posing a challenge due to its huge size. A key tool for addressing this issue is Automatic Text Summarization (ATS). It is one of the most challenging tasks since there is no precise computational method for evaluating accuracy of a summary.[1] The main function of ATS is to automatically create a concise and apprehensive summary by extracting the main ideas from the source text. Models for abstractive summarization based on deep learning (DL) have recently been created to better balance and improve these two elements. The field of DL-based text summarization currently lacks a thorough literature review, nevertheless. This work offers researchers a thorough analysis of DL-based text summarization in order to close this gap. In this paper, many prevalent frameworks for text summarization are listed. We also propose Summa - an Abstractive text summarizer which uses Long Short Term Memory(LSTM) based Sequence to Sequence Model. Accuracy matrix or F1 score are not recommended, traditional evaluation measures for text summarisation are not that much relevant so, a novel measure, Bi-Lingual Evaluation Understudy(BLEU)[2] measure is used. The study reported the BLEU score of 0.71, with attention mechanism and 0.3, without Attention Mechanism, which is considered a good score.

References
  1. Papineni, K.; Roukos, S.; Ward, T.; Zhu, W. J. (2002). BLEU: a method for automatic evaluation of machine translation (PDF). ACL-2002: 40th Annual meeting of the Association for Computational Linguistics. pp. 311–318
  2. BLEU. In Wikipedia. https://en.wikipedia.org/wiki/BLEU
  3. From Extractive to Abstractive Summarization: A Journey, by Parth Mehta, Prasenjeet Mujumde
  4. Yan Du, Hua Huo* "News Text Summarization Based on Multi-Feature and Fuzzy Logic", 2020, IEEE
  5. Amir Shahab Shahabi, Mohammad Reza Kangavari, Amir Masoud Rahmani. “ A Method for Multi-text Summarization Based on Multi-objective Optimization use Imperialist Competitive Algorithm” March 2022
  6. Muhammad Afzal, Fakhare Alam, Khalid Mahmood Malik, Ghaus M Malik, "Clinical Context–Aware Biomedical Text Summarization Using Deep Neural Network: Model Development and Validation" 2020 JMIR
  7. Zhixin Li, Zhi Peng, Suqin Tang, Canlong Zhang, Huifang Ma"Text Summarization Method Based on Double Attention Pointer Network" 2022
  8. Jingjing Cheng, Fucheng Yu. “Text summarization Generation Based On semantic similarity” 2021
  9. Hikmat A. M. Abdeljaber, Sultan Ahmad, Abdullah Alharbi, and Sudhir Kumar  “XAI-Based Reinforcement Learning Approach for Text Summarization of Social IoT-Based Content” 2022
  10. Kasimahanthi Divya, Kambala Sneha, Bassetti Sowmya, G Sankara Rao, "Text Summarization using Deep Learning"2020, IRJET(ISSN: 2395-0056)
  11. Liyan Tang, Zifan Xu, "GOLD-FACTUAL: Learning to Generate Faithful Summaries from models Generations" 2021
  12. Devi Fitrianah, Raihan Nugroho Jauhari, "Extractive text summarization for scientific journal articles using long short-term memory and gated recurrent units" 2022 (ISSN: 2302-9285)
  13. Youngji Koh, Sungwon Kang, Seonah Lee. “Bug Report Summarization using Believability Score and Text Ranking” 2021
  14. SAMIRA GHODRATNAMA, AMIN BEHESHTI, MEHRDAD ZAKERSHAHRAK, AND FARIBORZ SOBHANMANESH “Extractive Document Summarization Based on Dynamic Feature Space Mapping” 2020
  15. HEEWON JANG AND WOOJU KIM “Reinforced Abstractive Text Summarization With Semantic Added Reward” 2021
  16. ISKANDER AKHMETOV, ALEXANDER GELBUKH, AND RUSTAM MUSSABAYEV  “Greedy Optimization Method for Extractive Summarization of Scientific Articles”  2021
  17. JIANLI DING, YANG LI, HUIYU NI, AND ZHENGQUAN YANG “Generative Text Summary Based on Enhanced Semantic Attention and Gain-Benefit Gate” 2020
  18. Nikhil S. Shirwandkar,  Samidha Kulkarni  “Extractive Text Summarization using Deep Learning” 2020
  19. Architecture of LSTM [Image]. Retrieved from https://raw.githubusercontent.com/d2l-ai/d2l-en/master/img/ls
Index Terms

Computer Science
Information Sciences

Keywords

Extractive Abstractive Long Short Term Memory( Stacked LSTM) Attention BLEU.