NLP with Deep Learning Approaches in Text Generation

Abstract

Text generation is the process of automatically producing coherent and meaningful text, which can be in the form of sentences, paragraphs or even entire documents. It involves various techniques, which can be found under the field such as Natural Language Processing (NLP) and deep learning algorithms, to analyze input data and generate human-like text. The goal is to create text that is not only grammatically correct but also contextually appropriate and engaging for the intended audience. In advance we want to focus on text summarization because for generating text includes correct formation of sentence and reduce the user difficulty. Here we use deep learning techniques like Recurrent neural network (RNN), Generative pre-trained transformer (GPT), Bi-directional encoder representations from transformers (BERT). Text summarization models often face challenges such as lack of precision, vocabulary limitations, incorrect sentences, and false information.

Country : India

1 M.Sharmila Devi2 V.Samatha3 V.Naga Lavanya4 V.Srividya5 M.Rehana6 K.Anusha

  1. Assistant Professor, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India
  2. Student, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India
  3. Student, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India
  4. Student, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India
  5. Student, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India
  6. Student, Department of Computer Science & Engineering, Santhiram Engineering College, Nandyal, A.P, India

IRJIET, Volume 9, Special Issue of INSPIRE’25 April 2025 pp. 159-163

doi.org/10.47001/IRJIET/2025.INSPIRE26

References

  1. Devi, M. S. Poojitha, M. Sucharitha, R.Keerthi , K..Manideepika, P.,& Vasudha, C. (2023). Extracting and Analyzing Features in Natural Language Processing for Deep Learning with English Language. Journal of Research Publication and Reviews, 4(4), 497-502.
  2. Devi,S M. S., Mahammad, F. S., Bhavana, D., Sukanya, D., Thanusha, T. S., Chandrakala, M., & Swathi, P. V. (2022).” Machine Learning Based Classification and Clustering Analysis of Efficiency of Exercise against Covid-19 Infection.” Journal of Algebraic Statistics, 13(3), 112- 117.
  3. Devi, M. M. S., & Gangadhar, M. Y. (2012).” A comparative Study of Classification Algorithm for Printed Telugu Character Recognition.” International Journal of Electronics Communication and Computer Engineering, 3(3), 633-641.
  4. Devi, M. S., Meghana, A. I., Susmitha, M., Mounika, G., Vineela, G., & Padmavathi, M. MISSING CHILD IDENTIFICATION SYSTEM USING DEEP LEARNING.
  5. Y. Zhang, Z. Gan, K. Fan, Z. Chen, R. Henao, D. Shen, and L. Carin,“Adversarial feature matching for text generation,” Proceedings of International Conference on Machine Learning, pp. 4006-4015.
  6. R. Paulus, C. Xiong, and R. Socher, “A deep reinforced model for abstractive summarization,” Arxiv Preprint, vol. 17, no. 3, pp. 430-444, 2017.
  7. S. Song, H. Huang, and T. Ruan, “Abstractive text summarization using LSTM-CNN based deep learning,” Multimedia Tools and Applications, vol. 78, no. 1, pp. 857-875, 2019.
  8. W. Kryscinski, R. Paulus, C. Xiong, and R. Socher, “Improving abstraction in text summarization,” Arxiv Preprint, vol. 8, no. 2, 791-799, 2018.2017.2015.
  9. S. Bengio, O. Vinyals, N. Jaitly, N. Shazeer, “Scheduled sampling for sequence prediction with recurrent neural networks,” Advances in Neural Information Processing Systems, vol. 28, no. 2, pp. 657- 667.
  10. S. Song, H. Huang, and T. Ruan, “Abstractive text summarization Using LSTM-CNN based deep learning,” Multimedia Tools and Applications, vol. 78, no. 1, pp. 857-875, 2019.