Open Access iconOpen Access



ResNet CNN with LSTM Based Tamil Text Detection from Video Frames

I. Muthumani1,*, N. Malmurugan2, L. Ganesan3

1 Department of Electronics & Communication Engineering, Government College of Engineering, Thanjavur, 613402, India
2 Department of Electronics & Communication Engineering, Mahendra College of Engineering, Salem, 636106, India
3 Department of Computer Science & Engineering, AC Govt. College of Engineering & Technology, Karaikudi, 630004, India

* Corresponding Author: I. Muthumani. Email: email

Intelligent Automation & Soft Computing 2022, 31(2), 917-928.


Text content in videos includes applications such as library video retrievals, live-streaming advertisements, opinion mining, and video synthesis. The key components of such systems include video text detection and acknowledgments. This paper provides a framework to detect and accept text video frames, aiming specifically at the cursive script of Tamil text. The model consists of a text detector, script identifier, and text recognizer. The identification in video frames of textual regions is performed using deep neural networks as object detectors. Textual script content is associated with convolutional neural networks (CNNs) and recognized by combining ResNet CNNs with long short-term memory (LSTM) networks. A residual mapping underlies the network. In ResNet, skipping condenses the network into few layers to help it learn more quickly. Bidirectional LSTM enables networks to always have information about the sequence, backward as well as forward. For fast pattern learning processes, this combination uses the residual learning process. In comparison to the existing approaches, the proposed approach’s results show improved accuracy, precision and F-measures. The combination of ResNet CNNs and bidirectional LSTMs has high recognition rates for detecting video texts in Tamil cursive script.


Cite This Article

APA Style
Muthumani, I., Malmurugan, N., Ganesan, L. (2022). Resnet CNN with LSTM based tamil text detection from video frames. Intelligent Automation & Soft Computing, 31(2), 917-928.
Vancouver Style
Muthumani I, Malmurugan N, Ganesan L. Resnet CNN with LSTM based tamil text detection from video frames. Intell Automat Soft Comput . 2022;31(2):917-928
IEEE Style
I. Muthumani, N. Malmurugan, and L. Ganesan "ResNet CNN with LSTM Based Tamil Text Detection from Video Frames," Intell. Automat. Soft Comput. , vol. 31, no. 2, pp. 917-928. 2022.


cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 2055


  • 1195


  • 1


Share Link