Abstract

The huge amount of digital content is being uploaded by users every day, and processing these videos specifically for indexing and retrieval purposes is extremely important. This research is contributing to society by providing a baseline approach for Gujarati news channel video retrieval for regional users. The Gujarati language is spoken by more than 22 million people worldwide. To retrieve these videos correctly, we need to process them frame by frame; hence, shot segmentation is an essential component, followed by keyframe extraction, and, lastly, extracting text features for the retrieval of news videos. A three approaches were developed to detect shot boundaries and identify frames containing meaningful Gujarati text in broadcast news video. The three methods were: (1) An Shot Boundary Detection (SBD) methods based on global threshold (SBD-GT) with 5 distinct frame level features (2) SBD methods employing statistical adaptive thresholding (SBD-AT) with 5 distinct frame level features (3) Development of the proposed Edge Histogram Adaptive Shot Detection (EHASD) system with the fusion of edge and histogram based features. EHASD applied Statistical Edge-Histogram Thresholding (SEHT) together to evaluate edge deviation and histogram difference to improve the detection rate of both abrupt and gradual transitions. The proposed research was evaluated using a TV9 Gujarati news video dataset with 45920 total frames from different categories like weather, Cricket, and politics. The proposed approach, EHASD, achieved a precision of 93.25% and a recall of 92.01%, surpassing the values obtained by the global and adaptive thresholds in SBD approaches. Additionally, the z test & paired t test was also performed on the mean and standard deviation to validate the results of the proposed approach. In addition, the research confirmed that the proposed method can be used further to perform key frame selection followed with text extraction for the video retrieval purpose.

Keywords

Shot Boundary Detection (SBD), Edge Histogram Adaptive Shot Detection (EHASD), Statistical Adaptive Thresholding, Edge Change Ratio and Histogram Difference, Frame-level features,

Downloads

Download data is not yet available.

References

  1. N. Spolaor, H.D. Lee, W.S.R. Takaki, L.A. Ensina, C.S.R. Coy, F.C. Wu, A Systematic Review on Content-Based Video Retrieval. Engineering Applications of Artificial Intelligence, 90, (2020) 103557. https://doi.org/10.1016/j.engappai.2020.103557
  2. Office of the Registrar General and Census Commissioner, India, (2018) Census of India 2011, C-16 Population by Mother Tongue: Distribution of the 22 Scheduled Languages.
  3. A. Bhuva, D. Mishra, Gujarati Optical Character Recognition using Efficient Text Feature Extraction Approaches. Informatica, 49, (2025). https://doi.org/10.31449/inf.v49i28.8341
  4. A. Chabukswar, Deepa Shenoy, Dasharath S.M, Venugopal K.R, Deceptive News Content Detection using a Hybrid Transformer-based and Deep Learning Model with Explainability. International Research Journal of Multidisciplinary Technovation, (2025) 212–234. https://doi.org/10.54392/irjmt25613
  5. B.T. Truong, S. Venkatesh, Video Abstraction: A Systematic Review and Classification. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 3(1), (2007) 3-es. https://doi.org/10.1145/1198302.1198305
  6. Y. Zhai, M. Shah, Visual Attention Detection in Video Sequences using Spatiotemporal Cues. In Proceedings of the 14th ACM International Conference on Multimedia, (2005) 815-824. https://doi.org/10.1145/1180639.1180824
  7. C.B.A. Sai Ram, S. Sharma, Video segmentation: A Systematic Review on Recent Advances, Techniques, and Classification. International Conference on Advances in Computing, Communication Control and Networking (ICACCCN2018), (2018) 615–620, https://doi.org/10.1109/ICACCCN.2018.8748578
  8. T. Kar, P. Kanungo, S.N. Mohanty, S. Groppe, J. Groppe, Video Shot-Boundary Detection: Issues, Challenges and Solutions. Artificial Intelligence Review, 57(4), (2024) 104.https://doi.org/10.1007/s10462-024-10742-1
  9. U. Gargi, R. Kasturi, S. Strayer, Performance Characterization of Video-Shot-Change Detection Methods. IEEE Transactions on Circuits and Systems for Video Technology, 10(1), (2000) 1-13. https://doi.org/10.1109/76.825852
  10. Y. Bendraou, F. Essannouni, D. Aboutajdine, A. Salam, Video Shot Boundary Detection Method using Histogram Differences and Local Image Descriptor. In 2014 Second world conference on complex systems (WCCS) IEEE, Morocco. https://doi.org/10.1109/icocs.2014.7060883
  11. J. Mas, G. Fernandez, (2003). Video Shot Boundary Detection Based on Color Histogram. In TRECVID. https://www-nlpir.nist.gov/projects/tvpubs/tvpapers03/ramonlull.paper.pdf
  12. H. Zhang, A. Kankanhalli, S.W. Smoliar, Automatic Partitioning of Full-Motion Video. Multimedia Systems, 1(1), (1993) 10-28. https://doi.org/10.1007/bf01210504
  13. N. J. Janwe and K. K. Bhoyar, Video Shot Boundary Detection based on JND Color Histogram. IEEE Second International Conference on Image Information Processing (ICIIP), Shimla, India, (2013) pp. 476–480. https://doi.org/10.1109/ICIIP.2013.6707637
  14. A. Adnan, M. Ali, Shot boundary detection using sorted color histogram polynomial curve. Life Science Journal, 10(4), (2013) 1965–1972.
  15. M. Verma, B. Raman, A Hierarchical Shot Boundary Detection Algorithm Using Global and Local Features. In: Raman, B., Kumar, S., Roy, P., Sen, D. (eds) Proceedings of International Conference on Computer Vision and Image Processing. Advances in Intelligent Systems and Computing, Springer, Singapore, 460, (2017). https://doi.org/10.1007/978-981-10-2107-7_35
  16. Y. Tewari, P. Soni, S. Singh, M.S Turlapati, A. Bhuva, Real Time Sign Language Recognition Framework for Two Way Communication. In 2021 International Conference on Communication information and Computing Technology (ICCICT) IEEE, (2021) 1-6. https://doi.org/10.1109/ICCICT50803.2021.9510094
  17. N. Ibrahim, Z. Abduljabbar, Video Shot Boundary Detection based on Frames Objects Comparison and Scale-Invariant Feature Transform Technique. Computer Science and Information Technologies, 5(2), (2024) 130-139. https://doi.org/10.11591/csit.v5i2.p130-139
  18. S. Dhiman, R. Chawla, S. Gupta, A Novel Video Shot Boundary Detection Framework Employing DCT and Pattern Matching. Multimedia Tools and Applications, 78(24), (2019) 34707-34723. https://doi.org/10.1007/s11042-019-08170-3
  19. B.A. Halim, T. Faiza, (2019) Shot Boundary Detection: Fundamental Concepts and Survey. Conference on Innovative Trends in Computer Science.
  20. P.K. Sahoo, S. Soltani, A.K.C. Wong, A Survey of Thresholding Techniques. Computer Vision, Graphics, and Image Processing, 41(2), (1988) 233-260. https://doi.org/10.1016/0734-189x(88)90022-9
  21. S.N. Kumar, V.S.K. Reddy, L.K. Balivada, (2024). Content-based video retrieval using Deep Learning Algorithms. Research square. https://doi.org/10.21203/rs.3.rs-4331245/v1
  22. M.J. Esteve Brotons, F.J. Lucendo, R.J. Javier, J. García-Rodriguez, Shot Boundary Detection with 3D Depthwise Convolutions and Visual Attention. Sensors, 23(16), (2023) 7022. https://doi.org/10.3390/s23167022
  23. T. Soucek, J. Lokoc, TransNet V2: An Effective Deep Network Architecture for Fast Shot Transition Detection. In Proceedings of the 32nd ACM International Conference on Multimedia, (2024) 11218-11221). https://doi.org/10.1145/3664647.3685517
  24. W. Zhu, Y. Huang, X. Xie, W. Liu, J. Deng, D. Zhang, Z. Wang, J. Liu, Autoshot: A Short Video Dataset and State-of-the-Art Shot Boundary Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, (2023) 2238-2247). https://doi.org/10.1109/cvprw59228.2023.00218
  25. S. Tang, L. Feng, Z. Kuang, Y. Chen, W. Zhang, Fast Video Shot Transition Localization with Deep Structured Models. In: Jawahar, C., Li, H., Mori, G., Schindler, K. (eds) Computer Vision – ACCV 2018. ACCV 2018. Lecture Notes in Computer Science, Springer, Cham. (2019) 11361. https://doi.org/10.1007/978-3-030-20887-5_36
  26. J.T. Jose, S. Rajkumar, M.R. Ghalib, A. Shankar, P. Sharma, M.R. Khosravi, Efficient Shot Boundary Detection with Multiple Visual Representations. Mobile Information Systems, 2022(1), (2022) 4195905. https://doi.org/10.1155/2022/4195905
  27. Z. Yang, L. Tian, C. Li, December. A Fast Video Shot Boundary Detection Employing OTSU’s Method and Dual Pauta Criterion. In 2017 IEEE International Symposium on Multimedia (ISM) IEEE, (2017) 583-586. https://doi.org/10.1109/ism.2017.114
  28. W. Tong, L. Song, X. Yang, H. Qu, R. Xie, CNN-based Shot Boundary Detection and Video Annotation. In 2015 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting IEEE, (2015) 1-5. https://doi.org/10.1109/bmsb.2015.7177222
  29. R. Liang, Q. Zhu, H. Wei, S. Liao, A Video Shot Boundary Detection Approach based on CNN Feature. In 2017 IEEE International Symposium on Multimedia (ISM) IEEE, (2017) 89-494). https://doi.org/10.1109/ism.2017.97
  30. R.M. Bommisetty, P. Palanisamy, A. Khare, Content Based Video Retrieval—Methods, Techniques and Applications. In: Dash, S., Pani, S.K., Abraham, A., Liang, Y. (eds) Advanced Soft Computing Techniques in Data Science, IoT and Cloud Computing. Studies in Big Data, Springer, Cham, 89, (2021). https://doi.org/10.1007/978-3-030-75657-4_4
  31. E.M. Saoudi, S. Jai-Andaloussi, A distributed Content-Based Video Retrieval system for large datasets. Journal of Big Data, 8(87), (2021). https://doi.org/10.1186/s40537-021-00479-x
  32. S.H. Abdulhussain, A.R. Ramli, M.I. Saripan, B.M. Mahmmod, S.A.R. Al-Haddad, W.A. Jassim, Methods and Challenges in Shot Boundary Detection: a review. Entropy, 20(4), (2018) 214. https://doi.org/10.3390/e20040214
  33. Z. Li, X. Liu, S. Zhang, Shot Boundary Detection based on Multilevel Difference of Colour Histograms. In 2016 First International Conference on Multimedia and Image Processing (ICMIP) IEEE, (2016) 15-22. https://doi.org/10.1109/icmip.2016.24
  34. V.L. Narla, G. Suresh, M.K. Singh, V. Kumar M, Speech Signal Splicing Detection System based on MFCC and DTW. International Research Journal Multidisciplinary Technovation, 6(6), (2024) 170–181. https://doi.org/10.54392/irjmt24613
  35. TV9 Gujarati News Channel, Gujarati news video dataset. (2024). [Online]. Available: https://www.tv9gujarati.com