A new video similarity measurement for sports video classification

Prisana  Mutchima; Parinya  Sanguansat

Authors

Prisana Mutchima Faculty of Information Technology, Rangsit University, Patumthani 12000, Thailand
Parinya Sanguansat Faculty of Engineering and Technology, Panyapiwat Institute of Management, Nonthaburi 11120, Thailand

Keywords:

video similarity, video classification, Random Projection, distance space, Compressive Classification

Abstract

A key issue of video similarity measure is that most video data are huge files, resulting in time-consuming data processing. Therefore, reducing the dimensionality of the data becomes an essential. But data-dependent dimensionality reduction methods are not efficient. Furthermore, video data usually consists of a large number of frames which varies between different videos, making it difficult to compare their similarity. Therefore, this paper proposes a new framework to reduce the dimensionality of video data by Random Projection (RP) technique and fix dimension by distance space technique. In addition, Compressive Classification (CC) technique will be applied to classify videos. This technique works with a dimensionality reduction method that is data independent. Initially, all training videos frames are extracted by a color histogram based method. Next, all videos features are projected onto a low-dimensional subspace using a random projection. Then a clustering technique is performed to provide the centroids of each cluster, called reference vectors. These vectors are used as a set of basis to create new space, called distance space. For any sequence in distance space, the new feature is represented by the frequencies of similar frames compared with each reference vector. Finally, videos will be classified by the compressive classifier. Empirical evaluations of the results show that the proposed framework significantly outperforms other approaches in video classification.

References

Blanken, H., Vries, A. P., Blok, H. E. & Feng, L. (2007). Multimedia retrieval. New York, USA: Springer-Verlag Berlin Heidelberg.

Calic, J., Campbell, N., Dasiopoulou, S. & Kompatsiaris, Y. (2005). A survey on multimodal video representation for semantic retrieval. In The International Conference on Computer as a Tool (EUROCON 2005), Serbia, Montenegro, Belgrade, pp.135-138.

Chakravarti, R. & Meng, X. (2009). A study of color histogram based image retrieval. In Sixth International Conference on Information Technology: New Generations (ITNG '09), Las Vegas, Nevada, USA, pp.1323-1328.

Cheung, S. S. & Zakhor, A. (2003a). Efficient video similarity measurement with video signature. In IEEE Transactions on Circuits and Systems for Video Technology, 13(1), 59-74.

Cheung, S. S. & Zakhor, A. (2003b). Fast similarity search on video signatures. In International Conference on Image Processing (ICIP 2003), Barcelona, Catalonia, Spain, pp.II - 1-4.

Chikkerur, S., Pankanti, S., Jea, A., Ratha, N. & Bolle, R. (2006). Fingerprint representation using localized texture features. In 18th International Conference on Pattern Recognition (ICPR 2006), Hong Kong, China, pp.521-524.

Deegalla, S. & Bostrom, H. (2006). Reducing high-dimensional data by principal component analysis vs. random projection for nearest neighbor classification. In 5th International Conference on Machine Learning and Applications (ICMLA '06), Orlando, Florida, USA, pp. 245-250.

Deng, Y., Manjunath, B. S., Kenney, C., Moore, M. S. & Shin, H. (2001). An efficient color representation for image retrieval. In IEEE Transactions on Image Processing, 10(1), 140-147.

Ferman, A.M., Tekalp, A.M. & Mehrotra, R. (2002). Robust color histogram descriptors for video segment retrieval and identification. In IEEE Transactions on Image Processing, 11(5), 497-508.

Gao, L., Li, Z. & Katsaggelos, A. K. (2009). A video retrieval algorithm using random projections. In 16th IEEE International Conference on Image Processing (ICIP 2009), Cairo, Egypt, pp.797-800.

Goela, N., Bebisa, G. & Nefianb, A. (2005). Face recognition experiments with random projection. In Proceeding of the Biometric Technology for Human Identification II, Orlando, FL, USA, pp.426-437.

Hauptmann, A., Yan, R., Qi, Y. Jin, R., Christel, M., Derthick, M., Chen, M.-Y, Baron, R., Lin, W. H. &.Ng, T.D (2002, November). Video classification and retrieval with the informedia digital video library system. In Proceeding of the eleventh Text Retrieval Conference (TREC 2002), Gaithersburg, Maryland, USA, pp. 119-127.

Huitao, L. (2005). Image-dependent shape coding and representation. In IEEE Transactions on Circuits and Systems for Video Technology, 15(3), 345-354.

Majumdar, A. & Ward, R. K. (2010). Robust classifiers for data reduced via random projections. In IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics, 40(5), 1359-1371. URL: http://ubc.academia.edu/AngshulMajumdar/Papers/699899/Robust_classifiers_for_data_reduced_via_random_projections

Man-Kwan, S. & Suh-Yin, L. (1998). Content-based video retrieval based on similarity of frame sequence. In Proceedings of the International Workshop on Multi-Media Database Management Systems (IW-MMDBMS), Dayton, Ohio, pp.90-97.

Mazhar, R., Gader, P.D. & Wilson, J.N. (2009). Matching-pursuits dissimilarity measure for shape-based comparison and classification of high-dimensional data. In IEEE Transactions on Fuzzy Systems, 17(5), 1175-1188.

Mojsilovic, A., Hu, H. & Soljanin, E. (2002). Extraction of perceptually important colors and similarity measurement for image matching, retrieval and analysis. In IEEE Transactions on Image Processing, 11(11), 1238-1248.

Mutchima, P. & Sanguansat, P. (2010a). A new approach for measuring video similarity without threshold and its application in sports video categorization. In First International Conference on.Pervasive Computing Signal Processing and Applications (PCSPA 2010), Harbin, China, pp.868-872.

Mutchima, P. & Sanguansat, P. (2010b). Video similarity measurement approach via dimensionality reduction with distance space and random projection: Application with sports video classification. In International Symposium on Communications and Information Technologies (ISCIT2010), Tokyo, Japan, pp.430-434.

Nor Hazlyna, H, Mashor, M. Y., Mokhtar, N. R., Aimi Salihah, A. N., Hassan, R., Raof, R. A. A., & Osman, M. K. (2010, May 10-13). Comparison of acute leukemia Image segmentation using HSI and RGB color space. In 10th International Conference on Information Sciences Signal Processing and their Applications (ISSPA), 749-752. doi: 10.1109/ISSPA.2010.5605410

Ott, L., Lambert, P., Ionescu, B., & Coquin, D. (2007). Animation movie abstraction: Key frame adaptative selection based on color histogram filtering. In 14th International Conference on Image Analysis and Processing Workshops (ICIAPW 2007), Modena, Italy, pp. 206-211.

Shen, H., Tao, O., Beng C., & Zhou, X. (2005). Towards effective indexing for very large video sequence database. In Proceedings of the 2005 ACM SIGMOD international conference on Management of data (SIGMOD 2005). Baltimore, Maryland, USA: ACM, pp.730-741

Suruliandi, A., & Ramar, K. (2008). Local texture patterns - a univariate texture model for classification of images. In 16th International Conference on Advanced Computing and Communications (ADCOM 2008), Bangalore, India, pp.32-39.

Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., and Yi, M. (2009). Robust face recognition via sparse representation. Pattern Analysis and Machine Intelligence, 31(2), 210-227.

Wu, W., & Hu, J. (2008). Similarity search based on random projection for high frequency time series. In IEEE Conference on Cybernetics and Intelligent Systems, Chengdu, Chaina, pp. 388-393.

Xiong, Z., Radhakrishnan, R., Divakaran, A., Rui, Y., & Huang, T.S. (2005). A unified framework for video summarization, browsing & retrieval: with applications to consumer and surveillance video. Orlando, USA: Academic Press.

Zhang, Z., Wenhui, L., & Yinan, L. (2009). New color feature representation and matching technique for content-based image retrieval. In International Conference on Multimedia Computing and Systems (ICMCS '09), Montreal, Quebec, Canada, pp.118-122.

Zhou, X., Zhou, X., & Shen, H. T. (2007). Efficient similarity search by summarization in large video database. In Proceedings of the eighteenth conference on Australasian database. Victoria: Australian Computer Society, Ballarat, Victoria, Australia, pp .161-167.