A Novel Information-based Multi-view Representation Learning

Hongdan  Wang; Jian  Zhang

doi:10.6180/jase.202511_28(11).0008

A Novel Information-based Multi-view Representation Learning

Hongdan Wang¹This email address is being protected from spambots. You need JavaScript enabled to view it. and Jian Zhang²

¹Tieling Normal College, Tieling, 112608, China262737, China

²Liaoning Institute of Science and Engineering, Jinzhou, 121010, China

Received: December 15, 2024
Accepted: January 19, 2025
Publication Date: March 15, 2025

Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Download Citation: ||https://doi.org/10.6180/jase.202511_28(11).0008

Multi-view representation learning methods achieve great performance in various domains via fusing com plementary and consistent information of views, which have gained great attention. However, there still exist two issues in current methods. They typically assume strict semantic consistency across views to learn representations of multi-view data. Moreover, they lack a unified theoretical framework in mining patterns of multi-view data, making it difficult to gain a deeper understanding of multi-view representation learning. To this end, a new information-based multi-view representation learning within the encoding-decoding ar chitecture is proposed to aggregate complementary and consistent information for mining patterns (IMVRL). It consists of three mutual information objectives for multi-view representation learning, i.e., concentration learning, consistent learning, and comprehensiveness learning. Three objectives work seamlessly in aggregating complementary and consistent information to mine patterns of multi-view data. Finally, a series of extensive tests across three datasets underscore the advantages and efficacy of IMVRL.

Keywords: Mutual information maximization; multi-view representation learning; deep encoding-decoding architecture

[1] C.Xu,J.Si,Z.Guan,W.Zhao,Y.Wu,andX.Gao.“Re liable conflictive multi-view learning”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 38. 14. 2024, 16129–16137. DOI: 10.1609/aaai.v38i14.29546.
[2] W. Hu, Y. Wu, and Z. Yang, (2024) “An Analysis of Credit Risk Prediction for Small and Micro Enterprises" Journal of Artificial Intelligence Research 1(2): 1–21. DOI: 10.70891/JAIR.2024.110004.
[3] J. Gao, P. Li, A. A. Laghari, G. Srivastava, T. R. Gadekallu, S. Abbas, and J. Zhang, (2024) “Incomplete multiview clustering via semidiscrete optimal transport for multimedia data mining in IoT" ACM Transactions on Multimedia Computing, Communications and Applications 20(6): 1–20. DOI: 10.1145/3625548.
[4] L. Fu, S. Huang, L. Zhang, J. Yang, Z. Zheng, C. Zhang, and C. Chen, (2024) “Subspace-contrastive multi-view clustering" ACM Transactions on Knowl edge Discovery from Data 18(9): 1–35. DOI: 10.1145/367483.
[5] Y. Sun, Y. Qin, Y. Li, D. Peng, X. Peng, and P. Hu, (2024) “Robust multi-view clustering with noisy corre spondence" IEEE Transactions on Knowledge and Data Engineering: DOI: 10.1109/TKDE.2024.3423307.
[6] J.Gao,M.Liu,P.Li,A.A.Laghari,A.R.Javed,N.Vic tor, and T. R. Gadekallu, (2023) “Deep incomplete multi view clustering via information bottleneck for pattern min ing of data in extreme-environment IoT" IEEE Internet of Things Journal: DOI: 10.1109/JIOT.2023.3325272.
[7] S. Shi, F. Nie, R. Wang, and X. Li, (2021) “Multi-view clustering via nonnegative and orthogonal graph recon struction" IEEE transactions on neural networks and learning systems 34(1): 201–214. DOI: 10.1109/TNNLS.2021.3093297.
[8] W. Yan, Y. Zhang, C. Lv, C. Tang, G. Yue, L. Liao, and W.Lin. “Gcfagg: Global and cross-view feature aggregation for multi-view clustering”. In: Proceed ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023, 19863–19872.
[9] Y. Lin, Y. Gou, X. Liu, J. Bai, J. Lv, and X. Peng, (2022) “Dual contrastive prediction for incomplete multi-view representation learning" IEEE Transactions on Pattern Analysis and Machine Intelligence 45(4): 4447–4461. DOI: 10.1109/TPAMI.2022.3197238.
[10] J. Pu, C. Cui, X. Chen, Y. Ren, X. Pu, Z. Hao, S. Y. Philip, and L. He. “Adaptive Feature Imputation with Latent Graph for Deep Incomplete Multi-View Clustering”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 38. 13. 2024, 14633–14641.
[11] P. Li, A. A. Laghari, M. Rashid, J. Gao, T. R. Gadekallu, A. R. Javed, and S. Yin, (2022) “A deep multimodal adversarial cycle-consistent network for smart enterprise system" IEEE Transactions on Industrial Informatics 19(1): 693–702. DOI: 10.1109/TII.2022. 3197201.
[12] J. Gao, M. Liu, P. Li, J. Zhang, and Z. Chen, (2024) “Deep Multiview Adaptive Clustering With Semantic In variance" IEEE Transactions on Neural Networks and Learning Systems 35(9): 12965–12978. DOI: 10.1109/TNNLS.2023.3265699.
[13] P. Zhang, S. Wang, L. Li, C. Zhang, X. Liu, E. Zhu, Z. Liu, L. Zhou, and L. Luo. “Let the data choose: Flexible and diverse anchor graph fusion for scalable multi-view clustering”. In: Proceedings of the AAAI Conference on Artificial Intelligence. 37. 9. 2023, 11262 11269. DOI: 10.1609/aaai.v37i9.26333.
[14] Y. Ren, J. Pu, C. Cui, Y. Zheng, X. Chen, X. Pu, and L. He. “Dynamic weighted graph fusion for deep multi view clustering”. In: Proceedings of the 33rd Interna tional Joint Conference on Artificial Intelligence. 2024, 4842–4850.
[15] S.-Y. Li, Y. Jiang, and Z.-H. Zhou. “Partial multi-view clustering”. In: Proceedings of the AAAI conference on artificial intelligence. 28. 1. 2014. DOI: 10.1609/aaai.v28i1.8973.
[16] H. Wang, L. Zong, B. Liu, Y. Yang, and W. Zhou. “Spectral perturbation meets incomplete multi-view data”. In: Proceedings of the 28th International Joint Conference on Artificial Intelligence. 2019, 3677–3683.
[17] C. Luo, J. Xu, Y. Ren, J. Ma, and X. Zhu. “Simple Contrastive Multi-View Clustering with Data-Level Fusion”. In: Proceedings of the Thirty-Third Interna tional Joint Conference on Artificial Intelligence. 2024, 4697–4705.
[18] X. Yang, J. Jiaqi, S. Wang, K. Liang, Y. Liu, Y. Wen, S. Liu, S. Zhou, X. Liu, and E. Zhu. “Dealmvc: Dual contrastive calibration for multi-view clustering”. In: Proceedings of the 31st ACM International Conference on Multimedia. 2023, 337–346.
[19] J. Chen, H. Mao, W. L. Woo, and X. Peng. “Deep multiview clustering by contrasting cluster assign ments”. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. 2023, 16752–16761.

Journal of Applied Science and Engineering

A Novel Information-based Multi-view Representation Learning

Latest Articles

You may also like these articles below...

Most Popular Articles

Research Categories