1
|
Li B, Li Z. Large-Scale Cross-Modal Hashing with Unified Learning and Multi-Object Regional Correlation Reasoning. Neural Netw 2024; 171:276-292. [PMID: 38103437 DOI: 10.1016/j.neunet.2023.12.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 10/31/2023] [Accepted: 12/11/2023] [Indexed: 12/19/2023]
Abstract
To explore the rich information contained in multi-modal data and take into account efficiency, deep cross-modal hash retrieval (DCMHR) is a wise solution. But currently, most DCMHR methods have two key limitations, one is that the recommended classification of DCMHR models is conditioned only on the objects in different regions, respectively. Another flaw is that these methods either do not learn the unified hash codes in training or cannot design an efficient training process. To solve these two problems, this paper designs Large-Scale Cross-Modal Hashing with Unified Learning and Multi-Object Regional Correlation Reasoning (HUMOR). For the proposed related labels classified by ImgNet, HUMOR uses Multiple Instance Learning (MIL) to reason the correlation of these labels. When regional correlation reasoning is low, these labels will be through "reduce-add" to rectification from max-to-min (global precedence) or min-to-max (regional precedence). Then, HUMOR conducts unified learning on hash loss and classification loss, adopts the four-step iterative algorithm to optimize the unified hash codes, and reduces bias in the model. Experiments on two baseline datasets show that the average performance of this method is higher than most of the DCMHR methods. The results demonstrate the effectiveness and innovation of our method.
Collapse
Affiliation(s)
- Bo Li
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin 541004, China; Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, Guilin 541004, China; School of Computer Science and Engineering, Guilin University of Aerospace Technology, Guilin 541004, China.
| | - Zhixin Li
- Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University, Guilin 541004, China; Guangxi Key Lab of Multi-source Information Mining and Security, Guangxi Normal University, Guilin 541004, China.
| |
Collapse
|
2
|
Li J, Huang Z, Wang H, Ding H, Jia Q, Zhao W, Le T, Jameel D, Wang P. Multi-index comprehensive evaluation model for assessing risk to trainees in an emergency rescue training base for building collapse. Sci Rep 2024; 14:4792. [PMID: 38413691 PMCID: PMC10899225 DOI: 10.1038/s41598-024-55368-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2023] [Accepted: 02/22/2024] [Indexed: 02/29/2024] Open
Abstract
Rescues from building collapse accidents present a significant challenge for China's emergency rescue system. However, there are also many risk factors in a training scenario, which have been summarized in this study. A hierarchical indicator system for personnel safety was established, including 12 first-level indicators and 23s-level indicators. Then, an improved Grey-DEMATEL-ISM-MICMAC evaluation model was constructed to evaluate the level of risk. Influencing factor scores were determined according to the responses from the questionnaire survey. The influencing degree, influenced degree, centrality, and causality were identified, and the importance, relevance, and clustering of the various factors were obtained after making quantitative calculations. The results showed that the order of priority for solving the essential issues was safety education (A2), operating standards and proficiency (A10), equipment inspection (A4), equipment warehousing maintenance and records (A21). The solving of safety education was identified to be the most essential priority. The priority control order of direct causes was Scientific design and construction (A5), Potential fixed hazards in the facility (A12), Physical fitness of personnel (A1), Weather influences (A18), and Initiation efficiency of emergency plans (A20), and direct control measures for these five factors could achieve a relatively significant effect.
Collapse
Affiliation(s)
- Jinyang Li
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China
| | - Zhian Huang
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China
| | - Hongsheng Wang
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China.
- Institute of Risk Assessment and Control, Guangdong Technology Center of Work Safety, Guangzhou, 510000, China.
| | - Hao Ding
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China.
- Institute of Risk Assessment and Control, Guangdong Technology Center of Work Safety, Guangzhou, 510000, China.
| | - Qunlin Jia
- National Earthquake Emergency Rescue Training Base, Beijing, 100059, China
| | - Wei Zhao
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China
| | - Tian Le
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China
| | - Danish Jameel
- State Key Laboratory of High-Efficient Mining and Safety of Metal Mines, University of Science and Technology Beijing, Ministry of Education, Beijing, 100083, China
| | - Pengfei Wang
- Work Safety Key Lab on Prevention and Control of Gas and Roof Disasters for Southern Coal Mines, Hunan University of Science and Technology, Xiangtan, 411201, China
| |
Collapse
|
3
|
Intelligence and Neuroscience C. Retracted: A Study of Athlete Pose Estimation Techniques in Sports Game Videos Combining Multiresidual Module Convolutional Neural Networks. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:9831083. [PMID: 37538728 PMCID: PMC10396677 DOI: 10.1155/2023/9831083] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 07/25/2023] [Indexed: 08/05/2023]
Abstract
[This retracts the article DOI: 10.1155/2021/4367875.].
Collapse
|
4
|
Research on Multiplayer Posture Estimation Technology of Sports Competition Video Based on Graph Neural Network Algorithm. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4727375. [PMID: 35401733 PMCID: PMC8993548 DOI: 10.1155/2022/4727375] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2021] [Revised: 12/29/2021] [Accepted: 01/03/2022] [Indexed: 11/17/2022]
Abstract
With the explosive growth of the number of sports videos, the traditional sports video analysis method based on manual annotation has been difficult to meet the growing demand because of its high cost and many limitations. The traditional model is usually based on the target detection algorithm of manual features, and the detection of human posture features is not accurate. Compared with global image features such as line features, texture features and structure features, local image features have the characteristics of rich quantity in the image, low correlation between features, and will not affect the detection and matching of other features due to the disappearance of some features in the case of occlusion. Referring to the practice of Deep-ID network considering both local and global features, this paper adjusts the traditional neural network, and combines the improved neural network with the human joint model to form a human pose detection method based on graph neural network, and then applies the algorithm to multiperson human pose estimation. The results of several groups of comparative experiments show that the algorithm can better estimate the human posture in sports competition video, and has a good performance in solving multiperson pose estimation in sports game video.
Collapse
|