TY - JOUR
T1 - Semantic Neural Network Ensemble for Automated Dependency Relation Extraction from Bridge Inspection Reports
AU - Liu, Kaijian
AU - El-Gohary, Nora
N1 - Publisher Copyright:
© 2021 This work is made available under the terms of the Creative Commons Attribution 4.0 International license,.
PY - 2021/7/1
Y1 - 2021/7/1
N2 - Bridge inspection reports are important sources of technically detailed data/information about bridge conditions and maintenance history, yet remain untapped for bridge deterioration prediction. To capitalize on these reports for improved bridge deterioration prediction, there is a need for dependency parsing methods, in order to extract dependency relations from the reports for linking the isolated words into concepts and representing the semantically low concepts in a semantically rich structured way. To address this need, this paper proposes a novel semantic neural network ensemble (NNE)-based dependency parsing methodology. It uses a similarity-based method to sample similarly distributed configurations into the same clusters, a set of constituent neural network (NN) classifiers to learn from both the syntactic and semantic text features of the similarly distributed and therefore more easily separable configurations, and a combiner classifier to capture the classification patterns of the NN classifiers to make final predictions on the transition types. The proposed dependency parsing methodology was evaluated in extracting dependency relations from bridge inspection reports for representing information - about bridge conditions and maintenance actions - in a semantically rich structured way. It achieved a precision, recall, and F-1 measure of 96.6%, 90.4%, and 93.3% with a margin of error of 3.8%, 4.4%, and 3.8% at the semantic information element level, and 88.2%, 81.5%, and 84.7% with a margin of error of 5.4%, 5.8%, and 5.4% at the semantic information set level, respectively.
AB - Bridge inspection reports are important sources of technically detailed data/information about bridge conditions and maintenance history, yet remain untapped for bridge deterioration prediction. To capitalize on these reports for improved bridge deterioration prediction, there is a need for dependency parsing methods, in order to extract dependency relations from the reports for linking the isolated words into concepts and representing the semantically low concepts in a semantically rich structured way. To address this need, this paper proposes a novel semantic neural network ensemble (NNE)-based dependency parsing methodology. It uses a similarity-based method to sample similarly distributed configurations into the same clusters, a set of constituent neural network (NN) classifiers to learn from both the syntactic and semantic text features of the similarly distributed and therefore more easily separable configurations, and a combiner classifier to capture the classification patterns of the NN classifiers to make final predictions on the transition types. The proposed dependency parsing methodology was evaluated in extracting dependency relations from bridge inspection reports for representing information - about bridge conditions and maintenance actions - in a semantically rich structured way. It achieved a precision, recall, and F-1 measure of 96.6%, 90.4%, and 93.3% with a margin of error of 3.8%, 4.4%, and 3.8% at the semantic information element level, and 88.2%, 81.5%, and 84.7% with a margin of error of 5.4%, 5.8%, and 5.4% at the semantic information set level, respectively.
KW - Bridges
KW - Dependency parsing
KW - Deterioration prediction
KW - Information extraction
KW - Natural language processing
KW - Neural network ensemble
KW - Relation extraction
UR - http://www.scopus.com/inward/record.url?scp=85105164620&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85105164620&partnerID=8YFLogxK
U2 - 10.1061/(ASCE)CP.1943-5487.0000961
DO - 10.1061/(ASCE)CP.1943-5487.0000961
M3 - Article
AN - SCOPUS:85105164620
SN - 0887-3801
VL - 35
JO - Journal of Computing in Civil Engineering
JF - Journal of Computing in Civil Engineering
IS - 4
M1 - 04021007
ER -