TY - JOUR
T1 - Global optimization on non-convex two-way interaction truncated linear multivariate adaptive regression splines using mixed integer quadratic programming
AU - Ju, Xinglong
AU - Rosenberger, Jay M.
AU - Chen, Victoria C.P.
AU - Liu, Feng
N1 - Publisher Copyright:
© 2022 Elsevier Inc.
PY - 2022/6
Y1 - 2022/6
N2 - Multivariate adaptive regression splines (MARS) has been adopted as a popular surrogate function to model the unknown relationships between input and output variables in complex systems. Searching optimal solutions on the complicated surrogate response surface of MARS serves as important tasks in various applications. In this paper, we present an efficient and effective approach to find a global optimal value of MARS models that incorporate two-way interaction terms which are products of truncated linear univariate functions (TITL-MARS). Specifically, with a MARS model consisting of linear and quadratic structures, we can reformulate the optimization problem on TITL-MARS into a mixed integer quadratic programming problem (TITL-MARS-OPT), which can be further solved in a more principled way. To illustrate the effectiveness of our proposed approach TITL-MARS-OPT, we come up with a genetic algorithm and a gradient descent algorithm to solve the original version of TITL-MARS, and we compared the performance of the proposed approach with the benchmark algorithms. Numerical experiments are conducted on a spectrum of examples with different levels of complexity, including 6 existing models and a real world application in the wind farm optimization. Our proposed approach can find a global optimal successfully and efficiently while the comparison algorithms fail to find a global optimal solution. In the end, Python code for TITL-MARS and TITL-MARS-OPT is made available on GitHub ( https://github.com/JuXinglong/TITL-MARS-OPT).
AB - Multivariate adaptive regression splines (MARS) has been adopted as a popular surrogate function to model the unknown relationships between input and output variables in complex systems. Searching optimal solutions on the complicated surrogate response surface of MARS serves as important tasks in various applications. In this paper, we present an efficient and effective approach to find a global optimal value of MARS models that incorporate two-way interaction terms which are products of truncated linear univariate functions (TITL-MARS). Specifically, with a MARS model consisting of linear and quadratic structures, we can reformulate the optimization problem on TITL-MARS into a mixed integer quadratic programming problem (TITL-MARS-OPT), which can be further solved in a more principled way. To illustrate the effectiveness of our proposed approach TITL-MARS-OPT, we come up with a genetic algorithm and a gradient descent algorithm to solve the original version of TITL-MARS, and we compared the performance of the proposed approach with the benchmark algorithms. Numerical experiments are conducted on a spectrum of examples with different levels of complexity, including 6 existing models and a real world application in the wind farm optimization. Our proposed approach can find a global optimal successfully and efficiently while the comparison algorithms fail to find a global optimal solution. In the end, Python code for TITL-MARS and TITL-MARS-OPT is made available on GitHub ( https://github.com/JuXinglong/TITL-MARS-OPT).
KW - Genetic algorithm
KW - Global optimization
KW - Gradient descent algorithm
KW - Mixed integer quadratic programming
KW - Multivariate adaptive regression splines
UR - http://www.scopus.com/inward/record.url?scp=85126529014&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85126529014&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2022.03.041
DO - 10.1016/j.ins.2022.03.041
M3 - Article
AN - SCOPUS:85126529014
SN - 0020-0255
VL - 597
SP - 38
EP - 52
JO - Information Sciences
JF - Information Sciences
ER -