UCL Discovery
UCL home » Library Services » Electronic resources » UCL Discovery

Mathematical programming for piecewise linear regression analysis

Yang, L; Liu, S; Tsoka, S; Papageorgiou, LG; (2016) Mathematical programming for piecewise linear regression analysis. Expert Systems with Applications , 44 pp. 156-167. 10.1016/j.eswa.2015.08.034. Green open access

[thumbnail of Papageorgiou_ESWA.pdf]
Papageorgiou_ESWA.pdf - Accepted Version

Download (448kB) | Preview


In data mining, regression analysis is a computational tool that predicts continuous output variables from a number of independent input variables, by approximating their complex inner relationship. A large number of methods have been successfully proposed, based on various methodologies, including linear regression, support vector regression, neural network, piece-wise regression, etc. In terms of piece-wise regression, the existing methods in literature are usually restricted to problems of very small scale, due to their inherent non-linear nature. In this work, a more efficient piece-wise linear regression method is introduced based on a novel integer linear programming formulation. The proposed method partitions one input variable into multiple mutually exclusive segments, and fits one multivariate linear regression function per segment to minimise the total absolute error. Assuming both the single partition feature and the number of regions are known, the mixed integer linear model is proposed to simultaneously determine the locations of multiple break-points and regression coefficients for each segment. Furthermore, an efficient heuristic procedure is presented to identify the key partition feature and final number of break-points. 7 real world problems covering several application domains have been used to demonstrate the efficiency of our proposed method. It is shown that our proposed piece-wise regression method can be solved to global optimality for datasets of thousands samples, which also consistently achieves higher prediction accuracy than a number of state-of-the-art regression methods. Another advantage of the proposed method is that the learned model can be conveniently expressed as a small number of if-then rules that are easily interpretable. Overall, this work proposes an efficient rule-based multivariate regression method based on piece-wise functions and achieves better prediction performance than state-of-the-arts approaches. This novel method can benefit expert systems in various applications by automatically acquiring knowledge from databases to improve the quality of knowledge base.

Type: Article
Title: Mathematical programming for piecewise linear regression analysis
Open access status: An open access version is available from UCL Discovery
DOI: 10.1016/j.eswa.2015.08.034
Publisher version: http://dx.doi.org/10.1016/j.eswa.2015.08.034
Language: English
Additional information: © 2016. This manuscript version is published under a Creative Commons Attribution Non-commercial Non-derivative 4.0 International licence (CC BY-NC-ND 4.0). This licence allows you to share, copy, distribute and transmit the work for personal and non-commercial use providing author and publisher attribution is clearly stated. Further details about CC BY licences are available at http://creativecommons.org/licenses/by/4.0. Access may be initially restricted by the publisher.
Keywords: Science & Technology, Technology, Computer Science, Artificial Intelligence, Engineering, Electrical & Electronic, Operations Research & Management Science, Computer Science, Engineering, Regression Analysis, Surrogate Model, Piecewise Linear Function, Mathematical Programming, Optimisation, Artificial Neural-Networks, Support Vector Regression, Surrogate Models, Thermal-Conductivity, Random Forests, Ionic Liquids, Optimization, Prediction, Simulation, Algorithm
UCL classification: UCL
UCL > Provost and Vice Provost Offices > UCL BEAMS
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science
UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Chemical Engineering
URI: https://discovery.ucl.ac.uk/id/eprint/1491836
Downloads since deposit
Download activity - last month
Download activity - last 12 months
Downloads by country - last 12 months

Archive Staff Only

View Item View Item