In this study, for solving multi-group classification problems, a new two-stage hybrid classification method based on regression analysis and mathematical programming has been developed. In the first step of the proposed method, the classification score of each unit is estimated with the help of the linear regression equation for each unit. In the second step, the classification of the units is performed by the mathematical programming model based on clustering analysis. The proposed method combines the strengths of regression analysis and mathematical programming method. From the 10 real data sets taken the well-known literature and simulation study results, it is observed that the proposed method outperforms the regression analysis, mathematical programming and artificial neural network based classification methods.