Regression Analysis with Classical and Statistical Learning Methods

Regression is a powerful technique in data analysis for modeling relationships between variables, making it crucial for prediction, decision-making, and pattern recognition. This book offers an accessible introduction to regression modeling, tailored for postgraduate students in fields such as data science, engineering, statistics, mathematics, business, and the sciences. It simplifies complex mathematical concepts and emphasizes real-world applications, complemented by coding examples to reinforce key concepts. The book covers classical regression methods including simple and multiple linear regression, polynomial regression, and logistic regression. It also addresses regression diagnostics, such as model evaluation, outlier detection, and assessment of model assumptions. By integrating classical methods with modern machine learning techniques, it offers a unique perspective. Machine learning techniques like support vector regression, decision trees, and artificial neural networks (ANN) for regression tasks are introduced, demonstrating their complementarity to classical methods through practical examples. The book also explores advanced methods such as Ridge, Lasso, Elastic Net, Principal Component Regression, and Generalized Linear Models (GLMs). These techniques are demonstrated using Python libraries like Statsmodels and Scikit-learn, enabling students to engage in practical learning.