A Regression is a statistical model that describe the relationship between variables by fitting a line to the observed data. It is actually a mathematical equation, except a special random term, which allow us to estimate how a dependent variable change as the independent variable(s) change.
For Example: The equation Score = 40.5 + 7.2 * hours + e is a regression model where e is the error term, hours is the student’s study hours, score is his examination score.
This regression model constructed using a set of data consisting Score and hours. Now we can estimate a student’s score using his study hours. Off course, this will not give us exact estimate of score but approximate. That’s why an error term is used here.
Regression model represent an equation of a line. The line may be linear, or nonlinear (curve). When it is linear it is called Linear regression models and when it is curved line it is called nonlinear regression models.


Statlearner
Statlearner