• The line that makes the sum of the squares of the vertical distances of the data points from the line as small as possible.
  • That is, we want to minimize: