Linear Algebraic Systems
• Define underdetermined systems
• Define overdetermined systems
• Least Squares Examples
The system of matrices above is of the form:
Ax = b
• A system of two Equations and two unknowns may yield a unique solution.
• The exception is when the determinant of A is equal to zero. Then the system is said to be singular.
• The left division operator will solve the linear system in one step by combining two matrix operations
• A\B is equivalent to A -1*B
Graphical Representation of
Unique vs. Singular Systems
• A system of linear equations is may be undetermined if;
1 The determinant of A is equal to zero
2 The matrix A is not square, i.e. the are more
unknowns than there are equations
• The converse of an underdetermined system
is an overdetermined system where there are
more equations than there are variables
• This situation arises frequently in
engineering. For example: suppose a linear
relationship is expected between x and y and
there are multiple data points.
Data Distribution of Linear
|y = mx + b|
The line y = mx + b, that best describes this
data is obtained by the method of least squares
Method of Least Squares
|The line that results in the
minimum value of J is
the least squares linear fit
to the data.
The Overdetermined System
• Once the curve fit is obtained, a y-value may
be interpolated for any x-value within the x-data
range (sometimes extrapolation is
• In the following example, fmins is used to
minimize the sum of the squared residuals
with respect to the slope and intercept .
Flowchart for least.m
Solving The Overdetermined
System, Method II
Method II (cont’d)
• If the system is not overdetermined, the
method will not work
Overdetermined system cont.