Chapter(1) -- Linear Equations in Linear Algebra

1. Systems of Linear Equations

A linear equation in the variables x1,....xn is an equation that can be written in the form:

a1x1+a2x2+......+anxn=b

a1,....an is the cofficients

A system of linear equations or linear system is a collection of one or more linear equations involving the same variables.

The set of all possible solutions is called the solution set of the linear system.

Two linear systems are called equivalent if they have the same solution set.

Matrix is the essential information of a linear system can be recorded compactly in a rectangular array.

If m and n are positive integers, an m×n matrix is a rectangular array of numbers with m rows and n columns.

矩阵的表达也是以行列的顺序进行的。

2. Row Reduction and Echelon Forms

Nonzero row or column in a matrix means a row or column that contains at least one nonzero entry.

Leading entry of a row refers to the leftmost nonzero entry.

A rectangular matrix is in echelon form if it has the following three properties:

1. All nonzero rows are above any rows of all zeros

2. Each leading entry of a row is in a column to the right of the leading entry of the row above it.

3. All entries in a column below a leading entry are zeros.

梯形矩阵应有如下性质:

1. 所有的非零行都在零行上面。

2. 最左边的首个非零元素,应该比上面行的首项系数更靠右。

3. 首项系数所在列,下面的元素都应该是0。

4. 越往下,应该是0越多。

If a matrix in echelon form satisfies the following additional conditions, then it is in reduced echelon form

1. The leading entry in each nonzero row is 1

2. Each leading 1 is the only nonzero entry in its column

Theorem 1: uniqueness of Reduced Echelon Form

Each matrix is row equivalent to one and only one reduced echelon matrix.

(通过矩阵的变换,可以把每一个矩阵都换成梯形矩阵的样子,而且这个样子具有唯一性)

A pivot is a nonzero number in a pivot position that is used as needed to create zeros via row operations.

A pivot position in a matrix A is a location that corresponds to a leading 1 in the reduced echelon form of A.

A pivot column is a column of A that contains a pivot position.

3. Vector Equations

A matrix with only one column is called vector.

For example, the set of all vectors with two entries is denoted by ?2, whereas the ? stands for the real numbers that appear as entries in the vectors, and the exponent 2 indicated that the vectors each contain two entries.

Algebraic Properties of ?n

For all u, v, w in ?and all scalar c and d:

1. u+v = v+u

2. (u+v) + w = u +(v+w)

3. u+0 = 0+u

4. u+(−u) = −u+u = 0

5. c(u+v) = cu+cv

6. (c+d)u = cu+du

7. c(du) = (cd)*u

4. The Matrix Equation Ax=b

定义1:

If A is an m×n matrix, with columns a1...an, and if x is in ?n, then the product of A and x, denoted by Ax, is the linear conbination of the columns of A using the corresponding entries in x as weights.

Theorem 3:

If A is an m×n matrix, with columns a1...an, and if b is in ?n, the matrix equation Ax=b has the same solution set as the vector equation a1x1+a2x2+......+anxn=b, which, in turn, has hte same solution set as the system of linear equations whose augmented matrix is [a1 a2 ... an b]

Theorem 4:

Let A be an m×n matrix. Then the following statements are logically equivalent. This is, for a particular A, either they are all true or all false.

1. For each b in ?m, the equation Ax=b has a solution.

2. Each b in ?m is a linear conbination of the columns of A.

3. The columns of a span ?m

4. A has a pivot position in every row.

5. Solution Sets of Linear Systems

A system of linear equation is said to be homogeneous if it can be written in the form of Ax=0, where A is an  m×n matrix and 0 is the zero vector in ?n

This zero solution is usually called the trivial solution

Theorem 6:

Suppose the equation Ax=b is consistent for some given b, and let p be a solution. Then the solution set of Ax=b is the set of all vectors of the form w=p+vh, where vh is any solution of the homogeneous equation Ax=0.

6. Applications of Linear Systems

7. Linear Independence

Definition:

An indexed set of vectors {v1,...vp} in ?n is said to be linearly independent if the vector euqation x1v1+x2v2+...+xpvp=0 has only the trivial solution.

The set {v1,...vp} is said to be linearly dependent if there exist weights c1,...cp, not all zero, such that c1v1+c2v2+...+cpvp=0

Theorem 7:

An indexed set S={v1,...vp}  of two or more vectors is linearly dependent if and only if at least one of the vectors in S is a linear combination of the others. In fact, if S is linearly dependent and v1≠0, then some vj is a linear combination of the preceding vectors, v1,...,vj–1.

Theorem 8:

If a set contains more vectors than there are entries in each vector, then the set is linearly dependent. That is, any set {v1,...vp} in ?n is linearly dependent if p>n.

Theorem 9:

If a set S={v1,...vp} in ?n contains the zero vector, then the set is linearly dependent.

8. Introduction to Linear Transformations

A transformation (or a function or a mapping) T from ?n to ?m is a rule that assigns to each vector x in ?n a vector T(x) in  ?m.

Definition:

A transformation (or mapping) T is linear if:

1. T(u+v) = Tu + Tv for all u, v in the domain of T;

2. T(cu) = c(Tu) for all u nad all scalars c.

9. The Matrix of A Linear Transformation

Theorem 10:

Let T: ?n → ?m be a linear transformation. Then there exists a unique matrix A such that:

T(x) = Ax for all x in ?n,

In fact, A is the m×n matrix whose jth column is the vector T(ej), where ej is the jth column of the identity matrix in ?n:

A = [T(e1)......T(en), this matrix is called the standard matrix for the linear transformation T.

时间: 2024-10-04 09:48:12

Chapter(1) -- Linear Equations in Linear Algebra的相关文章

Memo - Chapter 6 of Strang's Linear Algebra and Its Applications

1.实对称矩阵的正定 2.实对称矩阵的半正定 3. Sylvester’s law of inertia : 4.Sylvester’s law of inertia 的推论: 5. SVD 6.瑞利伤: Memo - Chapter 6 of Strang's Linear Algebra and Its Applications

Memo - Chapter 3 of Strang's Linear Algebra and Its Applications

1.正交向量.正交空间.正交补空间 2.号称是本书最重要的配图 3.向量的cosine距离,投影变换,最小二乘 4.正交基与Schmidt正交化与QR分解 5.函数空间,傅里叶级数,Hilbert空间 Memo - Chapter 3 of Strang's Linear Algebra and Its Applications

线性代数相关库

blas The BLAS (Basic Linear Algebra Subprograms) are routines that provide standard building blocks for performing basic vector and matrix operations. The Level 1 BLAS perform scalar, vector and vector-vector operations, the Level 2 BLAS perform matr

Introduction to Linear Algebra(Chapter2)

Chapter 2 Solving Linear Equations 2.1 Vectors and Linear Equations 线性代数的核心问题:解决等式系统.------------“But slope is important in calculus and this is linear algebra”. A*x=b的两种viewpoints: A的行空间与x的内积:或者A的列空间的线性组合.-------key issue 常见矩阵分解:LU.QR.SVD(最常用). 2.2

线性代数导论 | Linear Algebra 课程

搞统计的线性代数和概率论必须精通,最好要能锻炼出直觉,再学机器学习才会事半功倍. 线性代数只推荐Prof. Gilbert Strang的MIT课程,有视频,有教材,有习题,有考试,一套学下来基本就入门了. 不多,一共10次课. 链接:https://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-spring-2010/calendar/ SES # TOPICS KEY DATES 1 The geometry of linear e

MAT2040 Linear Algebra

Binary Vector Spaces and Error Correcting CodesMAT2040 Linear Algebra (2019 Fall)Project 1Project Instructions:• Read the following text and answer the questions given in and after the text.• For questions that need Julia, both codes and results shou

Commemoration of Linear Algebra

1. Gaussian Elimination 1 import java.util.*; 2 import java.text.*; 3 4 class Linear { 5 private int m, n; 6 private double[][] mat; 7 private DecimalFormat df; 8 9 public Linear(int m,int n) { 10 this.m = m; 11 this.n = n; 12 mat = new double[m][n+1

Chapter 9 Linear Predictors

In this chapter we will study the family of linear predictors, one of the most useful families of hypothesis classes. Many learning algorithms that are being widely used in practice rely on linear predictors, first and foremost because of the ability

机器学习笔记1——Linear Regression with One Variable

Linear Regression with One Variable Model Representation Recall that in *regression problems*, we are taking input variables and trying to map the output onto a *continuous* expected result function. Linear regression with one variable is also known