Vector

  • \(\vec{a}=<a_1,a_2,\ldots,a_n>=\lVert \vec{a} \rVert\cdot\hat{i}\) is a vector in \(\mathbb{R}^n\)
  • \(\vec{a}\) has length \(\lVert \vec{a}\rVert=\sqrt{a_1^2+a_2^2+\ldots+a_n^2}\)
  • \(\vec{a}\) points in direction of unit vector \(\hat{i}=\frac{\vec{a}}{\lVert \vec{a}\rVert}\), where \(\lVert\hat{i}\rVert=1\)

Vector triangle inequality \(\lVert \vec{a}+\vec{b} \rVert \leq \lVert \vec{a} \rVert+\lVert \vec{b} \rVert\)

  1. Geometric view

  1. Algebraic view

    \[\begin{align} \lVert \vec{a}+\vec{b} \rVert^2 =&\vec{a}^2+2\left(\vec{a} \cdot \vec{b}\right)+\vec{b}^2\\ \leq&\lVert\vec{a}\rVert^2+2\left(\lVert \vec{a} \rVert\cdot\lVert\vec{b} \rVert\right)+\lVert\vec{b}\rVert^2=\left( \lVert\vec{a}\rVert+\lVert\vec{b}\rVert \right)^2\\ \Rightarrow&\lVert\vec{a}+\vec{b}\rVert \leq \lVert\vec{a}\rVert+\lVert\vec{b}\rVert \end{align}\]

Vector dot product

  • \(\vec{a}\cdot \vec{b}=\sum a_i\cdot b_i=\lVert \vec{a}\rVert \lVert \vec{b}\rVert \cdot \cos{\theta}=scalar\) is dot product of 2 vectors in \(\mathbb{R}^n\), \(\cos{\theta}=\frac{\vec{u}\cdot \hat{i}}{\lVert\vec{u}\rVert \lVert \hat{i}\rVert}\) is direction angle of 2 vectors, \(\mathbf{\vec{a}\cdot \vec{a}=\lVert \vec{a} \rVert^2=\vec{a}^2}\)

  • \(\vec{a}\cdot\vec{b}=\vec{b}\cdot\vec{a}\), \((c\vec{a})\cdot\vec{b}=c(\vec{a}\cdot\vec{b})\), \(\vec{a}\cdot\left(\vec{b}+\vec{c}\right)=\vec{a}\cdot\vec{b}+\vec{a}\cdot\vec{c}\)

  • orthogonal vectors have \(\theta=\frac{\pi}{2},\cos{\theta}=0\Rightarrow \vec{a}\cdot \vec{b}=0\)

  • parallel vectors have \(\theta=0,\cos{\theta}=1\Rightarrow \vec{a}\cdot \vec{b}=\lVert \vec{a}\rVert \lVert \vec{b}\rVert\)

Proof of Cauchy-Schwarz inequality

  • Cauchy-Schwarz inequality basic form, \(\left(ac+bd\right)^2\leq \left(a^2+b^2\right)\left(c^2+d^2\right)\)
\[\begin{align} \forall \vec{A}=<a,b>&\text{, }\vec{B}=<c,d>\text{ in }\mathbb{R}^2\text{,}\\ \vec{A}\cdot \vec{B}=ac+bd=\lVert \vec{A}\rVert \lVert \vec{B}\rVert \cdot \cos{\theta}&=\sqrt{\left(a^2+b^2\right)\left(c^2+d^2\right)}\cdot \cos{\theta}\\ \left(ac+bd\right)^2=&\left(a^2+b^2\right)\left(c^2+d^2\right)\cdot \cos^2{\theta}\\ \because \cos{\theta}\in[-1,1]\Rightarrow&\cos^2{\theta}\in[0,1]\\ \therefore \left(ac+bd\right)^2\leq &\left(a^2+b^2\right)\left(c^2+d^2\right)\\ \end{align}\]
  • Extended Cauchy-Schwarz inequality
\[\begin{align} \forall \vec{A}=<a_1,\ldots,a_n>&\text{, }\vec{B}=<b_1,\ldots,b_n>\text{ in }\mathbb{R}^n\text{,}\\ \vec{A}\cdot \vec{B}=\sum_{i=1}^na_i\cdot b_i&=\sqrt{\sum_{i=1}^na_i^2 \cdot\sum_{i=1}^n b_i^2}\cdot \cos{\theta}\\ \left(\sum_{i=1}^na_i\cdot b_i\right)^2&=\sum_{i=1}^na_i^2 \cdot\sum_{i=1}^n b_i^2\cdot \cos^2{\theta}\\ \because \cos{\theta}\in[-1,1]\Rightarrow&\cos^2{\theta}\in[0,1]\\ \therefore \left(\sum_{i=1}^na_i\cdot b_i\right)^2&\leq \sum_{i=1}^na_i^2 \cdot\sum_{i=1}^n b_i^2\\ \end{align}\]

Vector projections

  • scalar projection of \(\vec{b}\) to \(\vec{a}\) is \(\mathrm{comp}_a b=l=\lVert \vec{b} \rVert\cdot \cos{\theta}=\frac{\vec{a}\cdot \vec{b}}{\lVert \vec{a} \rVert}\)

    orthogonal decomposition of \(\vec{b}\) on direction of \(\vec{a}\)

  • vector projection of \(\vec{b}\) to \(\vec{a}\) is \(\mathrm{proj}_a b=l\cdot\hat{i}=\left( \frac{\vec{a}\cdot\vec{b}}{\lVert\vec{a}\rVert} \right)\cdot \frac{\vec{a}}{\lVert \vec{a} \rVert}=\mathrm{comp}_a b\, \cdot \frac{\vec{a}}{\lVert \vec{a} \rVert}\)

    vector at direction of \(\vec{a}\) with length \(\mathrm{comp}_a b\)


Vector cross product

  • \(\vec{a}\times\vec{b}=\begin{vmatrix}\hat{i} & \hat{j} & \hat{k}\\ a_1 & a_2 & a_3\\ b_1 & b_2 & b_3\\ \end{vmatrix}=\vec{c}=-\vec{b}\times\vec{a}\) is cross product of 2 vectors in \(\mathbb{R}^3\) or \(\mathbb{R}^7\), \(\vec{c}\) is perpendicular to the plane of \(\vec{a}\) and \(\vec{b}\) and follows right-hand rule, length of vector \(\lVert \vec{c}\rVert=\lVert\vec{a}\times\vec{b}\rVert=\lVert\vec{a}\rVert\lVert\vec{b}\rVert\cdot\sin{\theta}\), \(\mathbf{\vec{a}\times\vec{a}=0}\)
  • parallel vectors have \(\theta=0,\sin{\theta}=0\Rightarrow\vec{a}\times\vec{b}=0\)
  • \(\vec{a}\cdot(\vec{b}\times\vec{c})=\begin{vmatrix} a_1 & a_2 & a_3\\ b_1 & b_2 & b_3\\ c_1 & c_2 & c_3\\ \end{vmatrix}=(\vec{a}\cdot\vec{c})\cdot\vec{b}-(\vec{a}\cdot\vec{b})\cdot\vec{c}\) is triple product of 3 vectors in \(\mathbb{R}^3\) or \(\mathbb{R}^7\)

Areas of triangle and parallelogram

\[S_{\mathrm{para}}=2S_\triangle=l\cdot \lVert b\rVert=\lVert\vec{a}\rVert\lVert\vec{b}\rVert\cdot\sin{\theta}=\lVert\vec{a}\times\vec{b}\rVert\]

Volume of parallelepiped

\[V=h\cdot A=\lVert \vec{a}\cdot(\vec{b}\times\vec{c})\rVert\]
<
Blog Archive
Archive of all previous blog posts
>
Next Post
SAT Test-taking Experience at St. Joseph University, Macau