Linear Algebra review:

• Vectors
• matrix-vector multiplication
• matrix-matrix multiplication
• vector norms
• vector similarity
• Euclidian distance/ euclidian norm when $l_2$ is used
• linear independence
• Matrix rank
• Eigenvalues and eigenvector
• Matrix norm
• Othogonality
• Positive (Semi)-Definite
• Matrix Derivatives