The inverse of a Matrix Transformation is a matrix that reverses the transformation.
For example, if our matrix transform did a 90° anticlockwise rotation, the inverse matrix would do a 90° clockwise rotation.

We represent the inverse of a matrix A as A−1.
When you multiply a matrix by its inverse, you get the Identity Matrix back: A⋅A−1=I
It's the equivalent of the reciprocal of a number in scalar math, ie 10∗101​=1 or 10⋅10−1=1
For a 2×2 matrix, we calculate the inverse as follows:
[ac​bd​]−1=ad−bc1​[d−c​−ba​]
For example:
[12​34​]−1=1×4−3×21​[4−2​−31​]=−21​[4−2​−31​]=[−21​1.5−0.5​]
We can do a matrix multiplication to confirm the identity matrix is returned:
[12​34​][−21​1.5−0.5​]=[10​01​]
We can also use the np.linalg.inv method in Numpy to find the inverse.
{% notebook permanent/notebooks/matrix-inverse.ipynb %}
The ad−bc part of the expression is the Matrix Determinate.
For a larger matrix, we can use Gaussian Elimination to invert a matrix.
(Dye et al., 2018)
A matrix with a determinate of 0: ∣A∣=0 is referred to as a Singular Matrix and has no inverse.
We can only calculate the inverse of a square matrix.
(KhanAcademyLabs, 2008)
References
David Dye, Sam Cooper, and Freddie Page.
Mathematics for Machine Learning: Linear Algebra - Home.
2018. ↩
Khan Academy Labs.
Introduction to matrix inverses.
June 2008. ↩