If you do Gauss-Jordan elimination to find the inverse of you will get
Determinant of is . This also happens to be the denominator of every term in inverse above. So now you know where determinant comes from. It is the denominator that results when you Gaus Jordan elimination on any square matrix.