Generalisations of the Ornstein-Uhlenbeck process defined through Langevin equations, such as fractional Ornstein-Uhlenbeck processes, have recently received a lot of attention. However, most of the literature focuses on the one dimensional case with Gaussian noise. In particular, estimation of the unknown parameter is widely studied under Gaussian stationary increment noise. In this article, we consider estimation of the unknown model parameter in the multidimensional version of the Langevin equation, where the parameter is a matrix and the noise is a general, not necessarily Gaussian, vector-valued process with stationary increments. Based on algebraic Riccati equations, we construct an estimator for the parameter matrix. Moreover, we prove the consistency of the estimator and derive its limiting distribution under natural assumptions. In addition, to motivate our work, we prove that the Langevin equation characterises essentially all multidimensional stationary processes.