Latent Space Tracking from Heterogeneous Data with an Application for Anomaly Detection