High-dimensional and dependent data with additional structure