For each combination of covariates I expect that there could be a different set of transition probabilities. One could model them with a simple classification algorithm, but I am not sure how I would be able to evaluate the whole vector of probabilities for each single entry of the system.

Was not aware of it. Will have a look! Thanks for the suggestion.