Advancing Probabilistic Models For Approximate And Exact Inference