Reinforcement Learning -- 2

I want an algorithm which is a hybrid approach of Model Base and Model Free. Model Base in Reinforcement Learning - I want to use Gaussian Smoothening. Model Free , I would use TRPO.

Also , you should identify the hybrid function where the cost calculation of the MB and the Probabilistic approach of MF is applied