.. _sphx_glr_auto_examples_gradient-based-offpolicy:

Gradient-based off-policy learning agents
-----------------------------------------

The following example showcases how to use gradient-based Reinforcement Learning
techniques (in particular, Q-learning) to train a Model Predictive Controller (MPC)
scheme for a simple task in an off-policy way.



.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example tries to reproduce the results from the linear MPC numerical experiment in gros_datadriven_2020, but in an off-polic setting. We are given an RL environment whose cost function is">

.. only:: html

  .. image:: /auto_examples/gradient-based-offpolicy/images/thumb/sphx_glr_q_learning_offpolicy_thumb.png
    :alt:

  :ref:`sphx_glr_auto_examples_gradient-based-offpolicy_q_learning_offpolicy.py`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Off-policy Q-learning</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /auto_examples/gradient-based-offpolicy/q_learning_offpolicy