عنوان

Data-Driven Control with Learned Dynamics

شماره

TLpq2444855802

زبان متن نوشتاري يا گفتاري و مانند آن

انگلیسی

عنوان اصلي

Data-Driven Control with Learned Dynamics

نام عام مواد

[Thesis]

نام نخستين پديدآور

Hao, Wenjian

نام ساير پديدآوران

Han, Yiqiang

نام ناشر، پخش کننده و غيره

Clemson University

تاریخ نشرو بخش و غیره

2020

نام خاص و کميت اثر

85

جزئيات پايان نامه و نوع درجه آن

M.S.

کسي که مدرک را اعطا کرده

Clemson University

امتياز متن

2020

متن يادداشت

This research focuses on studying data-driven control with dynamics that are actively learned from machine learning algorithms. With system dynamics being identified using neural networks either explicitly or implicitly, we can apply control following either a model-based approach or a model-free approach. In this thesis, the two different methods are explained in detail and finally compared to shed light on the emerging data-driven control research field. In the first part of the thesis, we first introduce state-of-art Reinforcement Learning (RL) algorithm representing data-driven control using a model-free learning approach. We discuss the advantages and shortcomings of the current RL algorithms and motivate our study to search for a model-based control which is physics-based and also provides better model interpretability. We then propose a novel data-driven, model-based approach for the optimal control of the dynamical system. The proposed approach relies on the Deep Neural Network (DNN) based learning of Koopman operator and therefore is named as Deep Learning of Koopman Representation for Control (DKRC). In particular, DNN is employed for the data-driven identification of basis function used in the linear lifting of nonlinear control system dynamics. One a linear representation of system dynamics is learned, we can implement classic control algorithms such as iterative Linear Quadratic Regulator (iLQR) and Model Predictive Control (MPC) for optimal control design. The controller synthesis is purely data-driven and does not rely on prior domain knowledge. The OpenAI Gym environment is used for simulations of various control problems. The method is applied to three classic dynamical systems on OpenAI Gym environment to demonstrate the capability. In the second part, we compare the proposed method with a state-of-art model-free control method based on an actor-critic architecture - Deep Deterministic Policy Gradient (DDPG), which has been proved to be effective in various dynamical systems. Two examples are provided for comparison, i.e., classic Inverted Pendulum and Lunar Lander Continuous Control. We compare these two methods in terms of control strategies and the effectiveness under various initialization conditions from the results of the experiments. We also examine the learned dynamic model from DKRC with the analytical model derived from the Euler-Lagrange Linearization method, demonstrating the accuracy in the learned model for unknown dynamics from a data-driven sample-efficient approach.

موضوع مستند نشده

Computer science

موضوع مستند نشده

Mechanical engineering

مستند نام اشخاص تاييد نشده

Han, Yiqiang

مستند نام اشخاص تاييد نشده

Hao, Wenjian

نام الکترونيکي

فرمت انتشار

p

نوع ماده

[Thesis]

کد کاربرگه

276903

سطح دسترسي

a

تكميل شده

Y