Advanced Intelligent Adaptive Control Systems

"Characteristic" Course (Type B, 8CFU, 64hrs.) in English at the Master Degree LM-32 INGEGNERIA INFORMATICA E DELL'AUTOMAZIONE

CINECA Course Catalogue: Teaching Activity (in English) A.Y. 2024/2025
Google Classroom Course Code: mq55gad (for course enrollment only)
In-Person Lectures in PC Laboratory or Classrooms with PCs

Required Background

Basic concepts of mathematics, differential and integral computation;
knowledge of the basic concepts of Physics;
knowledge of dynamic systems, their behaviour, and their practical application; methods to analyse dynamic systems in steady and transient states;
knowledge of the frequency tools for the analysis of dynamic systems;
ability to analyse and design digital systems.

Main Objectives and Knowledge

Basic nonlinear control and identification techniques for complex processes from a dynamic point of view, considering the information from its input to its output variables
knowledge related to the analysis of nonlinear dynamic systems in steady and transient states and their advanced simulation tools;
knowledge of nonlinear blocks and system identification techniques;
knowledge of the tools to tackle the study of complex systems and their interconnections under the constraints imposed by performances in terms of cost, speed, computational cost, and robustness;
knowledge of the nonlinear mathematical tools for the analysis of nonlinear dynamic systems;
basic knowledge of nonlinear dynamic system software simulation tools;
fundamentals about system identification, neural networks and fuzzy logic for control, nonlinear methods for control, adaptive and learning algorithms, basics of optimization methods and tools, nonlinear prediction and filtering tools;
fundamentals of simulation and control for nonlinear dynamic systems.

Main Skills

Analysis of the behaviour of nonlinear systems in steady and dynamic conditions;
design of nonlinear dynamic and adaptive controllers for a given nonlinear dynamic system to meet proper transient and steady-state constraints;
design the most suitable system identification algorithm for the design of intelligent control solutions using fuzzy systems, neural networks, adaptive systems, nonlinear filters, adaptive schemes, and purely nonlinear prototypes;
identification of the most suitable process model, as well as the most suitable parameters for a specific control design and its application, given its model prototype;
use of simulation numerical programs to analyse nonlinear systems, their stability properties and the control performance.

General Description and Main Goals

The course represents an advanced course of nonlinear and adaptive control for complex systems, and it studies advanced elements of a control and adaptive system from the dynamic point of view, by considering nonlinear dynamic processes from their input-state-output and input-output points of view.
The course thus aims at presenting those adaptive control and data-driven methodologies currently required and expected by modern industries and practical application activities.
The main goal of the course consists of providing advanced topics and tools for the study of adaptation, learning, and control of complex dynamic systems, as well as their interconnections under proper design constraints imposed by cost, speed, computational cost, robustness, reliability, sustainability, and power consumption.

Course Contents

Introduction. Adaptive, intelligent, autonomous, distributed, embedded and cyber-physical systems. Key tools and multidisciplinary techniques for the comprehension, analysis, representation and synthesis of complex physical phenomena. Introduction to adaptive systems and adaptation theory for control.
Basics of optimization tools. Constrained and constrained optimization; gradient method; stochastic approaches; genetic algorithms.
Dynamic system identification. Parametric and nonparametric identification; recursive algorithms for linear system identification; online models and mathematical tools for nonlinear dynamic system identification; adaptive identification and control approaches; adaptive PID and classical controllers.
Fuzzy logic for control. Definitions and properties of fuzzy logic; fuzzy model identification; fuzzy logic for control; fuzzy control: automatic learning and adaptation for fuzzy models; adaptive fuzzy control; ANFIS tool - Adaptive Neuro-Fuzzy Inference System.
Neural Networks. Fundamentals and properties. Algorithms for supervised and unsupervised learning, with application to identification and control of dynamic systems; stochastic search algorithms; recurrent neural networks; adaptive neural networks; convolutional neural networks for identification and control; design of the adaptive neural controller employing the Model Reference Adaptive Control (MRAC) principle.
Computer Aided Hands-on (computer-aided design). Hands-on with the identification of nonlinear dynamic systems, fuzzy logic for control, neural networks, and design of adaptive control schemes.

Teaching Structure (64 Hrs. Total, 8 CFU)

47 hours of lectures on all the course topics;
17 hours of practical exercises in the Informatics Laboratory concerning the analysis and the simulation of nonlinear dynamic systems.
After the guided tutorials the students will have free access to the computer laboratories for additional individual tests and hands-on.

Examination Procedure

A project regarding the simulation and the control design for a nonlinear system using the Matlab and Simulink environments, which aims at understanding if the student has the skills in the analysis and the synthesis of a complex process. To pass this test it is required to get at least 18 points out of 26. The time allowed for this test is 1.5 hours. It is allowed to consult the Matlab and Simulink program manual only.
One test (30 open and multiple choice questions) based on all the topics tackled in the class or on the course's basic concepts, to evaluate how deeply the student has studied the subject and how he can understand the topics analysed. To pass this test it is required to get at least 18 points out of 30. The time allowed for this test is 0.5 hours. It is not allowed to consult any textbook or use any PC, smartphone, or calculator. The test score is obtained by multiplying the number of the correct quizzes (from 0 to 30, and weighted over 30) by 4.
The final mark is the sum of the 2 points achieved from the two tests: up to 26/30 at the project and 4/30 at the quizzes. A further point is assigned if both tests are correct. To pass the exam, you must get at least 18 points out of 30. If the first test fails or if the final mark is below 18, you must repeat all the exam steps.
Passing the exam is proof of having acquired the ability to apply knowledge and the required skills defined in the course training objectives.

Course Material: Lecture Notes, Slides and Recorded Lectures

Lecture 0. 19/09/2024. Course Introduction: Analysis of the course Syllabus and teaching material. Lecture 0 recorded movie (YouTube Channel); Lecture 0 recorded movie (YouTube Channel, in Italian, 36 mins.).
Lecture 1. 19/09/2024. Introduction - General introduction to modelling and system identification. Lecture 1. (Lesson Slides PDF Format, 3.9MB). Lecture 1 recorded movie part 1 (YouTube Channel, 64 mins.); Lecture 1 recorded movie part 2 (YouTube Channel, 21 mins.).
Lecture 2. 20/09/2024. Non-recursive (off-line) system identification methods. Lecture 2. (Lesson Slides PDF Format, 2.5MB). Introduction to Least Squares and Regression Models recorded movie (YouTube Channel, 31 mins.); PEM Scheme recorded movie (YouTube Channel, 48 mins.); IVM Scheme recorded movie (YouTube Channel, 20 mins).
Lecture 2.5. 26/09/2024. Nonparametric Identification. Input Signals for Identification. Identification Conditions. Lecture 2.5. (Lesson Slides PDF Format, 1.4MB). Nonparametric Models (part 1) recorded movie (YouTube Channel, 18 mins.); Lecture 2.5 Input Signals (part 2) recorded movie (YouTube Channel, 42 mins.).
Lecture 3. 30/09/2024. Recursive (on-line) methods. Lecture 3. (Lesson Slides PDF Format, 1.7MB). Lecture 3 recorded movie (YouTube Channel, 55 mins.).
Lecture 3.5. 30/09/2024. Recursive (on-line) methods: 2 application examples in Matlab. Matlab script file 1 for Lecture 3; Matlab script file 2 for Lecture 3; Lecture 3.5 recorded movie (YouTube Channel, 24 mins.).
Lecture 4. 03/10/2024. Prediction Error Methods. Lecture 4. (Lesson Slides PDF Format, 2MB). PEM Estimate Properties (part 1) recorded movie (YouTube Channel, 9 mins.); PEM Estimate Properties (part 2) recorded movie (YouTube Channel, 32 mins.).
Lecture 4.6. 03/10/2024 - 07/10/2024. Model Structure Determination. Model Validation. Lecture 4.6. (Lesson Slides PDF Format, 2.6MB). Model validation (part 1) recorded movie (YouTube Channel, 14 mins.); Model validation (part 2) recorded movie (YouTube Channel, 34 mins.); Model validation (part 3) recorded movie (YouTube Channel, 53 mins.).
Lecture 5. 07/10/2024. Final Remarks. An Application Example with the System Identification Toolbox of Matlab. Lecture 5. (Lesson Slides PDF Format, 6.5MB). Lecture 5 recorded movie (YouTube Channel, 41 mins).
Lecture 6. 09/10/2024. Final Remarks on System Identification and Data Analysis. Lecture 6. (Lesson Slides PDF Format, 2.8MB). Lecture 6 recorded movie (YouTube Channel, 40 mins).
Lecture 6.5. 09/10/2024 - 14/10/2024. The System IDentification Toolbox by MathWorks. Tutorial from MathWorks Website. Webinar by Lennart Ljung (YouTube, 46 mins); Lecture 6.5 offline recorded movie 2023 (YouTube Channel, 45 mins.); SID Toolbox Introduction recorded movie 2024 part 1 (YouTube Channel, 12 mins.); SID Toolbox recorded movie 2024 part 2 (YouTube Channel, 40 mins.); SID Toolbox recorded movie 2024 part 3 (YouTube Channel, 25 mins.);
Lecture 7. 14/10/2024. Control Refresher. Lecture 7. (Lesson Slides PDF Format, 232kB). Lecture 7. (Lesson Slides PDF Format, 2.8MB). Control Refresher recorded movie part 1 (YouTube Channel, 19 mins.); Control Refresher recorded movie part 2 (YouTube Channel, 17 mins.).
Lecture 8. 21/10/2024 - 6/11/2024. Introduction to Fuzzy Logic and Fuzzy Control. Lecture 8. (Lesson Slides PDF Format, 386kB). Lecture 8 - Introduction to Fuzzy Logic (part 1) recorded movie (YouTube Channel, 41 mins.); Recorded movie part 2 (YouTube Channel, 45 mins.); Recorded movie part 3 (YouTube Channel, 42 mins.).
Lecture 9. 11/11/2024 - 13/11/2024 - 18/11/2024. Fundamentals of Fuzzy Control. Lecture 9. (Lesson Slides PDF Format, 1.2MB). Lecture 9 - Introduction to Fuzzy Control (part 1) recorded movie (YouTube Channel, 15 mins); Lecture 9 - Data-Driven Fuzzy Control (part 2) recorded movie (YouTube Channel, 41 mins); Lecture 9 - Examples of Fuzzy Clustering (part 3) recorded movie (YouTube Channel, 34 mins); Lecture 9 - Examples of Designs of Fuzzy Models (part 4) recorded movie (YouTube Channel, 25 mins); Lecture 9 - Examples of Designs of Fuzzy Controllers (part 5) recorded movie (YouTube Channel, 31 mins).
Lecture 10. 18/11/2024. Fundamentals of Model-Based Control. Lecture 10. (Lesson Slides PDF Format, 240kB); Lecture 10 - Overview of Model-Based and Data-Driven Control Techniques recorded movie (part 1) (YouTube Channel, 15 mins); recorded movie (part 2) (YouTube Channel, 42 mins).
Lecture 11. 20/11/2024. Introduction to Artificial Neural Networks for Control. Lecture 11. (Lesson Slides PDF Format, 1.2MB); Lecture 11 - Introduction to Machine Learning and Neural Networks (part 1) recorded movie (YouTube Channel, 48 mins); Lecture 11 - Fundamentals of Deep Learning and Neural Network Training (part 2) recorded movie (YouTube Channel, 17 mins).
Lecture 12. 25/11/2024. Artificial Neural Networks for Control and Convolutional Architectures. Lecture 12. (Lesson Slides PDF Format, 4.5MB); Lecture 12 - Neural Network Regularization (part 1) recorded movie (YouTube Channel, 50 mins); Lecture 12 - Fundamentals of Deep Neural Networks and Reinforcement Learning (part 2) recorded movie (YouTube Channel, 24 mins).
Lecture 13. 25/11/2024. Remarks and Application Examples. Lecture 13. (Lesson Slides PDF Format, 6.4MB); Lecture 13 - Examples of design of fuzzy regulators for different processes offline recorded movie (YouTube Channel).
Lecture 14. 25/11/2024. Fuzzy Models and Neural Networks for Control: Fuzzy Clustering, and Neural Design Examples. Lecture 14. (Lesson Slides PDF Format, 2.8MB); Lecture 14 - Notes on the design of dynamic fuzzy systems and neural networks for control offline recorded movie (YouTube Channel); Lecture 14 - Classroom recorded movie (YouTube Channel, 13 mins).

General Application Examples and Control Design Cases

14/10/2024 - 16/10/2024 - 21/10/2024. Real Chemical SISO Process (CSTR, Prof. Robert Babuska, 1998) and Examples of Controller Designs (PID, MPC). (zipped folder .zip); (.txt file with a few details). Complete offline movie (YouTube Channel, 72 mins.). Example of identification of ARX models and design of PID/MPC controllers recorded movie part 1 (YouTube Channel, 25 mins.); recorded movie part 2 (YouTube Channel, 37 mins.); recorded movie part 3 (YouTube Channel, 40 mins.).
16/10/2024. Recursive Estimation for Linear Varying Parameters of a Dynamic Process: Matlab and Simulink Solutions. Implementation of the RLS algorithm with forgetting factor (example); Matlab script for result display; Simulink file for data generation with linear varying parameters; RLS Simulink block and data generation; Offline movie (YouTube Channel, 21 mins.). Recursive estimation example of ARX models recorded movie (YouTube Channel, 22 mins.).
16/10/2024. Example of a Simple Adaptive PID Controller. Compressed folder with files used in the simulations (.zip file); Offline movie (YouTube Channel, 14 mins.). Design example of an Adaptive PID Controller Example recorded movie (YouTube Channel, 21 mins.).
11/11/2024. Example of a Simple Adaptive PID Controller. Example in Matlab Online and Simulink. Lecture recorded movie (YouTube Channel, 28 mins.).
18/11/2024. Example of Fuzzy c-means Algorithm for Fuzzy Clustering. Fuzzy c-means Matlab function; 2D fuzzy clustering example; 3D fuzzy clustering example; Zipped folder with the files (.zip file). Lecture recorded movie (YouTube Channel, 87 mins.).
20/11/2024. Examples of Adaptive Neuro-Fuzzy Inference System - ANFIS and NN for Dynamic Process Modelling: Chemical Reactor Case Study. Compressed folder with files used in the simulations (.zip file); Neural network and fuzzy system for the approximation of a dynamic nonlinear process recorded movie (YouTube Channel).
27/11/2024 - 02/12/2024. Design of a Reference Model and Training of the Neural Controller for the Chemical Reactor Case. Reference Model Design: compressed folder with files used in the simulations (.zip file). Design of the Reference Model offline recorded movie (YouTube Channel, 44 mins). Design of the linear model recorder movie - part 1 (YouTube Channel, 48 mins); design of the neural and fuzzy systems recorded movie - part 2 (YouTube Channel, 6 mins); design of the nonlinear model recorded movie - part 3 (YouTube Channel, 27 mins). Data Augmentation example for Reference Model design: compressed folder with files used in the simulations - part 2 (.zip file); Design of the Neural Controller offline recorded movie - part 2 (YouTube Channel, 37 mins); Neural controller design from the reference model: compressed folder with files used in the simulations - part 3 (.zip file); Neural Controller Design from Reference Model offline recorded movie - part 3 (YouTube Channel, 26 mins).
Design of an Adaptive Reference Model for the Training of Intelligent Controllers Applied to a Directional Antenna Nonlinear Process. Files for the Design of the Reference Model and the Intelligent Controllers (.zip file); Design of the Linear Model and the RLS with FF Solutions - part 1 (YouTube Channel); Derivation of the Neural Model of the Process - part 2 (YouTube Channel); Estimation of the Fuzzy Model of the Process - part 3 (YouTube Channel); Design of the Intelligent Controller with Neural Networks - part 4 (YouTube Channel); Design of the Intelligent Controller with the Fuzzy Models - part 5 (YouTube Channel); Derivation of the Intelligent Controller and Final Validation - part 6 (YouTube Channel).
Exam Example (PC Project + Quizzes). Compressed folder with the files used for the exam (.zip file); Example of 7 quizzes of the exam test (Google form).

Matlab and Simulink Basic Docs

K. Sigmon, "Matlab Primer". University of Florida, Florida, Second Edition ed., 1993. (PDF format file).
"Matlab Tutorial", Getting Started with MATLAB. (PDF format file).
Simulink Main Features, "SIMULINK. Dynamic System Simulation for MATLAB". (PDF format file).
Simulink for Dynamic System Modelling. Dynamic System Simulation for MATLAB and SIMULINK. (PDF format file).
Simulink Basic Features. SIMULINK for Beginners. (PDF format file).

References and Textbooks

Applied nonlinear control, J.J. Slotine, W. Li. - Prentice Hall, 1991.
A Course in Fuzzy Systems and Control, L.-X. Wang - Prentice Hall, 1997.
Neural Networks for Identification, Prediction, and Control, D.T. Pham and X. Liu - Springer Verlag, 1995.
Model-based Fault Diagnosis in Dynamic Systems Using Identification Techniques, S. Simani, C. Fantuzzi, R. J. Patton - Springer, 2003.
Robust and Adaptive Control with Aerospace Applications, E. Lavretsky, K. A. Wise, Springer-Verlag, London, 2013
Adaptive Control. Second Edition, K. J. Astrom,, B. Wittenmark, Addison Wesley, 1995
System Identification, T. Soderstrom, P. Stoica, Prentice Hall International, Cambridge, 1989
Adaptive Control. Algorithms, Analysis and Applications, I. D. Landau, R. Lozano, M. M'Saad, A. Karimi, Springer, London, 2011
Stable Adaptive Systems, K. S. Narendra, A. M. Annaswamy, Dover Publications, New York, 2005
Robust Adaptive Control, P. Ioannou, J. Sun, Dover Publications, New York, 2012
Adaptive Control Tutorial, P. Ioannou, B. Fidan, Advances in Design and Control, SIAM, Philadelphia 2006

Simani Home Page

Dipartimento di Ingegneria