Publications - Learning and learning-based methods

Bart De Schutter

Note: If the pdf file (pdf) of the technical report that corresponds to a given publication is available, then this is indicated at the end of the entry for that publication. More information on the pdf file format can be found here. Hardcopies of the papers can also be requested by contacting me.



  1. J. Lago, E. Sogancioglu, G. Suryanarayana, F. De Ridder, and B. De Schutter, "Building day-ahead bidding functions for seasonal storage systems: A reinforcement learning approach," Proceedings of the IFAC Workshop on Control of Smart Grid and Renewable Energy Systems (CSGRES 2019), Jeju, Republic of Korea, pp. 488-493, June 2019.  (online paperbibtex)

  2. J. Lago, F. De Ridder, and B. De Schutter, "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, vol. 221, pp. 386-405, July 2018.  (online paperabstractbibtex)

  3. F. Ruelens, B.J. Claessens, S. Quaiyum, B. De Schutter, R. Babuska, and R. Belmans, "Reinforcement learning applied to an electric water heater: From theory to practice," IEEE Transactions on Smart Grid, vol. 9, no. 4, pp. 3792-3800, 2018.  (online paperabstractbibtex)

  4. F. Ruelens, B.J. Claessens, S. Vandael, B. De Schutter, R. Babuska, and R. Belmans, "Residential demand response of thermostatically controlled loads using batch reinforcement learning," IEEE Transactions on Smart Grid, vol. 8, no. 5, pp. 2149-2159, Sept. 2017.  (online paperabstractbibtextech. rep. (pdf))

  5. L. Busoniu, A. Lazaric, M. Ghavamzadeh, R. Munos, R. Babuska, and B. De Schutter, "Least-squares methods for policy iteration," in Reinforcement Learning: State-Of-The-Art (M. Wiering and M. van Otterlo, eds.), vol. 12 of Adaptation, Learning, and Optimization, Heidelberg, Germany: Springer, ISBN 978-3-642-27644-6, pp. 75-109, 2012.  (online versionabstractbibtextech. rep. (pdf))

  6. J. van Ast, R. Babuska, and B. De Schutter, "Convergence analysis of ant colony learning," Proceedings of the 18th IFAC World Congress, Milan, Italy, pp. 14693-14698, Aug.-Sept. 2011.  (online paperabstractbibtextech. rep. (pdf))

  7. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Approximate reinforcement learning: An overview," Proceedings of the 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2011), Paris, France, pp. 1-8, Apr. 2011.  (abstractbibtextech. rep. (pdf))

  8. L. Busoniu, R. Munos, B. De Schutter, and R. Babuska, "Optimistic planning for sparsely stochastic systems," Proceedings of the 2011 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2011), Paris, France, pp. 48-55, Apr. 2011.  (abstractbibtextech. rep. (pdf))

  9. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Cross-entropy optimization of control policies with adaptive basis functions," IEEE Transactions on Systems, Man and Cybernetics, Part B: Cybernetics, vol. 41, no. 1, pp. 196-209, Feb. 2011.  (online paperabstractbibtextech. rep. (pdf))

  10. J. van Ast, R. Babuska, and B. De Schutter, "Generalized pheromone update for ant colony learning in continuous state spaces," Proceedings of the 2010 IEEE Congress on Evolutionary Computation (CEC 2010), Barcelona, Spain, pp. 2617-2624, July 2010.  (abstractbibtextech. rep. (pdf))

  11. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Online least-squares policy iteration for reinforcement learning control," Proceedings of the 2010 American Control Conference, Baltimore, Maryland, pp. 486-491, June-July 2010.  (abstractbibtextech. rep. (pdf))

  12. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Approximate dynamic programming with a fuzzy parameterization," Automatica, vol. 46, no. 5, pp. 804-814, May 2010.  (online paperabstractbibtextech. rep. (pdf))

  13. L. Busoniu, B. De Schutter, R. Babuska, and D. Ernst, "Using prior knowledge to accelerate online least-squares policy iteration," Proceedings of the 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR 2010), Cluj-Napoca, Romania, 6 pp., May 2010. Paper A-S2-1/3005.  (abstractbibtextech. rep. (pdf))

  14. L. Busoniu, R. Babuska, and B. De Schutter, "Multi-agent reinforcement learning: An overview," Chapter 7 in Innovations in Multi-Agent Systems and Applications - 1 (D. Srinivasan and L.C. Jain, eds.), vol. 310 of Studies in Computational Intelligence, Berlin, Germany: Springer, pp. 183-221, 2010.  (online versionabstractbibtextech. rep. (pdf))

  15. L. Busoniu, R. Babuska, B. De Schutter, and D. Ernst, Reinforcement Learning and Dynamic Programming Using Function Approximators. Boca Raton, Florida: CRC Press, ISBN 978-1-4398-2108-4, 270 pp., 2010.  (online linkbibtex)

  16. L. Busoniu, B. De Schutter, and R. Babuska, "Approximate dynamic programming and reinforcement learning," in Interactive Collaborative Information Systems (R. Babuska and F.C.A. Groen, eds.), vol. 281 of Studies in Computational Intelligence, Berlin, Germany: Springer, ISBN 978-3-642-11687-2, pp. 3-44, 2010.  (online versionabstractbibtextech. rep. (pdf))

  17. L. Busoniu, B. De Schutter, R. Babuska, and D. Ernst, "Exploiting policy knowledge in online least-squares policy iteration: An empirical study," Automation, Computers, Applied Mathematics, vol. 19, no. 4, pp. 521-529, 2010.  (abstractbibtextech. rep. (pdf))

  18. J.M. van Ast, R. Babuska, and B. De Schutter, "Ant colony learning algorithm for optimal control," in Interactive Collaborative Information Systems (R. Babuska and F.C.A. Groen, eds.), vol. 281 of Studies in Computational Intelligence, Berlin, Germany: Springer, ISBN 978-3-642-11687-2, pp. 155-182, 2010.  (online versionabstractbibtextech. rep. (pdf))

  19. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Policy search with cross-entropy optimization of basis functions," Proceedings of the 2009 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning (ADPRL 2009), Nashville, Tennessee, pp. 153-160, Mar.-Apr. 2009.  (abstractbibtextech. rep. (pdf))

  20. Z. Lukszo, M.P.C. Weijnen, R.R. Negenborn, and B. De Schutter, "Tackling challenges in infrastructure operation and control: Cross-sectoral learning for process and infrastructure engineers," International Journal of Critical Infrastructures, vol. 5, no. 4, pp. 308-322, 2009.  (online paperabstractbibtextech. rep. (pdf))

  21. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Fuzzy partition optimization for approximate fuzzy Q-iteration," Proceedings of the 17th IFAC World Congress, Seoul, Korea, pp. 5629-5634, July 2008.  (online paperabstractbibtextech. rep. (pdf))

  22. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Consistency of fuzzy model-based reinforcement learning," Proceedings of the 2008 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2008), Hong Kong, pp. 518-524, June 2008.  (abstractbibtextech. rep. (pdf))

  23. L. Busoniu, R. Babuska, and B. De Schutter, "A comprehensive survey of multi-agent reinforcement learning," IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 38, no. 2, pp. 156-172, Mar. 2008.  (online paperabstractbibtextech. rep. (pdf))

  24. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Continuous-state reinforcement learning with fuzzy approximation," in Adaptive Agents and Multi-Agent Systems III. Adaptation and Multi-Agent Learning (K. Tuyls, A. Nowé, Z. Guessoum, and D. Kudenko, eds.), vol. 4865 of Lecture Notes in Computer Science, Berlin, Germany: Springer, ISBN 978-3-540-77947-6, pp. 27-43, 2008.  (online versionabstractbibtextech. rep. (pdf))

  25. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Fuzzy approximation for convergent model-based reinforcement learning," Proceedings of the 2007 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2007), London, UK, pp. 968-973, July 2007.  (abstractbibtextech. rep. (pdf))

  26. L. Busoniu, D. Ernst, B. De Schutter, and R. Babuska, "Continuous-state reinforcement learning with fuzzy approximation," Proceedings of the 7th Annual Symposium on Adaptive and Learning Agents and Multi-Agent Systems (ALAMAS 2007) (K. Tuyls, S. de Jong, M. Ponsen, and K. Verbeeck, eds.), Maastricht, The Netherlands, pp. 21-35, Apr. 2007.  (abstractbibtextech. rep. (pdf))

  27. L. Busoniu, R. Babuska, and B. De Schutter, "Multi-agent reinforcement learning: A survey," Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision (ICARCV 2006), Singapore, pp. 527-532, Dec. 2006.  (abstractbibtextech. rep. (pdf))

  28. L. Busoniu, B. De Schutter, and R. Babuska, "Decentralized reinforcement learning control of a robotic manipulator," Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision (ICARCV 2006), Singapore, pp. 1347-1352, Dec. 2006.  (abstractbibtextech. rep. (pdf))

  29. R. Babuska, L. Busoniu, and B. De Schutter, "Reinforcement learning for multi-agent systems," Tech. rep. 06-041, Delft Center for Systems and Control, Delft University of Technology, 7 pp., July 2006. Paper for a keynote presentation at the 11th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA 2006), Prague, Czech Republic, Sept. 2006.  (abstractbibtexreport (pdf))

  30. L. Busoniu, B. De Schutter, and R. Babuska, "Learning and coordination in dynamic multiagent systems," Tech. rep. 05-019, Delft Center for Systems and Control, Delft University of Technology, Delft, The Netherlands, 98 pp., Oct. 2005.  (abstractbibtexreport (pdf))

  31. L. Busoniu, B. De Schutter, and R. Babuska, "Multiagent reinforcement learning with adaptive state focus," Proceedings of the 17th Belgium-Netherlands Conference on Artificial Intelligence (BNAIC 2005) (K. Verbeeck, K. Tuyls, A. Nowé, B. Manderick, and B. Kuijpers, eds.), Brussels, Belgium, pp. 35-42, Oct. 2005.  (abstractbibtextech. rep. (pdf))

  32. R.R. Negenborn, B. De Schutter, M.A. Wiering, and J. Hellendoorn, "Experience-based model predictive control using reinforcement learning," Proceedings of the 8th TRAIL Congress 2004 - A World of Transport, Infrastructure and Logistics - CD-ROM, Rotterdam, The Netherlands, 18 pp., Nov. 2004.  (abstractbibtextech. rep. (pdf))



Go to the publications overview page.
Go to the page with bibtex entries of all publications.
Visit my home page.


This page is maintained by Bart De Schutter. Last update: January 6, 2020.