Since 18 of December 2019 conferences.iaea.org uses Nucleus credentials. Visit our help pages for information on how to Register and Sign-in using Nucleus.

28 November 2023 to 1 December 2023
IAEA Headquarters
Europe/Vienna timezone
Workshop programme now available

Bayesian optimization for efficient parameter space coverage with computationally demanding simulations in fusion energy applications

29 Nov 2023, 09:50
35m
Conference Room 1 (CR1), C Building, 2nd floor (IAEA Headquarters)

Conference Room 1 (CR1), C Building, 2nd floor

IAEA Headquarters

Invited AI

Speaker

Aaro Järvinen (VTT)

Description

Magnetic confinement fusion research is characterized by computationally demanding physics models with a selection of uncertain, phenomenological input parameters. Rigorous usage of such models for predictive or interpretative applications requires a thorough inverse uncertainty quantification (UQ) for these input parameters [1]. Bayesian inference (BI) algorithms provide a principled approach to quantify the uncertainty, as a probability distribution, for the state of the investigated system or hypothesis validity, given the available information [2]. When operating with computationally costly models, data-efficiency is key to maximizing the information gain in establishing this probability distribution. Such efficiency can be achieved by combining “Bayesian optimization” (BO) with the overall BI task. BO is a powerful framework for data-efficient global optimization of costly, non-convex functions, without access to first- or second-order derivatives [3]. On the one hand, BO uses BI to build a statistical approximation in the space of functions that represents the costly model, leveraging the Bayesian quantification of uncertainty over functions to efficiently refine the approximation where needed. On the other hand, the overall BI task is focused on establishing posterior probability distributions over the uncertain state of the investigated system or hypothesis. Crucially, the overall BI task can be conducted with or without BO, but the application of BO renders the BI task orders of magnitude more data-efficient. For many practical applications in fusion energy research, batch BO is needed [4]. The standard BO algorithms conduct sequential search, where a computationally relatively light to evaluate acquisition function is optimized to recommend the highest utility sample to collect with the computationally demanding model. However, if evaluation of the full model takes longer than a few hours, which is quite typical in fusion research applications, the overall optimization time with a sequential approach can easily become unacceptably long. Batch BO can be used to collect several samples in parallel to each other, accelerating the overall optimization task to the throughput levels required for practical applications in fusion energy research. This work discusses BI and BO work performed within or in close connection to the EUROfusion Advanced Computing Hub, hosted by the University of Helsinki (ACH 5). The example applications presented in this work encompass runaway electron simulations [5, 6], scrape-off layer (SOL) plasma simulations, integrated plasma scenario simulations, and tokamak experiment design through BO algorithms [7].
[1] WU, X., et al., Nucl. Eng. Des. 335 (2018) 339-355.
[2] VON TOUSSAINT, U., Rev. Mod. Phys. 83 (2011) 943.
[3] FRAZIER, P.I., A Tutorial on Bayesian Optimization, (2018) arXiv:1807.02811.
[4] HUNT, N., et al., Batch Bayesian Optimization, Thesis: S.M., MIT, 2020.
[5] NARDON, E., et al., Modelling of runaway electron dynamics in tokamak disruptions, Proceedings of 29th IAEA Fusion Energy Conference, 16-21 October, 2023, London, United Kingdom.
[6] JÄRVINEN, A.E., et al., J. Plasma Phys. 88 (2022) 905880612.
[7] CLARTÉ, G., et al. Proceedings of the 4th International Conference on Data-Driven Plasma Science, 16 – 21, April, 2023, Okinawa, Japan.

Speaker's Affiliation VTT Technical Research Centre of Finland
Member State or IGO/NGO Finland

Primary author

Co-authors

Dr Aaron Ho (DIFFER) Adam Kit (Helsinki University) Dr Ayush Bharti (Aalto University) Dr Chirag Furia (Brown University) Mr Emil Amnell (University of Helsinki) Eric Nardon (CEA) Dr Gregoire Clarte (University of Helsinki) Prof. Luigi Acerbi (University of Helsinki) Mathias Hoppe (KTH) Randy Churchill (Princeton Plasma Physics Laboratory) Dr Scott Silburn (UKAEA) Prof. Tünde Fülöp (Chalmers University of Technology)

Presentation materials