Home > Research > Publications & Outputs > Approximate Policy Iteration (API) with neural ...

Electronic data

  • 2019frimpongmscbyresearch

    Final published version, 784 KB, PDF document

    Available under license: CC BY-NC-ND: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Text available via DOI:

View graph of relations

Approximate Policy Iteration (API) with neural networks for the generalized single node energy storage problem

Research output: ThesisMaster's Thesis

Published
  • Richlove Frimpong
Close
Publication date2019
Number of pages87
QualificationMasters by Research
Awarding Institution
Supervisors/Advisors
Publisher
  • Lancaster University
<mark>Original language</mark>English

Abstract

Energy storage problems are hard sequential decision-making problems often modelled as markov decision processes. Exact solution using dynamic programming quickly becomes implausible with large state spaces hence approximate dynamic programming using policy iteration (API) is often employed in such cases. API does not always work, one reason being that the approximation architectures used are often linear for computational tractability reasons. We propose a mathematical model which allows easier implementation of non-linear approximations with API. We use neural networks along with monte-carlo simulation to predict the future values for the generated states during the improvement step of the API algorithm. Our initial experiments suggest that the proposed method provides good results which can be further improved with more fine tuning of the neural network parameters.