Home > Research > Publications & Outputs > Reinforcement learning in blockchain-enabled II...

Links

Text available via DOI:

View graph of relations

Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published

Standard

Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges. / Jameel, F.; Javaid, U.; Khan, W.U. et al.
In: Sustainability, Vol. 12, No. 12, 5161, 24.06.2020.

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Harvard

Jameel, F, Javaid, U, Khan, WU, Aman, MN, Pervaiz, H & Jäntti, R 2020, 'Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges', Sustainability, vol. 12, no. 12, 5161. https://doi.org/10.3390/su12125161

APA

Jameel, F., Javaid, U., Khan, W. U., Aman, M. N., Pervaiz, H., & Jäntti, R. (2020). Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges. Sustainability, 12(12), Article 5161. https://doi.org/10.3390/su12125161

Vancouver

Jameel F, Javaid U, Khan WU, Aman MN, Pervaiz H, Jäntti R. Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges. Sustainability. 2020 Jun 24;12(12):5161. doi: 10.3390/su12125161

Author

Jameel, F. ; Javaid, U. ; Khan, W.U. et al. / Reinforcement learning in blockchain-enabled IIoT networks : A survey of recent advances and open challenges. In: Sustainability. 2020 ; Vol. 12, No. 12.

Bibtex

@article{047ee823796742f88ce76737119253fc,
title = "Reinforcement learning in blockchain-enabled IIoT networks: A survey of recent advances and open challenges",
abstract = "Blockchain is emerging as a promising candidate for the uberization of Internet services. It is a decentralized, secure, and auditable solution for exchanging, and authenticating information via transactions, without the need of a trusted third party. Therefore, blockchain technology has recently been integrated with industrial Internet-of-things (IIoT) networks to help realize the fourth industrial revolution, Industry 4.0. Though blockchain-enabled IIoT networks may have the potential to support the services and demands of next-generation networks, the gap analysis presented in this work highlights some of the areas that need improvement. Based on these observations, the article then promotes the utility of reinforcement learning (RL) techniques to address some of the major issues of blockchain-enabled IIoT networks such as block time minimization and transaction throughput enhancement. This is followed by a comprehensive case study where a Q-learning technique is used for minimizing the occurrence of forking events by reducing the transmission delays for a miner. Extensive simulations have been performed and the results have been obtained for the average transmission delay which relates to the forking events. The obtained results demonstrate that the Q-learning approach outperforms the greedy policy while having a reasonable level of complexity. To further develop the blockchain-enabled IIoT networks, some future research directions are also documented. While this article highlights the applications of RL techniques in blockchain-enabled IIoT networks, the provided insights and results could pave the way for rapid adoption of blockchain technology.",
keywords = "Blockchain, Industrial internet-of-things (IIoT), Industry 4.0, Q-learning, Reinforcement learning (RL), data mining, innovation, Internet, machine learning, technological development, technology adoption",
author = "F. Jameel and U. Javaid and W.U. Khan and M.N. Aman and H. Pervaiz and R. J{\"a}ntti",
year = "2020",
month = jun,
day = "24",
doi = "10.3390/su12125161",
language = "English",
volume = "12",
journal = "Sustainability",
issn = "2071-1050",
publisher = "MDPI AG",
number = "12",

}

RIS

TY - JOUR

T1 - Reinforcement learning in blockchain-enabled IIoT networks

T2 - A survey of recent advances and open challenges

AU - Jameel, F.

AU - Javaid, U.

AU - Khan, W.U.

AU - Aman, M.N.

AU - Pervaiz, H.

AU - Jäntti, R.

PY - 2020/6/24

Y1 - 2020/6/24

N2 - Blockchain is emerging as a promising candidate for the uberization of Internet services. It is a decentralized, secure, and auditable solution for exchanging, and authenticating information via transactions, without the need of a trusted third party. Therefore, blockchain technology has recently been integrated with industrial Internet-of-things (IIoT) networks to help realize the fourth industrial revolution, Industry 4.0. Though blockchain-enabled IIoT networks may have the potential to support the services and demands of next-generation networks, the gap analysis presented in this work highlights some of the areas that need improvement. Based on these observations, the article then promotes the utility of reinforcement learning (RL) techniques to address some of the major issues of blockchain-enabled IIoT networks such as block time minimization and transaction throughput enhancement. This is followed by a comprehensive case study where a Q-learning technique is used for minimizing the occurrence of forking events by reducing the transmission delays for a miner. Extensive simulations have been performed and the results have been obtained for the average transmission delay which relates to the forking events. The obtained results demonstrate that the Q-learning approach outperforms the greedy policy while having a reasonable level of complexity. To further develop the blockchain-enabled IIoT networks, some future research directions are also documented. While this article highlights the applications of RL techniques in blockchain-enabled IIoT networks, the provided insights and results could pave the way for rapid adoption of blockchain technology.

AB - Blockchain is emerging as a promising candidate for the uberization of Internet services. It is a decentralized, secure, and auditable solution for exchanging, and authenticating information via transactions, without the need of a trusted third party. Therefore, blockchain technology has recently been integrated with industrial Internet-of-things (IIoT) networks to help realize the fourth industrial revolution, Industry 4.0. Though blockchain-enabled IIoT networks may have the potential to support the services and demands of next-generation networks, the gap analysis presented in this work highlights some of the areas that need improvement. Based on these observations, the article then promotes the utility of reinforcement learning (RL) techniques to address some of the major issues of blockchain-enabled IIoT networks such as block time minimization and transaction throughput enhancement. This is followed by a comprehensive case study where a Q-learning technique is used for minimizing the occurrence of forking events by reducing the transmission delays for a miner. Extensive simulations have been performed and the results have been obtained for the average transmission delay which relates to the forking events. The obtained results demonstrate that the Q-learning approach outperforms the greedy policy while having a reasonable level of complexity. To further develop the blockchain-enabled IIoT networks, some future research directions are also documented. While this article highlights the applications of RL techniques in blockchain-enabled IIoT networks, the provided insights and results could pave the way for rapid adoption of blockchain technology.

KW - Blockchain

KW - Industrial internet-of-things (IIoT)

KW - Industry 4.0

KW - Q-learning

KW - Reinforcement learning (RL)

KW - data mining

KW - innovation

KW - Internet

KW - machine learning

KW - technological development

KW - technology adoption

U2 - 10.3390/su12125161

DO - 10.3390/su12125161

M3 - Journal article

VL - 12

JO - Sustainability

JF - Sustainability

SN - 2071-1050

IS - 12

M1 - 5161

ER -