A Novel Task Provisioning Approach Fusing Reinforcement Learning for Big Data

• Published in: IEEE access Vol. 7; pp. 143699 - 143709
• Main Authors: Cheng, Yongyi, Xu, Gaochao
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Artificial neural networks; Big Data; Cloud computing; fat-tree; Large-scale tasks; Load management; Machine learning; Mapping; Markov processes; Multiagent systems; Nodes; Optimization; Provisioning; Reinforcement learning; Resource conservation; Resource management; Response time (computers); Swarm intelligence; Task analysis; Topology; two-phase optimization

The large-scale tasks processing for big data using cloud computing has become a hot research topic. Most of previous work on task processing is directly customized and achieved through existing methods. It may result in relatively more system response time, high algorithm complexity and resource wa...