A Deep Reinforcement Learning Method for Flexible Job-Shop Scheduling Problem

This paper focuses on the flexible job shop scheduling problem, with the primary optimization goal being the minimization of the maximum completion time. An innovative end-to-end deep reinforcement learning framework is proposed, based on the deep deterministic policy gradient algorithm. The state s...

Full description

Saved in:
Bibliographic Details
Published in2024 5th International Conference on Electronic Communication and Artificial Intelligence (ICECAI) pp. 184 - 188
Main Authors Shao, Changshun, Yu, Zhenglin, Ding, Hongchang, Cao, Guohua
Format Conference Proceeding
LanguageEnglish
Published IEEE 31.05.2024
Subjects
Online AccessGet full text

Cover

Loading…
Abstract This paper focuses on the flexible job shop scheduling problem, with the primary optimization goal being the minimization of the maximum completion time. An innovative end-to-end deep reinforcement learning framework is proposed, based on the deep deterministic policy gradient algorithm. The state space includes six operation features and three machine features. The action space consists of a 3-tuple comprising the job, the operation of the job, and the machine used, catering to both machine selection and operation selection requirements. The reward function is intricately linked to the completion time, accurately reflecting the agent's performance in the scheduling process. Experimental results demonstrate the algorithm's effectiveness in terms of solution quality, showing its ability to find scheduling solutions closer to the global optimal solution.
AbstractList This paper focuses on the flexible job shop scheduling problem, with the primary optimization goal being the minimization of the maximum completion time. An innovative end-to-end deep reinforcement learning framework is proposed, based on the deep deterministic policy gradient algorithm. The state space includes six operation features and three machine features. The action space consists of a 3-tuple comprising the job, the operation of the job, and the machine used, catering to both machine selection and operation selection requirements. The reward function is intricately linked to the completion time, accurately reflecting the agent's performance in the scheduling process. Experimental results demonstrate the algorithm's effectiveness in terms of solution quality, showing its ability to find scheduling solutions closer to the global optimal solution.
Author Shao, Changshun
Ding, Hongchang
Cao, Guohua
Yu, Zhenglin
Author_xml – sequence: 1
  givenname: Changshun
  surname: Shao
  fullname: Shao, Changshun
  email: sd_scs0633@sina.com
  organization: College of mechanical and electrical engineering, Changchun University of Science and Technology,Changchun,China
– sequence: 2
  givenname: Zhenglin
  surname: Yu
  fullname: Yu, Zhenglin
  email: zhenglin_yu@sina.com
  organization: College of mechanical and electrical engineering, Changchun University of Science and Technology,Changchun,China
– sequence: 3
  givenname: Hongchang
  surname: Ding
  fullname: Ding, Hongchang
  organization: College of mechanical and electrical engineering, Changchun University of Science and Technology,Changchun,China
– sequence: 4
  givenname: Guohua
  surname: Cao
  fullname: Cao, Guohua
  organization: College of mechanical and electrical engineering, Changchun University of Science and Technology,Changchun,China
BookMark eNqFzrsOgjAYhuGa6OCBO3CoFyC25djRIESMJEbcCYcfaQItqZjo3auJzk7f8HzDO0NjqSQgtKLEpJTwTRyEwTZ2mcOpyQizTUpcz2GcjZDBPe5bDrF8l9vWFCVbvAPo8RmErJUuoQM54CPkWgp5xQkMjarwW3DUwkMULeCDKtZpo3qclg1U9_bzO2n1pm6BJnXe3sD47hwto_AS7NcCALJeiy7Xz-xXY_3hF8ICPes
ContentType Conference Proceeding
DBID 6IE
6IL
CBEJK
RIE
RIL
DOI 10.1109/ICECAI62591.2024.10675292
DatabaseName IEEE Electronic Library (IEL) Conference Proceedings
IEEE Proceedings Order Plan All Online (POP All Online) 1998-present by volume
IEEE Xplore All Conference Proceedings
IEEE/IET Electronic Library (IEL)
IEEE Proceedings Order Plans (POP All) 1998-Present
DatabaseTitleList
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE/IET Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
EISBN 9798350386943
EndPage 188
ExternalDocumentID 10675292
Genre orig-research
GroupedDBID 6IE
6IL
CBEJK
RIE
RIL
ID FETCH-ieee_primary_106752923
IEDL.DBID RIE
IngestDate Wed Oct 02 05:56:42 EDT 2024
IsPeerReviewed false
IsScholarly false
Language English
LinkModel DirectLink
MergedId FETCHMERGED-ieee_primary_106752923
ParticipantIDs ieee_primary_10675292
PublicationCentury 2000
PublicationDate 2024-May-31
PublicationDateYYYYMMDD 2024-05-31
PublicationDate_xml – month: 05
  year: 2024
  text: 2024-May-31
  day: 31
PublicationDecade 2020
PublicationTitle 2024 5th International Conference on Electronic Communication and Artificial Intelligence (ICECAI)
PublicationTitleAbbrev ICECAI
PublicationYear 2024
Publisher IEEE
Publisher_xml – name: IEEE
Score 3.840891
Snippet This paper focuses on the flexible job shop scheduling problem, with the primary optimization goal being the minimization of the maximum completion time. An...
SourceID ieee
SourceType Publisher
StartPage 184
SubjectTerms Artificial intelligence
Deep reinforcement learning
Electric potential
Job shop scheduling
Minimization
Optimization
Reinforcement learning flexible job-shop scheduling Maximum completion time
Title A Deep Reinforcement Learning Method for Flexible Job-Shop Scheduling Problem
URI https://ieeexplore.ieee.org/document/10675292
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3fS8MwED50D-KTihV_TInga7vZJu3yOOrKNugQp7C30bTXCcpapH3xrzeXtoqi4FtIwuVISO6S3PcdwA0m-e3QywgckwQ25-jbSo2E7WEmpB9kOXcJOxwv_OkTn6_EqgWrGywMIprgM3SoaP7ysyKt6alsQHRnwpX6xN0NpGzAWntw3fJmDmbhJBzPyKGni5_Lna7_t8wpxnBEB7DohmziRV6culJO-v6DjfHfOh2C9YXRY_ef1ucIdnB7DPGY3SGW7AENIWpq3v5Yy6G6YbFJF810C4uICFO9IpsXyl4-FyVb6uXLKC59Q3Ipy4wF_WjyGE5t0mddNrwU604V7wR622KLp8D0dhylXi4lR8VReInMhUpRBcMs145ecAbWryLO_6i_gH2a2eb7vA-96q3GS22VK3VlVuMDcyiR9A
link.rule.ids 310,311,783,787,792,793,799,27939,55088
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3fS8MwED5kgvqkYsUfUyP42m62Sbs-jrnRzbWIm7C3sTTXCcpaZH3xrzeXroqi4FtISHIkJHfJ3fcdwA0ustu2pwgcswhsztG3pewI20MlQj9QGXcJOxwnfvTERzMx24DVDRYGEU3wGTpUNL58laclfZW1iO5MuKG-cbcFGRYVXGsHrjfMma1hr9_rDsmkp6efy526x7fcKUZ1DPYhqSetIkZenHItnfT9Bx_jv6U6AOsLpccePvXPIWzh6gjiLrtDLNgjGkrU1Pz-sQ2L6pLFJmE00y1sQFSY8hXZKJf25Dkv2ERvoKLI9CWNS3lmLGgO-tNeZJM886JippjXonjH0FjlKzwBpg9kJ_WyMOQoOQpvEWZCpiiDtsq0qRecgvXrEGd_1F_BbjSNx_PxMLk_hz1a5cqZ3oTG-q3EC62j1_LS7MwHR0eVQQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=proceeding&rft.title=2024+5th+International+Conference+on+Electronic+Communication+and+Artificial+Intelligence+%28ICECAI%29&rft.atitle=A+Deep+Reinforcement+Learning+Method+for+Flexible+Job-Shop+Scheduling+Problem&rft.au=Shao%2C+Changshun&rft.au=Yu%2C+Zhenglin&rft.au=Ding%2C+Hongchang&rft.au=Cao%2C+Guohua&rft.date=2024-05-31&rft.pub=IEEE&rft.spage=184&rft.epage=188&rft_id=info:doi/10.1109%2FICECAI62591.2024.10675292&rft.externalDocID=10675292