REAL-TIME RESCHEDULING OF PRODUCTION SYSTEMS USING RELATIONAL REINFORCEMENT LEARNING

Revista Iberoamericana De Engenharia Industrial

Endereço:
Campus Universitário - Trindade, Caixa Postal 476
Florianópolis / SC
0
Site: http://periodicos.incubadora.ufsc.br/index.php/IJIE
Telefone: (48) 3721-7065
ISSN: 2175-8018
Editor Chefe: Nelson Casarotto Filho
Início Publicação: 31/05/2009
Periodicidade: Semestral
Área de Estudo: Engenharia de produção

REAL-TIME RESCHEDULING OF PRODUCTION SYSTEMS USING RELATIONAL REINFORCEMENT LEARNING

Ano: 2011 | Volume: 3 | Número: 2
Autores: Jorge Palombarini, Ernesto Martinez
Autor Correspondente: Jorge Palombarini | [email protected]

Palavras-chave: Learning, Rescheduling, Relational Modeling, Agile Manufacturing

Resumos Cadastrados

Resumo Inglês:

Most scheduling methodologies developed until now have laid down good
theoretical foundations, but there is still the need for real-time rescheduling methods that can
work effectively in disruption management. In this work, a novel approach for automatic
generation of rescheduling knowledge using Relational Reinforcement Learning (RRL) is
presented. Relational representations of schedule states and repair operators enable to encode
in a compact way and use in real-time rescheduling knowledge learned through intensive
simulations of state transitions. An industrial example where a current schedule must be
repaired following the arrival of a new order is discussed using a prototype application –
SmartGantt®- for interactive rescheduling in a reactive way. SmartGantt® demonstrates the
advantages of resorting to RRL and abstract states for real-time rescheduling. A small number
of training episodes are required to define a repair policy which can handle on the fly events
such as order insertion, resource break-down, raw material delay or shortage and rush order
arrivals using a sequence of operators to achieve a selected goal.