Elsevier

Computers in Industry

Volume 58, Issue 7, September 2007, Pages 656-666
Computers in Industry

A Benchmarking Service for the evaluation and comparison of scheduling techniques

https://doi.org/10.1016/j.compind.2007.05.004Get rights and content

Abstract

Scheduling decisions constitute the last decision-making phase of the production planning and control process. From the industrial side, the adoption of highly reactive and efficient scheduling and control systems strongly affects the level of productivity and utilization of a manufacturing system, particularly under the pressure of shortened product cycles, reduced batch sizes and a broader variety of items to be produced. In the meanwhile, from the research side, there has been a considerable amount of works done in the area of manufacturing systems control, even if they still remain “unheard voices” in industry. Hence, in the scheduling world there is a risk of miscommunication between academics and industrial users.

Aim of the paper is to provide a comprehensive view of the rationale, the conceptual model, the development efforts and first applicative experiences of the Benchmarking Service, a research initiative which has been carried out within the activities of the Special Interest Group on Benchmarking and Performance Measurement of the IMS Network of Excellence. In particular, the paper details the PMS-ESS conceptual framework developed for assessing the level of quality of a scheduling solution in terms of efficiency, robustness and flexibility.

Introduction

Competitive firms are operating today in global and worldwide markets. Manufacturers are experiencing a lumpy market demand for their products, with ever shorter requested lead times and order quantities as well as frequent changes in product specifications. In this context, within the production planning and control process, scheduling plays undoubtedly a critical role. It is the final temporal decision-making phase where industrial managers have to act for fixing any short noticed variations preserving at the same time expected medium-term efficiency performance.

According to Kempf et al. [6], the most general definition of a scheduling problem is that of “assigning scarce resources to competing activities over a given time horizon to obtain the best possible system performance”. Referring specifically to factory scheduling, the resources are machines and workforce, and the competing activities are jobs that require processing on the resources.

Several scheduling approaches exist, from the traditional off-line scheduling systems, which elaborate a production plan (e.g. according to static rules and algorithms) for a specific plan period, to on-line production scheduling systems, which are intrinsically able to modify an existing schedule or regenerate a completely new one for managing upcoming events which could alter the original plan.

Despite the flourish of heterogeneous proposals, a dichotomy is actually affecting the world of scheduling. Researchers are often detached from industrial reality, proposing answers to simple examples and toy cases. On the contrary, practitioners have clear difficulties in explaining their requirements and exploiting the opportunities which could come out from the industrial exploitation of the new advanced scheduling approaches.

The main purpose of the present paper is to provide a comprehensive view of a research initiative, carried out in the last years within the activities of the IMS-NoE Special Interest Group (SIG) on Benchmarking and Performance Measurement of Production Scheduling Systems. The research community involved in the SIG has been mainly interested in promoting the adoption of a Benchmarking methodology for testing and evaluating scheduling solutions in order to identify the best solution for one industrial problem.

This idea has turned into reality with the instantiation of the Benchmarking Service within the IMS-NoE web site [7], freely accessible to all the registered members. The available prototype of the Benchmarking Service is a web-based arena, where production systems would be described and different production scheduling policies would be evaluated and compared under a common simulation environment.

The paper is organized as follows: Section 2 summarizes the rationale behind the developed Benchmarking Service; Section 3 introduces the framework developed for supporting the description of a test case; Section 4 explores the main requirements of the evaluation of a scheduling system; Sections 5 The proposed framework (PMS-ESS), 6 Application of the PMS-ESS illustrate the proposed PMS-ESS with an applicative example; Section 7 provides the main conclusions of the paper.

Section snippets

Rationale of the Benchmarking Service

Finding a scheduling system as a panacea for solving all the issues which could arise in a production environment is quite pretentious. Indeed, one of the main sources of miscommunication between the research and the industrial world is the difficulty to clearly and objectively ascertain the real domain of applicability of a scheduler for a specific industrial problem.

In literature, there are several approaches to the scheduling problem, which can be classified using alternative criteria,

The descriptive Benchmark framework

Since 1999, Cavalieri et al. [2] have been proposing a framework merging static and dynamic data for the description of a production system. At first, the framework arose from the need to test and evaluate multi-agent based solutions for scheduling problems. Then, the idea was enlarged to a more comprehensive Benchmarking action for all types of scheduling policies. The conceptual elements for the production system design derive from past experiences [14], with the development of a

Main requirements for the evaluation of scheduling systems

In the Benchmarking Service, the role of performance measures is particularly important. Performance evaluation should include all relevant aspects, as the quality of the scheduling and control software, its deployment effort in a shop floor and the productivity of the shop floor system itself. Moreover, performance evaluation should be industrially relevant, to refrain diffidence of industrial practitioners and to provide them with a critical analysis of the performance of the scheduling

The proposed framework (PMS-ESS)

The proposed Performance Measurement System for the Evaluation of Scheduling Solutions (PMS-ESS), which has been also described in [26], is a three-layered framework:

  • Effectiveness layer—this layer of the framework deals with measures and indicators assessing the level of effectiveness of a single production resource, sub-system or of the overall system as a result of the control of a scheduling solution. The set of measures elaborated in this layer provides an answer to “how the specific

Application of the PMS-ESS

In [26] the PMS-ESS has been applied for the evaluation of the quality of schedules currently applied to a shop-floor of the motorcycle business unit of an Italian company producing automotive braking systems. In this paper, we propose a comparison between a market-like multi-agent architecture with other three scheduling techniques, one based on the scheduling architecture with supervisor, adapted from [18], [19], while the other two by using heuristic techniques (one mainly based on a

Conclusions

The paper provides a description of the Benchmarking Service initiative. The service comprises the Test-Bench Assistant (TBA), which provides an interactive user interface to lower the threshold for the prospective users, and the Test-Bench Emulator, which performs the specified Benchmarks and produces a persistent log file of the events that occur in the emulated factory connected to the manufacturing control system during the Benchmark execution. The α release of the TBA is available on line

Acknowledgements

The results reported in this paper have been made possible also thanks to the activities of the Special Interest Group on Benchmarking and Performance Measures, within the IMS Network of Excellence (IST 2001-65001).

Sergio Cavalieri is Associate Professor of Operations and Supply Chain Management at the University of Bergamo. He has been author of 2 books and more than 70 papers, published on national and international journals or presented in conference proceedings. He is member of IFAC-TC 5.1 on Advanced Manufacturing Technology, member of the Technical Development Steering Committee of the Supply Chain Council, former coordinator of a SIG within the IMS (Intelligent Manufacturing Systems) Network of

References (26)

  • IMS-NoE, Network of Excellence on Intelligent Manufacturing Systems, Project Reference IST-2001-65001 IMS-02006,...
  • S. Gören, Robustness and Stability for Scheduling Policies in a Single Machine Environment, M.Sc. Thesis, Bilkent...
  • D.J. Mignon et al.

    Framework for investigating schedule robustness under uncertainty

    Computers in Chemical Engineering

    (1995)
  • Cited by (0)

    Sergio Cavalieri is Associate Professor of Operations and Supply Chain Management at the University of Bergamo. He has been author of 2 books and more than 70 papers, published on national and international journals or presented in conference proceedings. He is member of IFAC-TC 5.1 on Advanced Manufacturing Technology, member of the Technical Development Steering Committee of the Supply Chain Council, former coordinator of a SIG within the IMS (Intelligent Manufacturing Systems) Network of Excellence and associated member of EUROMA and POMS.

    Sergio Terzi is researcher at University of Bergamo, Department of Industrial Engineering and Assistant Professor at Politecnico di Milano. In 2005, he received his PhD in Management Engineering from Politecnico di Milano and his PhD in Production Engineering from the University Henri Poincaré Nancy I. He is author and co-author of more than 40 papers at national and international level. He is former coordinator of a SIG within the IMS (Intelligent Manufacturing Systems) Network of Excellence. His current research interests are: modelling and simulation of production systems, operation management and product lifecycle management.

    Marco Macchi is researcher and developed his activity at Politecnico di Milano, Department of Management, Economics and Industrial Engineering since 1997. He is contract professor of Modelling of Production Systems and lecturer of many other courses. His current research interests are: modelling and simulation of production systems and logistics, business process analysis and re-engineering, maintenance of industrial plants, product life cycle management.

    View full text