Managing Dynamic Inventory Systems with Product Returns: A Markov Decision Process

Abstract

This paper presents a Markov decision process for managing inventory systems with Markovian customer demand and Markovian product returns. Employing functional analysis, we prove the existence of the optimal replenishment policies for the discounted-cost and average-cost problems when demand, returns, and cost functions are of polynomial growth. Our model generalizes literature results by integrating Markovian demand, Markovian returns, and positive replenishment lead times. In particular, the optimality of the reorder point, order-up-to policies is proved when the order cost consists of fixed setup and proportional cost components and the inventory surplus cost is convex. We then make model extensions to include different cost components and to differentiate returned products from new ones. Finally, we derive managerial insights for running integrated closed-loop supply chains. At the aggregate level, returns reduce effective demand while many structural characteristics of inventory models are intact. A simple heuristic for managing systems with returns is to still utilize literature results without returns, but effective demand is lower than customer demand.