Partially Observable Markov Decision Process

Assembly Line

🧠🗓️ Explainable production planning under partial observability in high-precision manufacturing

📅 Date:

✍️ Authors: Dorina Weichert, Alexander Kister, Peter Volbach, Sebastian Houben, Marcus Trost, Stefan Wrobel

🔖 Topics: Production Planning, Partially Observable Markov Decision Process, Monte Carlo Tree Search, Markov Chain


Conceptually, high-precision manufacturing is a sequence of production and measurement steps, where both kinds of steps require to use non-deterministic models to represent production and measurement tolerances. This paper demonstrates how to effectively represent these manufacturing processes as Partially Observable Markov Decision Processes (POMDP) and derive an offline strategy with state-of-the-art Monte Carlo Tree Search (MCTS) approaches. In doing so, we face two challenges: a continuous observation space and explainability requirements from the side of the process engineers. As a result, we find that a tradeoff between the quantitative performance of the solution and its explainability is required. In a nutshell, the paper elucidates the entire process of explainable production planning: We design and validate a white-box simulation from expert knowledge, examine state-of-the-art POMDP solvers, and discuss our results from both the perspective of machine learning research and as an illustration for high-precision manufacturing practitioners.

Read more at Journal of Manufacturing Systems