Generalized Ordinal Learning Framework (GOLF) for Decision Making with Future Simulated Data
Abstract
Real-time decision making has acquired increasing interest as a means to efficiently operating complex systems. The main challenge in achieving real-time decision making is to understand how to develop next generation optimization procedures that can work efficiently using: (i) real data coming from a large complex dynamical system, (ii) simulation models available that reproduce the system dynamics. While this paper focuses on a different problem with respect to the literature in RL, the methods proposed in this paper can be used as a support in a sequential setting as well. The result of this work is the new Generalized Ordinal Learning Framework (GOLF) that utilizes simulated data interpreting them as low accuracy information to be intelligently collected offline and utilized online once the scenario is revealed to the user. GOLF supports real-time decision making on complex dynamical systems once a specific scenario is realized. We show preliminary results of the proposed techniques that motivate the authors in further pursuing the presented ideas.
References
- 2001). A modification of the stochastic ruler method for discrete stochastic optimization. European Journal of Operational Research, 133, 160–182. Web of Science, Google Scholar (
- 2010). Stochastic kriging for simulation metamodeling. Operations Research, 58, 371–382. Web of Science, Google Scholar (
- 2016). Adaptive infill sampling criterion for multi-fidelity optimization based on Gappy-POD. Structural and Multidisciplinary Optimization, 1–13. Web of Science, Google Scholar (
- 2008). Approximate Dynamic Programming. Google Scholar (
- 1958). A discussion of random methods for seeking maxima. Operations Research, 6, 244–251. Web of Science, Google Scholar (
- 2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33, 261–304. Web of Science, Google Scholar (
- 2000). Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynamic Systems, 10, 251–270. Web of Science, Google Scholar (
- 2015). An effective learning procedure for multi-fidelity simulation optimization with ordinal transformation. In Proc. 2015 IEEE Conf. Automation Science and Engineering, pp. 702–707,
Gothenburg, Sweden . Google Scholar ( - 2010). Stochastic Simulation Optimization: An Optimal Computing Budget Allocation, World Scientific Publishing Co. Link, Google Scholar (
- 1995). Greedy randomized adaptive search procedures. Journal of Global Optimization, 6, 109–133. Web of Science, Google Scholar (
- 2007). December. Multi-fidelity optimization via surrogate modeling. In Proeedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, Vol. 463, No. 2088, pp. 3251–3269. The Royal Society. Google Scholar (
- Fu, MC (ed.) (2015). Handbook of Simulation Optimization, Vol. 216. New York: Springer. Google Scholar
- 2007). Ensemble of surrogates. Structural and Multidisciplinary Optimization, 33, 199–216. Web of Science, Google Scholar (
- 2016). Application of multi-fidelity simulation modeling to integrated circuit packaging. International Journal of Simulation and Process Modeling, 28, 195–208. Google Scholar (
- 2017). Equipment utilization enhancement in photolithography area through a dynamic system control using multi-fidelity simulation optimization with big data technique. IEEE Transactions on Semiconductor Manufacturing, 30, 166–175. Web of Science, Google Scholar (
- 2018). Continuous simulation optimization with model mismatch using gaussian process regression. Submitted to Winter Simulation Conference. Google Scholar (
- 1977). The Shannon sampling theorem — Its various extensions and applications: A tutorial review. Proceedings of the IEEE, 65, 1565–1596. Web of Science, Google Scholar (
- 1998). Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13, 455–492. Web of Science, Google Scholar (
- 2016). Gaussian process optimisation with multi-fidelity evaluations. In NIPS. Google Scholar (
- 2017). Multi-fidelity modeling for analysis of serial production lines. In 2017 IEEE CASE Conference. Google Scholar (
- Kleijnen, JPC (2015). Regression and Kriging metamodels with their experimental designs in simulation: Review. Google Scholar
- 2015). Cokriging-based sequential design strategies using fast cross-validation techniques for multi-fidelity computer codes. Technometrics, 57, 418–427. Web of Science, Google Scholar (
- 2010). A systematic comparison of metamodeling techniques for simulation optimization in decision support systems. Applied Soft Computing, 10, 1257–1273. Web of Science, Google Scholar (
- 2017). Optimal computing budget allocation to select the non-dominated systems — A large deviations perspective. IEEE Transactions on Automated Controls. Google Scholar (
- 2016). A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems. Journal of Computational Science, 12, 28–37. Web of Science, Google Scholar (
- 1997). Bayesian algorithms for one-dimensional global optimization. Journal of Global Optimization, 10, 57–76. Web of Science, Google Scholar (
- 2017). Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms. In 2017 Winter Simulation Conference (WSC). IEEE (To Appear). Google Scholar (
- 2015). An additive global and local Gaussian process model for large data sets. In Proceedings of 2015 Winter Simulation Conference, IEEE Press. Google Scholar (
- Min, C (2017). Multi-fidelity optimization with Gaussian regression on ordinal transformation space. Master dissertation. Google Scholar
- 2011). Mixture surrogate models based on Dempster-Shafer theory for global optimization problems. Journal of Global Optimization, 51, 79–104. Web of Science, Google Scholar (
- 2009). Response Surface Methodology: Process and Product Optimization Using Designed Experiments, Vol. 705. John Wiley & Sons. Google Scholar (
- 2017). Simulation-based optimization: Achieving computational efficiency through the use of multiple simulators. Transportation Science, 51, 395–411. Web of Science, Google Scholar (
- 1987). Model selection and Akaike’s information criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52, 345–370. Web of Science, Google Scholar (
- Pedrielli, G and SH Ng (2015). eTSSO: Adaptive Search Method for Stochastic Global Optimization Under Finite Budget. Working paper. Google Scholar
- Pedrielli, G et al. Empirical analysis of the performance of variance estimators in sequential single-run ranking selection: The case of time dilation algorithm. WSC’16. Google Scholar
- 2016, December). G-star: A new kriging-based trust region method for global optimization. In 2016 Winter Simulation Conference (WSC). IEEE. Google Scholar (
- 2015, December). Kriging-based simulation-optimization: A stochastic recursion perspective. In 2015 Winter Simulation Conference (WSC), pp. 3834–3845. IEEE. Google Scholar (
- 1994). A generalized criterion for regression models estimated by the instrumental variables method. Econometrica, 62, 705–710. Web of Science, Google Scholar (
- 2007). Approximate Dynamic Programming: Solving the Curses of Dimensionality, Vol. 703. John Wiley and Sons. Google Scholar (
- 2013). Simulation optimization via kriging: A sequential search using expected improvement with computing budget constraints. Iie Transactions, 45, 763–780. Web of Science, Google Scholar (
- 2010). On the robustness of a one-period look-ahead policy in multi-armed bandit problems. Procedia Computer Science, 1, 1635–1644. Google Scholar (
- 2013). The Design and Analysis of Computer Experiments. Springer Science & Business Media. Google Scholar (
- 2010). Data Management for Multimedia Retrieval, Cambridge University Press. Google Scholar (
- Si, J, AG Barto, WB Powell and D Wunsch (Eds.) (2004). Handbook of Learning and Approximate Dynamic Programming, Vol. 2. John Wiley and Sons. Google Scholar
- 1981). Minimization by random search techniques. Mathematics of Operations Research, 6, 19–30. Web of Science, Google Scholar (
- 2018). Reinforcement Learning: An Introduction. MIT Press. Google Scholar (
- 2015). Performance study of multi-fidelity gradient enhanced kriging. Structural and Multidisciplinary Optimization, 51, 1017–1033. Web of Science, Google Scholar (
- 2014). Special section on multidisciplinary design optimization: Metamodeling in multidisciplinary design optimization: How far have we really come? AIAA Journal, 52, 670–690. Web of Science, Google Scholar (
- 2013). Bayesian optimization in high dimensions via random embeddings. In Twenty-Third International Joint Conference on Artificial Intelligence. Google Scholar (
- 2017). Batched high-dimensional Bayesian optimization via structural kernel learning. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70, pp. 3656–3664, JMLR.org. Google Scholar (
- 2012).
Model fit and model selection in structural equation modeling . In Handbook of Structural Equation Modeling, pp. 209–231. Google Scholar ( - 2011, November). Dynamic and hierarchical multi-structure geometric model fitting. In 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1044–1051. IEEE. Google Scholar (
- Xinsheng, L, K Selcuk Candan and ML Sapino (2018). M2TD: Multi-task tensor decomposition for sparse ensemble simulations. Submitted to ICDE 2018. Google Scholar
- 2016a). Mo2tos: Multi-fidelity optimization with ordinal transformation and optimal sampling. Asia-Pacific Journal of Operational Research, 33, 1650017. Link, Web of Science, Google Scholar (
- 2014). An ordinal transformation framework for multi-fidelity simulation optimization. In Proc. 2014 IEEE Conf. Automation Science and Engineering, pp. 385–390,
Taipei, Taiwan ,2014 . Google Scholar ( - 2015). Simulation optimization: A review and exploration in the new era of cloud computing and big data. Asia-Pacific Journal of Operational Research, 32. Web of Science, Google Scholar (
- 2016b). Simulation optimization in the era of Industrial 4.0 and the Industrial internet. Journal of Simulation, 10, 310–320. Web of Science, Google Scholar (
- 2018). Transfer Learning: Algorithms and Applications. Morgan Kaufmann. Google Scholar (
- 1992). Stochastic discrete optimization. SIAM Journal on Control and Optimization, 30, 594–612. Web of Science, Google Scholar (
- 2011). Kriging metamodel with modified nugget-effect: The heteroscedastic variance case. Computers & Industrial Engineering, 61, 760–777. Web of Science, Google Scholar (
- 2011). SCENT: Scalable compressed monitoring of evolving multirelational social networks. ACM Transactions on Multimedia Computing, Communications, and Applications, 7(Suppl.), 29. Google Scholar (
- 1993). Improving hit-and-run for global optimization. Journal of Global Optimization, 3, 171–192. Web of Science, Google Scholar (
- 2010). Stopping and restarting strategy for stochastic sequential search in global optimization. Journal of Global Optimization, 46.2, 273–286. Web of Science, Google Scholar (
- 1992). Pure adaptive search in global optimization. Mathematical Programming, 53, 323–338. Web of Science, Google Scholar (
- 2017). Optimal computing budget allocation for particle swarm optimization in stochastic optimization, IEEE Transactions on Evolutionary Computation, 21, 206–219. Web of Science, Google Scholar (
- 2016a). A new optimal sampling rule for multi-fidelity optimization via ordinal transformation. In 2016 IEEE International Conference on Automation Science and Engineering (CASE), pp. 670–674, IEEE. Google Scholar (
Remember to check out the Most Cited Articles! |
---|
Be inspired by these New Titles in Business & Management today. |