World Scientific
  • Search
  •   
Skip main navigation

Cookies Notification

We use cookies on this site to enhance your user experience. By continuing to browse the site, you consent to the use of our cookies. Learn More
×

System Upgrade on Tue, May 28th, 2024 at 2am (EDT)

Existing users will be able to log into the site and access content. However, E-commerce and registration of new users may not be available for up to 12 hours.
For online purchase, please visit us again. Contact us at [email protected] for any enquiries.

Generalized Ordinal Learning Framework (GOLF) for Decision Making with Future Simulated Data

    https://doi.org/10.1142/S0217595919400116Cited by:13 (Source: Crossref)
    This article is part of the issue:

    Real-time decision making has acquired increasing interest as a means to efficiently operating complex systems. The main challenge in achieving real-time decision making is to understand how to develop next generation optimization procedures that can work efficiently using: (i) real data coming from a large complex dynamical system, (ii) simulation models available that reproduce the system dynamics. While this paper focuses on a different problem with respect to the literature in RL, the methods proposed in this paper can be used as a support in a sequential setting as well. The result of this work is the new Generalized Ordinal Learning Framework (GOLF) that utilizes simulated data interpreting them as low accuracy information to be intelligently collected offline and utilized online once the scenario is revealed to the user. GOLF supports real-time decision making on complex dynamical systems once a specific scenario is realized. We show preliminary results of the proposed techniques that motivate the authors in further pursuing the presented ideas.

    References

    • Alrefaei, MH and S Andradóttir (2001). A modification of the stochastic ruler method for discrete stochastic optimization. European Journal of Operational Research, 133, 160–182. Web of ScienceGoogle Scholar
    • Ankenman, B, BL Nelson and J Staum (2010). Stochastic kriging for simulation metamodeling. Operations Research, 58, 371–382. Web of ScienceGoogle Scholar
    • Benamara, T, P Breitkopf, I Lepot and C Sainvitu (2016). Adaptive infill sampling criterion for multi-fidelity optimization based on Gappy-POD. Structural and Multidisciplinary Optimization, 1–13. Web of ScienceGoogle Scholar
    • Bertsekas, DP (2008). Approximate Dynamic Programming. Google Scholar
    • Brooks, SH (1958). A discussion of random methods for seeking maxima. Operations Research, 6, 244–251. Web of ScienceGoogle Scholar
    • Burnham, KP and DR Anderson (2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods & Research, 33, 261–304. Web of ScienceGoogle Scholar
    • Chen, CH, J Lin, E Yücesan and SE Chick (2000). Simulation budget allocation for further enhancing the efficiency of ordinal optimization. Discrete Event Dynamic Systems, 10, 251–270. Web of ScienceGoogle Scholar
    • Chen, R, J Xu, C-H Chen and L-H Lee (2015). An effective learning procedure for multi-fidelity simulation optimization with ordinal transformation. In Proc. 2015 IEEE Conf. Automation Science and Engineering, pp. 702–707, Gothenburg, Sweden. Google Scholar
    • Chen, CH and LH Lee (2010). Stochastic Simulation Optimization: An Optimal Computing Budget Allocation, World Scientific Publishing Co. LinkGoogle Scholar
    • Feo, TA and MG Resende (1995). Greedy randomized adaptive search procedures. Journal of Global Optimization, 6, 109–133. Web of ScienceGoogle Scholar
    • Forrester, AI, A Sóbester and AJ Keane (2007). December. Multi-fidelity optimization via surrogate modeling. In Proeedings of the Royal Society of London A: Mathematical, Physical and Engineering Sciences, Vol. 463, No. 2088, pp. 3251–3269. The Royal Society. Google Scholar
    • Fu, MC (ed.) (2015). Handbook of Simulation Optimization, Vol. 216. New York: Springer. Google Scholar
    • Goel, T, RT Haftka, W Shyy and NV Queipo (2007). Ensemble of surrogates. Structural and Multidisciplinary Optimization, 33, 199–216. Web of ScienceGoogle Scholar
    • Hsieh, L, E Huang, S Zhang, KH Chang and CH Chen (2016). Application of multi-fidelity simulation modeling to integrated circuit packaging. International Journal of Simulation and Process Modeling, 28, 195–208. Google Scholar
    • Hsieh, L, E Huang and CH Chen (2017). Equipment utilization enhancement in photolithography area through a dynamic system control using multi-fidelity simulation optimization with big data technique. IEEE Transactions on Semiconductor Manufacturing, 30, 166–175. Web of ScienceGoogle Scholar
    • Inanlouganji, A, G Pedrielli, G Fainekos and Pokutta (2018). Continuous simulation optimization with model mismatch using gaussian process regression. Submitted to Winter Simulation Conference. Google Scholar
    • Jerri, AJ (1977). The Shannon sampling theorem — Its various extensions and applications: A tutorial review. Proceedings of the IEEE, 65, 1565–1596. Web of ScienceGoogle Scholar
    • Jones, DR, M Schonlau and WJ Welch (1998). Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13, 455–492. Web of ScienceGoogle Scholar
    • Kandasamy, K, G Dasarathy, J Oliva, J Schneider and B Poczos (2016). Gaussian process optimisation with multi-fidelity evaluations. In NIPS. Google Scholar
    • Kang, Y, L Mathesen, G. Pedrielli and F Ju (2017). Multi-fidelity modeling for analysis of serial production lines. In 2017 IEEE CASE Conference. Google Scholar
    • Kleijnen, JPC (2015). Regression and Kriging metamodels with their experimental designs in simulation: Review. Google Scholar
    • Le Gratiet, L and C Cannamela (2015). Cokriging-based sequential design strategies using fast cross-validation techniques for multi-fidelity computer codes. Technometrics, 57, 418–427. Web of ScienceGoogle Scholar
    • Li, Y, SH Ng, M Xie and TN Goh (2010). A systematic comparison of metamodeling techniques for simulation optimization in decision support systems. Applied Soft Computing, 10, 1257–1273. Web of ScienceGoogle Scholar
    • Li, J, W Liu, G Pedrielli, LH Lee and EP Chew (2017). Optimal computing budget allocation to select the non-dominated systems — A large deviations perspective. IEEE Transactions on Automated Controls. Google Scholar
    • Liu, B, S Koziel and Q Zhang (2016). A multi-fidelity surrogate-model-assisted evolutionary algorithm for computationally expensive optimization problems. Journal of Computational Science, 12, 28–37. Web of ScienceGoogle Scholar
    • Locatelli, M (1997). Bayesian algorithms for one-dimensional global optimization. Journal of Global Optimization, 10, 57–76. Web of ScienceGoogle Scholar
    • Mathesen, L, G Pedrielli and SH Ng (2017). Trust region based stochastic optimization with adaptive restart: A family of global optimization algorithms. In 2017 Winter Simulation Conference (WSC). IEEE (To Appear). Google Scholar
    • Meng, Q and SH Ng (2015). An additive global and local Gaussian process model for large data sets. In Proceedings of 2015 Winter Simulation Conference, IEEE Press. Google Scholar
    • Min, C (2017). Multi-fidelity optimization with Gaussian regression on ordinal transformation space. Master dissertation. Google Scholar
    • Muller, J and R Piche (2011). Mixture surrogate models based on Dempster-Shafer theory for global optimization problems. Journal of Global Optimization, 51, 79–104. Web of ScienceGoogle Scholar
    • Myers, RH and CM Anderson-Cook (2009). Response Surface Methodology: Process and Product Optimization Using Designed Experiments, Vol. 705. John Wiley & Sons. Google Scholar
    • Osorio, C and KK Selvam (2017). Simulation-based optimization: Achieving computational efficiency through the use of multiple simulators. Transportation Science, 51, 395–411. Web of ScienceGoogle Scholar
    • Ozdogan, H (1987). Model selection and Akaike’s information criterion (AIC): The general theory and its analytical extensions. Psychometrika, 52, 345–370. Web of ScienceGoogle Scholar
    • Pedrielli, G and SH Ng (2015). eTSSO: Adaptive Search Method for Stochastic Global Optimization Under Finite Budget. Working paper. Google Scholar
    • Pedrielli, G et al. Empirical analysis of the performance of variance estimators in sequential single-run ranking selection: The case of time dilation algorithm. WSC’16. Google Scholar
    • Pedrielli, G and SH Ng (2016, December). G-star: A new kriging-based trust region method for global optimization. In 2016 Winter Simulation Conference (WSC). IEEE. Google Scholar
    • Pedrielli, G and SH Ng (2015, December). Kriging-based simulation-optimization: A stochastic recursion perspective. In 2015 Winter Simulation Conference (WSC), pp. 3834–3845. IEEE. Google Scholar
    • Pesaran, MH and RJ Smith (1994). A generalized R2 criterion for regression models estimated by the instrumental variables method. Econometrica, 62, 705–710. Web of ScienceGoogle Scholar
    • Powell, WB (2007). Approximate Dynamic Programming: Solving the Curses of Dimensionality, Vol. 703. John Wiley and Sons. Google Scholar
    • Quan, N, J Yin, SH Ng and LH Lee (2013). Simulation optimization via kriging: A sequential search using expected improvement with computing budget constraints. Iie Transactions, 45, 763–780. Web of ScienceGoogle Scholar
    • Ryzhov, IO, PI Frazier and WB Powell (2010). On the robustness of a one-period look-ahead policy in multi-armed bandit problems. Procedia Computer Science, 1, 1635–1644. Google Scholar
    • Santner, TJ, BJ Williams and WI Notz (2013). The Design and Analysis of Computer Experiments. Springer Science & Business Media. Google Scholar
    • Selçuk Candan, K and LS Maria (2010). Data Management for Multimedia Retrieval, Cambridge University Press. Google Scholar
    • Si, J, AG Barto, WB Powell and D Wunsch (Eds.) (2004). Handbook of Learning and Approximate Dynamic Programming, Vol. 2. John Wiley and Sons. Google Scholar
    • Solis, FJ and RJB Wets (1981). Minimization by random search techniques. Mathematics of Operations Research, 6, 19–30. Web of ScienceGoogle Scholar
    • Sutton, RS and AG Barto (2018). Reinforcement Learning: An Introduction. MIT Press. Google Scholar
    • Ulaganathan, S, I Couckuyt, F Ferranti, E Laermans and T Dhaene (2015). Performance study of multi-fidelity gradient enhanced kriging. Structural and Multidisciplinary Optimization, 51, 1017–1033. Web of ScienceGoogle Scholar
    • Viana, FA, TW Simpson, V Balabanov and V Toropov (2014). Special section on multidisciplinary design optimization: Metamodeling in multidisciplinary design optimization: How far have we really come? AIAA Journal, 52, 670–690. Web of ScienceGoogle Scholar
    • Wang, Z, M Zoghi, F Hutter, D Matheson and N De Freitas (2013). Bayesian optimization in high dimensions via random embeddings. In Twenty-Third International Joint Conference on Artificial Intelligence. Google Scholar
    • Wang, Z, C Li, S Jegelka and P Kohli (2017). Batched high-dimensional Bayesian optimization via structural kernel learning. In Proceedings of the 34th International Conference on Machine Learning, Vol. 70, pp. 3656–3664, JMLR.org. Google Scholar
    • West, SG, BT Aaron and W Wei (2012). Model fit and model selection in structural equation modeling. In Handbook of Structural Equation Modeling, pp. 209–231. Google Scholar
    • Wong, HS, TJ Chin, J Yu and D Suter (2011, November). Dynamic and hierarchical multi-structure geometric model fitting. In 2011 IEEE International Conference on Computer Vision (ICCV), pp. 1044–1051. IEEE. Google Scholar
    • Xinsheng, L, K Selcuk Candan and ML Sapino (2018). M2TD: Multi-task tensor decomposition for sparse ensemble simulations. Submitted to ICDE 2018. Google Scholar
    • Xu, J, S Zhang, E Huang, CH Chen, LH Lee and N Celik (2016a). Mo2tos: Multi-fidelity optimization with ordinal transformation and optimal sampling. Asia-Pacific Journal of Operational Research, 33, 1650017. Link, Web of ScienceGoogle Scholar
    • Xu, J, S Zhang, CC Huang, CH Chen, LH Lee and N Celik (2014). An ordinal transformation framework for multi-fidelity simulation optimization. In Proc. 2014 IEEE Conf. Automation Science and Engineering, pp. 385–390, Taipei, Taiwan, 2014. Google Scholar
    • Xu, J, E Huang, CH Chen and LH Lee (2015). Simulation optimization: A review and exploration in the new era of cloud computing and big data. Asia-Pacific Journal of Operational Research, 32. Web of ScienceGoogle Scholar
    • Xu, J, E Huang, L Hsieh, LH Lee, QS Jia and CH Chen (2016b). Simulation optimization in the era of Industrial 4.0 and the Industrial internet. Journal of Simulation, 10, 310–320. Web of ScienceGoogle Scholar
    • Yamada, M, J Chen and Y Chang (2018). Transfer Learning: Algorithms and Applications. Morgan Kaufmann. Google Scholar
    • Yan, D and H Mukai (1992). Stochastic discrete optimization. SIAM Journal on Control and Optimization, 30, 594–612. Web of ScienceGoogle Scholar
    • Yin, J, SH Ng and KM Ng (2011). Kriging metamodel with modified nugget-effect: The heteroscedastic variance case. Computers & Industrial Engineering, 61, 760–777. Web of ScienceGoogle Scholar
    • Yu-Ru, L, K Selçuk Candan, H Sundaram and X Lexing (2011). SCENT: Scalable compressed monitoring of evolving multirelational social networks. ACM Transactions on Multimedia Computing, Communications, and Applications, 7(Suppl.), 29. Google Scholar
    • Zabinsky, ZB, RL Smith, JF McDonald, HE Romeijn and DE Kaufman (1993). Improving hit-and-run for global optimization. Journal of Global Optimization, 3, 171–192. Web of ScienceGoogle Scholar
    • Zabinsky, ZB, B David and K Charoenchai (2010). Stopping and restarting strategy for stochastic sequential search in global optimization. Journal of Global Optimization, 46.2, 273–286. Web of ScienceGoogle Scholar
    • Zabinsky, ZB and RL Smith (1992). Pure adaptive search in global optimization. Mathematical Programming, 53, 323–338. Web of ScienceGoogle Scholar
    • Zhang, S, J Xu, LH Lee, EP Chew, WP Wong and CH Chen (2017). Optimal computing budget allocation for particle swarm optimization in stochastic optimization, IEEE Transactions on Evolutionary Computation, 21, 206–219. Web of ScienceGoogle Scholar
    • Zhang, S, J Xu, E Huang and CH Chen (2016a). A new optimal sampling rule for multi-fidelity optimization via ordinal transformation. In 2016 IEEE International Conference on Automation Science and Engineering (CASE), pp. 670–674, IEEE. Google Scholar
    Remember to check out the Most Cited Articles!

    Be inspired by these New Titles in Business & Management today.
    With a wide range of areas, you're bound to find something you like.