Hochul Cho
Abstract
StarCraft is a well-known real-time strategy game developed by Blizzard Entertainment in 1998. One of the characteristics of this game is “fog of war,” which refers to the fact that players cannot see their opponents' regions but only their own unit. This characteristic of the game means that the information required in order to predicting the opponent's strategy is only available through “scouting.” Although the “fog of war” is one of the most important features of the game, it has not been deeply understood in the design of artificial intelligence. In this work, we propose to investigate the effect of the “fog of war” in the prediction of opponent's strategy using machine learning for human players and artificial intelligence (AI) bots. To realize this analysis, we develop a customized replay analyzer that exports the internal game events with/without the fog of war. In the experimental results, we collect replays from various sources: human vs. human, human vs. AI bots, and AI bots vs. AI bots. This systematic analysis with “fog of war” reveals the predictability of the machine-learning algorithms on different conditions and the directions for designing new artificial intelligence for the game.
- D. W. Aha, D. Kibler, and M. K. Albert. 1991. Instance-based learning algorithms. Mach. Learn. 6, 1, 37--66. Google Scholar
Digital Library
- L. Breiman. 2001. Random forests. Mach. Learn. 45, 5--32. Google ScholarDigital Library
- M. Brent. 1995. Instance-Based Learning: Nearest Neighbour with Generalisation. Master's Thesis, University of Waikato, Hamilton, New Zealand.Google Scholar
- M. Buro and D. Churchill. 2012. Real-time strategy game competitions. AI Mag. 33, 3, 106--108.Google ScholarCross Ref
- D. Churchill and M. Buro. 2012. Incorporating search algorithms into RTS Game agents. AIIDE Workshop on Artificial Intelligence in Adversarial Real-Time Games, 2--7.Google Scholar
- IEEE CIG StarCraft AI Comeptition. 2011. Homepage. Retrieved from http://ls11-www.cs.uni-dortmund.de/rts-competition/starcraft-cig2011/.Google Scholar
- IEEE CIG StarCraft AI Comeptition. 2012. Homepage. Retrieved from http://ls11-www.cs.uni-dortmund.de/rts-competition/starcraft-cig2012/.Google Scholar
- E. Dereszynski, J. Hostetler, A. Fern, T. Dietterich, T. T. Hoang, and M. Udarbe. 2011. Learning probabilistic behavior models in real-time strategy games. In Proceedings of the 7th Artificial Intelligence and Interactive Digital Entertainment Conference. 20--25.Google Scholar
- K. J. Kim and S. B. Cho. 2011. Server-side Early Detection Method for Detecting Abnormal Players of StarCraft. In Proceedings of the 3rd International Conference on Internet. 489--494.Google Scholar
- F. Kabanza, P. Bellefeuille, F. Bisson, A. Benaskeur, and H. Irandoust. 2010. Opponent behavior recognition for real-time strategy games. In Proceedings of the AAAI Workshop on Plan, Activity, and Intent Recognition, 29--36.Google Scholar
- K. J. Kim and S. B. Cho. 2012. The 2011 IEEE conference on computational intelligence and games report. IEEE Comput. Intell. Mag. 7, 1, 15--18. Google ScholarCross Ref
- J. Kim, K. H. Yoon, T. Yoon, and J. H. Lee. 2010. Cooperative learning by replay files in real-time strategy game. Lecture Notes in Computer Science, Vol. 6240. 47--51. Google ScholarCross Ref
- J. L. Hsieh and C. T. Sun. 2008. Building a player strategy model by analyzing replays of real-time strategy games. In Proceedings of the IEEE International Joint Conference on Neural Networks. 3106--3111. Google ScholarCross Ref
- Lord Martin's Replay Browser. 2012.Google Scholar
- H. S. Park, H. C. Cho, K. Y. Lee, and K. J. Kim. 2012. Prediction of early stage opponent strategy for StarCraft AI using scouting and machine learning. In Proceedings of the Workshop at SIGGRAPH ASIA (Computer Gaming Track). 7--12. Google ScholarDigital Library
- AIIDE StarCraft AI Competition. 2010. Homepage. Retrieved from http://eis.ucsc.edu/StarCraftAICompetition/.Google Scholar
- G. Synnaeve and P. Besiere. 2011a. A Bayesian model for RTS unit control applied to StarCraft. In Proceedings of the IEEE Conference on Computational Intelligence and Games. 190--196. Google ScholarCross Ref
- G. Synnaeve and P. Besiere. 2011b. A Bayesian model for opening prediction in RTS games with application to StarCraft. In Proceedings of the IEEE Conference on Computational Intelligence and Games. 281--288. Google ScholarCross Ref
- B. Weber and M. Mateas. 2009. A data mining approach to strategy prediction. In Proceedings of the IEEE Symposium on Computational Intelligence in Games. 140--147. Google ScholarCross Ref
- B. G. Weber and S. Ontanon. 2010. Using automated replay annotation for case-based planning in games. In Proceedings of the International Conference on Case-Based Reasoning Workshop on CBR for Computer Games. 15--24.Google Scholar
- B. G. Weber, M. Mateas, and A. Jhala. 2011. Building human-level ai for real-time strategy games. In Proceedings of the AAAI Fall Symposium on Advances in Cognitive Systems. 329--336.Google Scholar
- I. H. Witten, E. Frank, and M. A. Hall. 2011. Data Mining: Practical Machine Learning Tools and Techniques (3rd ed.). Morgan Kaufmann.Google ScholarDigital Library
Index Terms
- Investigation of the Effect of “Fog of War” in the Prediction of StarCraft Strategy Using Machine Learning
Recommendations
Starcraft from the stands: understanding the game spectator
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsVideo games are primarily designed for the players. However, video game spectating is also a popular activity, boosted by the rise of online video sites and major gaming tournaments. In this paper, we focus on the spectator, who is emerging as an ...
Towards human-like artificial intelligence using StarCraft 2
FDG '18: Proceedings of the 13th International Conference on the Foundations of Digital GamesOn our path towards artificial general intelligence, video games have become excellent tools for research. Reinforcement learning (RL) algorithms are particularly successful in this domain, with the added benefit of having fairly well established ...
Prediction of early stage opponents strategy for StarCraft AI using scouting and machine learning
WASA '12: Proceedings of the Workshop at SIGGRAPH AsiaStarCraft is one of the most famous Real-Time Strategy Games and there have been several competitions on AI bots. In order to win StarCraft, players have to predict their opponents strategy and respond properly. Human players used to scout their ...
Comments