The First ChatGPT4PCG Competition

Abstract

This article summarizes the first ChatGPT4PCG competition held at the 2023 IEEE Conference on Games. The goal of the competition is to explore emergent abilities of publicly available large language models (LLMs) in performing complex tasks related to procedural content generation, specifically physics-based level generation for Angry Birds -like games. Participants are tasked with submitting their prompts for ChatGPT to generate Angry Birds -like game structures that resemble English uppercase characters. A structure is a collection of stacked game objects comprising a part of an entire Angry Birds -like level. A prompt is an input for LLMs, including ChatGPT. Two evaluation metrics, i.e., stability and similarity, are used to evaluate the submitted prompts. Stability measures the sturdiness of a structure to withstand in-game gravity, while similarity measures a structure's resemblance to the target character. With such evaluation, participants are challenged to produce not only character-like but also stable structures by utilizing prompt engineering techniques. Finally, the competition's results are discussed to provide valuable insights for future studies and competitions.