The paper investigates the application of Large Language Models (LLMs) in mobile user interface (UI) layout generation. It introduces the concept of UI grammar, a novel approach to represent the hierarchical structure of UI screens. The goal of this approach is to guide LLMs more effectively and enhance the explainability and controllability of the process. The paper presents initial experiments using GPT-4, indicating the promising potential of LLMs to produce high-quality user interfaces through in-context learning. The study also suggests the potential of the grammar-based approach in improving the quality of generative results.

 

Publication date: 26 Oct 2023
Project Page: Not provided
Paper: https://arxiv.org/pdf/2310.15455