Journal of Information Systems Engineering and Business Intelligence | 2026
Authors: Nguyen V.-V.; Nguyen H.-K.; Nguyen K.-S.; Luong T.M.-H.; Bui A.-T.; Vu D.-Q.; Nguyen T.-V.
DOI: 10.20473/jisebi.12.1.138-153
Journal: Journal of Information Systems Engineering and Business Intelligence
Year: 2026
Publisher: Airlangga University
Document Type: Article
Open Access: All Open Access; Gold Open Access
Cited by: 0
Background: Unified Modeling Language (UML) shares a common view among stakeholders in modeling software architecture through a set of diagrams. Of these essential diagrams, Component Diagrams and Deployment Diagrams ensure consistency between business requirements, software structure, and execution infrastructure. Yet, conventional methods relied on human expertise and hard to scale up (automate) from natural language descriptions, leaving a gap in the literature. Objective: To fill this gap, the current study attempted to construct a viable end-to-end solution that can automatically create and validate UML diagrams from natural language feature descriptions. Methods: To meet the objective, we proposed a 3-stages pipeline: 1) generate synthetic architectural-level feature descriptions (public benchmark dataset) using a pre-trained language model (i.e., LLaMA 3.2-1B-Instruct), 2) synthesize executable PlantUML code for UML Component and Deployment diagrams via recent reasoning-oriented language model (DeepSeek-R1-Distill-Qwen-32B); and 3) evaluate the generated diagrams through three multimodal validation frameworks (i.e., Qwen2.5-VL-3B, LLaMA-3.2-11B-Vision, and Aya-Vision-8B). Results: Experiments on over 2,000 UML description-diagram pairs showed that: 1) the proposed solution is capable of generating valid diagrams consistently, 2) the reasoning-oriented language model demonstrated a good performance compared to general-generated models in implementing end-to-end architecture, and 3) the three evaluating models closely reached to human experts terms of semantics and architectural coherence. Conclusion: This study conveyed information that when combining inference-oriented language modeling with controlled multimodal evaluation, it is feasible to automate software architecture modeling in UML. The release dataset and the proposed method are expected to not only lay the foundation for further research on “AI software architects” but also expand the potential for prospective behavioral UML diagrams. © 2026 The Authors.
Automated Reasoning; Multimodal Evaluation; Software Architecture Modeling; UMLCode; Vision-Language Models