Featured | Open Access | DOI: https://doi.org/10.55640/ijcsis/Volume11Issue11-02

A Review of NLP-Driven Test Case Generation Using Large Language Models for Software Quality Assurance

Dr. Nilesh Jain , Associate Professor Department of Computer Sciences and Applications, Mandsaur University, Mandsaur

Abstract

The rapid transformation of software development practices, from Waterfall to Agile and DevOps, has augmented the demand for effective, scalable and precise testing methodology. Conventional manual test case generation is lengthy, inaccurate and in most cases unable to meet current continuous delivery cycles. Recently, advancements in Natural Language Processing (NLP) and Large Language Models (LLMs) have presented exciting opportunities for generating automated test cases. This survey discusses how NLP-based and LLM-based methods can transform the nature of software quality assurance by examining the requirement documents, categorizing intents, creating formalized test cases, and validating the results using automated simulation frameworks. An overview of the architectures of software quality assurance its process and its importance in development is also outlined extensively. Recent literature has shown great improvements including higher coverage of tests, high defect detection rates, and less manual work. Nevertheless, the issues of hallucination, data quality restrictions, computational costs, and the inability to test dynamic interfaces remain. The present review summarizes the existing knowledge, identifies a gap in literature, and provides knowledge of the future of automated generation of test cases with intelligence, scalability, and reliability.

Keywords

Large Language Models (LLMs), Automated Test Case Generation,, Natural Language Processing (NLP)

References

V. Banka, “Multi-Dimensional Governance in Software Procurement: A Strategic Framework for Integrated Asset Management, Cybersecurity, and Legal Compliance Within the ServiceNow Ecosystem,” in 2026 7th International Conference On Computational Vision and Bio Inspired Computing (ICCVBIC), IEEE, Aug. 2026, pp. 1271–1277. doi: 10.1109/ICCVBIC71195.2026.11689058.

S. Bernardo et al., “Software Quality Assurance as a Service: Encompassing the quality assessment of software and services,” Futur. Gener. Comput. Syst., vol. 156, no. February, pp. 254–268, Jul. 2024, doi: 10.1016/j.future.2024.03.024.

S. Barman, P. Gupta, and S. Kashiramka, “Project Management Survey: A Review of Software Project Management Methodologies,” 2024 IEEE 11th Uttar Pradesh Sect. Int. Conf. Electr. Electron. Comput. Eng. UPCON 2024, 2024, doi: 10.1109/UPCON62832.2024.10983518.

K. Patel and S. Gupta, “Prediction of Software Defects for Quality Assurance and Improvement Based on Machine Learning Methods,” in 2024 2nd International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT), IEEE, Nov. 2024, pp. 400–406. doi: 10.1109/ICAICCIT64383.2024.10912382.

Y. Macha and S. K. Pulichikkunnu, “A Survey of DevOps Practices for Machine Learning and Artificial Intelligence Workflows in Modern Software Development,” ESP J. Eng. Technol. Adv., vol. 4, no. 3, pp. 200–208, 2024, doi: 10.56472/25832646/JETA-V4I3P121.

H. Afzal and M. Huzaifa, “Securing AI Systems Against Adversarial Attacks: A Framework for Building Robust and Trustworthy Machine Learning Models,” Comput. Fraud Secur., no. 5, pp. 65–74, 2024, doi: https://doi.org/10.52710/cfs.867.

J. Rahul Dattangire, Ruchika Vaidya, Divya Biradar, “Exploring the Tangible Impact of Artificial Intelligence and Machine Learning: Bridging the Gap between Hype and Reality,” 2024 1st Int. Conf. Adv. Comput. Emerg. Technol., pp. 1–6, 2024.

D. Patel, “AI-Enhanced Natural Language Processing for Improving Web Page Classification Accuracy,” vol. 4, no. 1, pp. 133–140, 2024, doi: 10.56472/25832646/JETA-V4I1P119.

S. Garg, “AI-Driven Innovations in Storage Quality Assurance and Manufacturing Optimization,” Int. J. Multidiscip. Res. Growth Eval., vol. 6, no. 2, pp. 1083–1087, 2025, doi: 10.54660/.IJMRGE.2025.6.2.1083-1087.

S. K. Tiwari, “Quality Assurance Strategies in Developing High-Performance Financial Technology Solutions,” Int. J. data Sci. Mach. Learn., vol. 05, no. 01, pp. 323–335, Jun. 2025, doi: 10.55640/ijdsml-05-01-26.

P. Chandrashekar and M. Kari, “A Study on Artificial Intelligence in Software Engineering with Methodologies , Applications , and Effects on SDLC,” TIJER Int. Res. J., vol. 11, no. 12, pp. 932–937, 2024.

V. Prajapati, “Advances in Software Development Life Cycle Models: Trends and Innovations for Modern Applications,” JGREC, vol. 1, no. 4, 2025, doi: 10.5281/zenodo.15222129.

K. Shah, C. R. Katru, and S. Gami, “Redefining Software Quality Assurance: A Deep Dive into Automated Testing Strategies,” Rev. Contemp. Sci. Acad. Stud., vol. 5, no. 3, Mar. 2025, doi: 10.55454/rcsas.5.03.2025.002.

S. K. Das, “Modernizing QA Frameworks for Omni-Based Retirement Systems : A Shift from Manual Mainframe Testing to Intelligent Automation .,” vol. 06, no. 5, pp. 68–89, 2025.

K. Patel, S. B. Thakare, and N. K. Balaraman, “Resilient Hardware Lifecycle Management Through Agile Engineering Approaches for Sustainable Prototype-To-Production Transitions,” 2026, pp. 292–307. doi: 10.1007/978-3-032-28616-1_23.

N. Medeshetty, A. N. Ghazi, S. Alawadi, and F. Alkhabbas, “From Requirements to Test Cases : An NLP-Based Approach for High-Performance ECU Test Case Automation,” 2025, doi: 10.48550/arXiv.2505.00547.

Jariwala, “Construction Execution Methodologies for Modular Data Center Deployment: A Field-Based Framework for Mission-Critical Infrastructure Delivery,” J. Inf. Syst. Eng. Manag., vol. 11, no. 3s, pp. 2630–2643, Sep. 2026.

Duggasani, “The Integration of Java-Based Applications in Software Development and AI: A Conceptual Review,” Int. J. Adv. Res. Sci. Commun. Technol., vol. 5, no. 1, p. 11, Sep. 2025.

Bhanushali, “Ensuring Software Quality Through Effective Quality Assurance Testing: Best Practices and Case Studies,” Int. J. Adv. Eng. Res., vol. 26, no. 4, pp. 1–18, 2023.

H. Sivaraman, “Natural Language Processing For Automated Test Case Generation From Software Requirement Documents,” Int. J. Core Eng. Manag., vol. 5, no. 12, March, pp. 99–104, 2019.

S. R. Sagili, “Prompt-Instructed Generative based AI for Enhancing Transformer effectiveness Analysis,” in 2024 Asian Conference on Intelligent Technologies (ACOIT), 2024, pp. 1–5. doi: 10.1109/ACOIT62457.2024.10939616.

J. W. Lim et al., “Test case information extraction from requirements specifications using NLP-based unified boilerplate approach,” J. Syst. Softw., vol. 211, p. 112005, May 2024, doi: 10.1016/j.jss.2024.112005.

S. Kumar, K. Napte, R. Rani, and S. K. Pippal, “A method for IoT devices test case generation using language models,” MethodsX, vol. 14, p. 103340, Jun. 2025, doi: 10.1016/j.mex.2025.103340.

H. P. Kapadia, “Voice and Conversational Interfaces in Banking Web Apps,” J. Emerg. Technol. Innov. Res, vol. 8, no. 6, pp. g817--g823, 2021.

G. Maddali and S. J. Wawge, Site Reliability Engineering. 2025.

Dudhipala, R. Karne, and P. K. Pativada, “Prompt2Graph: Leveraging LLMs to Construct Knowledge Graphs from Technical Manuals,” in 2025 4th International Conference on Innovative Mechanisms for Industry Applications (ICIMIA), IEEE, Sep. 2025, pp. 912–919. doi: 10.1109/ICIMIA67127.2025.11200177.

F. D. Ashkezari, “Investigating the usefulness of LLMs in Test Case Generation,” 2024.

S. P. Kalava, “Enhancing Software Development with AI-Driven Code Reviews,” North Am. J. Eng. Res., vol. 5, no. 2, pp. 1–7, 2024.

R. Ande, “A Unified Optimization Framework for Large Language Models in Enterprise Applications Using Python,” J. Comput. Anal. Appl., vol. 33, no. 6, pp. 2111–2122, 2024.

G. Kathiresan, “Automated Test Case Generation with AI: A Novel Framework for Improving Software Quality and Coverage,” World J. Adv. Res. Rev., vol. 23, no. 2, pp. 2880–2889, Aug. 2024, doi: 10.30574/wjarr.2024.23.2.2463.

M. A. Sami, Z. Rasheed, M. Waseem, Z. Zhang, T. Herda, and P. Abrahamsson, “A Tool for Test Case Scenarios Generation Using Large Language Models,” 2024, doi: 10.48550/arXiv.2406.07021.

S. Thangavel, S. Srinivasan, S. B. V. Naga, and K. Narukulla, “Distributed Machine Learning for Big Data Analytics: Challenges, Architectures, and Optimizations,” Int. J. Artif. Intell. Data Sci. Mach. Learn., vol. 4, no. 3, pp. 18–30, Oct. 2023, doi: 10.63282/3050-9262.IJAIDSML-V4I3P103.

R. Q. Majumder, “Machine Learning for Predictive Analytics: Trends and Future Directions,” Int. J. Innov. Sci. Res. Technol., vol. 10, no. 4, pp. 3557–3564, 2025.

X. Zhao, H. Wang, J. Ding, Z. Hu, Q. Tian, and Y. Wang, “Augmenting software quality assurance with AI and automation using PyTest-BDD,” Autom. Softw. Eng., vol. 33, no. 1, p. 23, May 2026, doi: 10.1007/s10515-025-00566-w.

N. Li, Y. Xu, J. Luo, and J. Fang, “AI-Driven Test Case Generation Based on DeepSeek-Chat Large-Language Model,” in 2025 5th International Symposium on Computer Technology and Information Science (ISCTIS), IEEE, May 2025, pp. 1–4. doi: 10.1109/ISCTIS65944.2025.11065082.

Z. U. Abideen and G. Junxia, “Intent Based E2E Automated Test Case Generation for Web Applications Using LLM,” in 2025 IEEE 49th Annual Computers, Software, and Applications Conference (COMPSAC), IEEE, Jul. 2025, pp. 1281–1290. doi: 10.1109/COMPSAC65507.2025.00161.

L. Naimi, E. M. Bouziane, M. Manaouch, and A. Jakimi, “A new approach for automatic test case generation from use case diagram using LLMs and prompt engineering,” in 2024 International Conference on Circuit, Systems and Communication (ICCSC), IEEE, Jun. 2024, pp. 1–5. doi: 10.1109/ICCSC62074.2024.10616548.

H. Edirisinghe and D. Wickramaarachchi, “Quality Assurance for LLM-Generated Test Cases: A Systematic Literature Review,” in 2024 8th SLAAI International Conference on Artificial Intelligence (SLAAI-ICAI), IEEE, Dec. 2024, pp. 1–6. doi: 10.1109/SLAAI-ICAI63667.2024.10844968.

F. Chen, Y. Zhao, and Z. Li, “Research on Software Test Case Generation based on SysML,” in 2023 International Symposium on Intelligent Robotics and Systems (ISoIRS), IEEE, May 2023, pp. 173–177. doi: 10.1109/ISoIRS59890.2023.00044.

Article Statistics

Downloads

Download data is not yet available.

Copyright License

Download Citations

How to Cite

Dr. Nilesh Jain. (2026). A Review of NLP-Driven Test Case Generation Using Large Language Models for Software Quality Assurance. International Journal of Computer Science & Information System, 11(11), 11–19. https://doi.org/10.55640/ijcsis/Volume11Issue11-02