OpenAi's GPT4 as coding assistant (2309.12732v1)

Abstract: Lately, LLMs have been widely used in code generation. GPT4 is considered the most potent LLM from Openai. In this paper, we examine GPT3.5 and GPT4 as coding assistants. More specifically, we have constructed appropriate tests to check whether the two systems can a) answer typical questions that can arise during the code development, b) produce reliable code, and c) contribute to code debugging. The test results are impressive. The performance of GPT4 is outstanding and signals an increase in the productivity of programmers and the reorganization of software development procedures based on these new tools.