Automated code review tools like GitHub Copilot are on the rise, but how do their reviews compare to those written by human developers? This thesis explores the quality, depth, and relevance of AI-generated reviews to understand whether these tools truly support or replace peer review. Expect to dive into real-world code review data, assess review performance and uncover when AI adds value, or falls short, in development workflows.
Code reviews are a key practice in modern software engineering, improving code quality, maintainability and knowledge sharing within development teams. Traditionally, these reviews are conducted manually by peers. However, with the rise of AI tools like GitHub Copilot, developers can now request automated pull request reviews. While these AI-generated reviews promise greater efficiency, there is little empirical evidence on how their quality compares to that of human reviewers.
The Assignment
In this thesis, you will investigate the quality of AI-generated code reviews. Your focus will be on identifying differences in quality, depth and relevance compared to reviews written by humans. By analyzing these aspects, you will assess whether and how AI can support or complement human reviewers. Your findings will highlight current limitations and provide insights into how development teams can best utilize AI-based review tools in practice.
About Info Support
Info Support specializes in custom software, data/AI solutions, management, and training and is active in the Finance, Industry, Agriculture, Food & Retail, Mobility & Public, and Healthcare sectors. We provide solid and innovative solutions for complex and critical software issues. Our headquarters are located in Veenendaal (NL) and Mechelen (BE). At present, approximately 500 employees are employed by Info Support.
Info Support’s working method is characterized by a number of core values: solidity, integrity, craftsmanship, and passion. These core values are intertwined in our work and the way we interact with each other.
To ensure that all employees are always up to date with the latest developments, Info Support has an in-house IT Academy that eagerly satisfies the hunger for more or different knowledge and skills.
B2 language proficiency in Dutch is required.
