Welcome to DU!
The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards.
Join the community:
Create a free account
Support DU (and get rid of ads!):
Become a Star Member
Latest Breaking News
Editorials & Other Articles
General Discussion
The DU Lounge
All Forums
Issue Forums
Culture Forums
Alliance Forums
Region Forums
Support Forums
Help & Search
General Discussion
Related: Editorials & Other Articles, Issue Forums, Alliance Forums, Region ForumsCodeRabbit review of pull requests shows meatbags beat clankers
AI-authored code contains worse bugs than software crafted by humansThe Register (UK)
AI-authored code contains worse bugs than software crafted by humans
CodeRabbit review of pull requests shows meatbags beat clankers
Generating code using AI increases the number of issues that need to be reviewed and the severity of those issues.
CodeRabbit, an AI-based code review platform, made that determination by looking at 470 open source pull requests for its State of AI vs Human Code Generation report.
The report finds that AI-generated code contains significantly more defects of logic, maintainability, security, and performance than code created by people.
On average, AI-generated pull requests (PRs) include about 10.83 issues each, compared with 6.45 issues in human-generated PRs. That's about 1.7x more when AI is involved, meaning longer code reviews and increased risk of defects.
Problems caused by AI-generated PRs also tend to be more severe than human-made messes. AI-authored PRs contain 1.4x more critical issues and 1.7x more major issues on average than human-written PRs, the report says.
Machine-generated code therefore seems to require reviewers to deal with a large volume of issues that are more severe than those present in human-generated code.
These findings echo a report issued last month by Cortex, maker of an AI developer portal. The company's Engineering in the Age of AI: 2026 Benchmark Report [PDF] found that PRs per author increased 20 percent year-over-year even as incidents per pull request increased by 23.5 percent, and change failure rates rose around 30 percent.
...
3 replies
= new reply since forum marked as read
Highlight:
NoneDon't highlight anything
5 newestHighlight 5 most recent replies
CodeRabbit review of pull requests shows meatbags beat clankers (Original Post)
Munu
Dec 18
OP
Often times, I think it's easier to write code from scratch than to analyze code ...
Intractable
Dec 18
#2
hvn_nbr_2
(6,748 posts)1. What is a "pull request"?
cojoel
(1,020 posts)3. A pull request is a request to merge new code into a shared code repository
The new code is developed in a private workspace, and when the developer(s) think it is ready to incorporate into the shared repository they issue a pull request, to "pull" the changes from the private workspace into the main. This triggers a review process where bugs are found and fixed, and eventually a concensus is reached as to whether the code will be included in the main repository.
Intractable
(1,634 posts)2. Often times, I think it's easier to write code from scratch than to analyze code ...
to figure out what it does, or how it works, or how to fix it.