Home Back to Blog Photography Sailing CV Contact
We had a problem all to familiar to development teams recently: Important feature needs releasing, but there is a backlog of pull requests which need reviewing.
I decided to give GPT-assisted PR review another try.
TL;DR - it’s promising but still needs work.
I ran GPT against some spike (i.e. crap) code used to generate some statistics for this website, and here’s what it found:
The open source tools in this space are still evolving. I’m on waitlist for Github Next’s Co-Pilot PR Review, which seems to be the most promising.
The token limit (4k or 10k) barely fits small PRs, and splitting them across multiple requests limits static analysis capabilities.
Here is the sample review output for the crapcode PR reviewed: https://github.com/cianclarke/cianclarke.com/pull/3#discussion_r1259484521
If you’ve got any experience with GPT-assisted PR review, I’d love to hear about it.