autophagian parent
I've had experience lately of getting GPT4 to output some code, I notice there's a bug, I point out the bug (not even 'it's at this line with this variable', but just that it exists) and, yes, it does fix successfully fix it. So, yes, I think that's likely.
Well that required you to understand the code. My reply is disbelief off codebases that no one understands in the near term when looking at the current output. People don't trust the output and do what you did, review it and catch the potential bug before going further with it.
The issue take with it is that we are able to trust the output of AI models as we trust the output of optimizing compilers. It isn't even close that we can just fire and forget the prompt like I can code up something and trust that it 99,999% the optimizer produces the desired binary that works as intended.