p1dda parent
It would be interesting to see which is faster/better in competitive coding, the human coder or the human using AI to assist in coding.
New benchmark for competitive coding dropped yesterday - https://livecodebenchpro.com/
Apparently models are not doing great for problems out of distribution.
It would only be interesting if the problem was truly novel. If the AI has already been trained on the problem it’ll just push out a solution.