Claude 3.5 Sonnet was able to solve 64% of problems related to bug fixing and functionality additions with open source codebases, a significant improvement over Claude 3 Opus’ 38% success rate.