Answer
Can I compare different prompts or models?
In detail
Yes. Run the same cases against different application versions or prompt and model settings supported by your app. Compare scores and individual outputs to see which cases improved or regressed. You can also re-score saved outputs with a different scorer without calling the application again.