An artificial intelligence (AI) system may be assessed on how well it prioritises insurance claims for review, then given a different task: recommending whether to accept or refuse them. Evidence that it can prioritise claims reliably does not establish whether its recommendations to accept or refuse claims are sound.