Good idea in theory, but many of the announcers bet on the games thus blowing their impartial view of the play. But then again, who's to say the replay ref doesn't have some outside interest as well. I do agree that most times the review is correctly called by the announcers though.