The faster ball will recoil faster, because the collision is partially elastic. The ball compresses at contact with the bat, and the outgoing velocity is faster than the bat velocity by the effect of the compression, which is always increasing with the incoming speed. So all else being equal, the faster ball recoils faster.
