Banks need to face the music as survey reveals credit card users are ready to move