The point is with it on a badge you don't need to ask. What about if you go into the bank, speak to Dave first, clock his badge but Dave refers you to another staff member. You explain to the new staff member, starting with Dave's name having been referred to them by him/her/them you then go on to say "As I said to ?". It would be good to give the right pronoun, particularly if Dave is witnessing the conversation, but also for the other staff member who will be accustomed to referring to Dave in a particular way.
It isn’t a huge issue, but handling it in the right way helps Dave and their colleague. It is only a matter of courtesy and respect for everyone you deal with.