Is there a command or firmware to allow the 5634ZBA-V92 to run with 11 bits in command mode as well as data (on-line) mode?

No, the modem will only accept 10 bit command characters. So if your device needs to send commands to the modem, it must do it in 10-bit mode, then switch over to 11-bit when online.