How many SMS messages can this modem hold (what is the buffer size)? What happens when it gets full, does it overwrite the first message in the stack?

That modem doesn't have memory allocated for SMS messaging. It will only use the memory on the SIM. Once the storage location is full, no more messages will be received from the SMS server. You will have to free up space to receive more messages.