Mail server does not sent bounce message to sender

When I sent a message to e.g. a non-existent mail address the mail is directly frozen.
But I do not receive a bounce mail at the sender the mail address.

Is this standard or is there something wrong?

I do see the following in the log:

Process failed (1) when writing error message to name@domain.ext (frozen)

What can I do to solve this?

Many thanks