I don't see what's passive-aggressive about it. Telling people that a particular behaviour will outrage* you sounds like fairly straightforward boundary setting to me.

*or upset, or disappoint**, or whatever
**generally what I would mean by "I expect you not to do this" if I don't mean surprise