I'm not too sure about the regular client, but I use mirror mode and I haven't been banned. I assume detection is based upon what you're botting, and if your account is suspicious (level 3, no quests, commonly botted skill/area).
Edit: And like it was said above, they probably only notice you aren't using their client.