I think negative feedback has too big of an impact. If a buyer sees someone has negative feedback, it WILL deter them from not trading with the guy.
Trading on this website can't always be very smooth because some things just take a while and real life can interfere aswell.
Straight up rudeness though, should be punishable with neutral or negative feedback