I use something similar to that, I found moving entities or the player's movement itself cause enough inaccuracy where nothing more is needed. I also got better results when only a small portion of the entity was visible or entities with holes in them. Some modification is still needed to the points for some entities, such as fire, or ladders, objects that are half submerged underground. Mine removes any points that are below the position it's on.