Generally the impressions stop immediately. But since the stats do not reflect clicks realtime, they tend to keep tallying for several more hours - especially if you had the partner sites (ie. AOL) enabled.
If you keep seeing the ad after you have deleted the keyword, let AdWords know.
seasalt