It would only be trying to move it anyway if you had the drag tool selected. If you have the pencil selected it won't try to move anything. I think perhaps having the whole image selected is the default, but I've never noticed because I don't normally have the drag tool selected.