In some cases I'd like to destroy my own units, either because they are too expensive or they are not useful anymore (or both).

Same thought regarding provinces improvements - When the improvement is too expensive, or when I know that my province is going to be occupied. For some buildings there's is an option to disable it, but I'd like to have an option to destroy it completely.