I was invited to a coalition and just left the invite as an option. After I conquered all provs of the coalition members and the coalition no longer existed the invite notification still shows.

I also noticed that the last country in that coalition to be eliminated is still showing up under "Most Dreaded Nations" in the newspaper. It has no provinces and isn't listed in diplomacy, but perhaps this is related to why the invite notification is still showing.