(Closing it only hides it from your list, it appears again any time you chat to that other person...)

Learned today that Discord doesn't allow you to just delete a DM conversation. You can only close it.

You have to delete every individual message inside for them to be gone. Insane.