USAID was established by executive order, and no compelling argument has been made against reversing it via the same process.
--
USAID was created by executive order, and I have seen no one presenting a case for why it is "illegal" to undo what is created by executive order, by another executive order.