I don't think there's any good reason to not be an organ donor.
An important thing to note is that the notation on your driver's license isn't legally binding; your family is the one who makes the decision, so you have to make sure that your wishes are known to them.