This is a choice you should make yourself. Do you no longer find enjoyment on the server? Do you feel that it wastes your time? Do you feel that your feelings are being hurt, and no longer wish to deal with that? Take into consideration what you think is best for yourself, and then follow through on it.