A settlement can only be raided once per day by anybody. For example, if Vekaro was to be raided by Kal'Arkon, that would be it for that day. No more raids on Vekaro. So how would someone know if a settlement got raided already?
alot of times settlements are proactive and put up signs, but unfortunately this has always been a problem with the raid rules (knowing whether or not it has). I usually just back off if they mention it while I am doing the RP part of the raid before initiating combat.