I would drive down... but I'm a stubborn creature!
On a serious note you need to keep a record of threats. Next time you see them bee-lining for you set the voice recorder on your phone away (im sure alll phones have them these days) that way if they do anything to you or your property you can take the threats to the police.
It is horrible being targeted like this, try not to let it ruin your time with the hoss!