Yes, do what we did - we bought a heavy duty galvanised feed bin secondhand and drilled a series of holes long enough in the bottom for the earth stake to go through. You can add extra weight to the bin by putting bricks or paving slabs in the bottom.
We drilled a hole out of the back to take the fencer unit wire. we house the battery - fencer unit and we added a solar panel (screwed to the lid) and any other 'valuable ' in the bin.
We added a hasp and catch to the front and lock it with a heavy duty padlock. The fencer is left on all the time, but the solar panel trickle charges it. We have a crocodile clip on the wire end so we can easily detach that from the fence and clip onto a spare fencer stake to disable the charge for maintenance etc.
Similar to above, I had metal box made with holes in back for wires to attach to fence and earth stake, weighted down with concrete blocks. Did the job for 5yrs before the thieving b******s sawed through the hasp. Use heaviest duty hasps/padlocks you can afford ie £50+ each minimum, as my hasp wasn't good enough and my £60 padlock went even though it would be no use to thief. Luckily just by chance found it tossed in the opposite field a year later, still intact.