I cable-tied (as more secure!) a sponge to the end of a thin-ish broom handle, and stuck it in and scrubbed with that - can be a bit time consuming but gets there!
Wet towel, or something similar depending on size of container, with some water and detergent in the container, and shake/slosh it around. The towel should help rub off the dirt.