I have yet to be stopped by a muggle (actually yet to find a cach) but I know exactly what I would do. I would use the jedi mind trick on them.
When they stop me and ask what am I doing I will look at them and wave my hand in front of their face while saying:
"These aren't the droids your looking for. Move along"