The reason people think you are suspicious is because you act suspicious.
When people look at you say something.
Like good morning, nice day or in my case howdy.
You are just out to enjoy a nice day just like them.
Keep your phone low and by your side.
When someone comes by act like you are texting or talking on your phone.
The only time you have to be careful is when you are going for or replacing the cache.
Just my 2 cents hope it helps