I went during off season with a group of friends and had the exact same experience. There were times we didn't see anyone. Most people we saw were in the early mornings, those stopping by to shop and such.
I was legit thinking of doing this today when I saw 3 cars parked like idiots in the lot. No cameras too. So tempting the more it happens.