I occasionally enjoy them when I'm between games, and I know I will not have the time or energy to start a new, more involved game.
I see these kind of games as a different medium to tell a story and, if done well, the controls can be a part of the storytelling. The Last of Us is a great example of using controls for this.
As to why not whatch a movie? I cannot sit in front of a screen passively anymore. If I'm with my partner, we can sit together and watch something, otherwise, I want to interact with the screen, even if it's only by walking.