Don't cache in some special modes

[cireu]

I found the cache mechanism sometimes annoying. For example, when using
macrostep or lsp-ui peek won't trigger cache update because put overlay on a
buffer don't actually modify a buffer. And add a new directory in dired with
dired-create-directory also don't update cache and you can't find created
direcotory in dired buffer.

I believe we should update cache mechanism, or be more aggressive to remove it.
The pros and cons of cache needs to be considered

Related issues: #112