It's true, every moment we refer to as 'now' is at least 10-50ms in the past.
So you could even say we live in the future as it flows towards us, but we can only observe it after it has passed such that our senses have apprehended it. That is why there is no 'now'. At best 'now' would be what is taking place only in our brains. Everything else is lagging behind that.