I don't see the effect you describe, however it sounds similar to what I see when I'm looking at clouds sometimes: they appear to be rushing away from the point I'm looking at. Then I blink and they're as they've always been. My mother gets the opposite effect: things rush in to the point she's looking at. We always assumed it was something to do with the dilation of the eye as you look between different areas of brightness.