Is it just me, or does going back in time...?

You can go back and kill Oswald because time for you is linear from 2008 to 1963 and back to 2008. However, the rest of the universe is altered because it is outside of your own personal time.