You know, this is how I see the events of Endgame, it isn't your history you are affecting, it's technically only happening right now, so just treat it like visiting a foreign country. You aren't going to break any obvious laws or anything, but whether you overlook some crime in front of you, is on your conscience, not excused by timey-wimey nonsense.