This is actually an idea that has been utilized in experiments in the past. Some of us have had our memories temporarily altered to believe that certain events we experienced turned out differently, sometimes causing radical changes to our pasts.

Of course, those were merely memories. But absolutely nothing says that worlds like that cannot exist out there in some form.