Having the right of way doesn't exempt you from responsibility. Just walking (or pulling) out into traffic and expecting everybody to see you, perceive you, and be able to stop in time is a good way to get hit by a bus.
Are you in the right? Yes.
Does it always matter? No. Physics will always win.