I originally typed out a reply saying that if I bought a sure-to-be-expensive self-driving car, I would be disappointed if it made my trip slower.
But then I thought that maybe if I wasn't the one fighting to get into lanes I wouldn't care that my trip ended up a couple of minutes longer, I would just relax and read a book and not even pay attention while all that was happening.
Not sure if that would work in reality though. In my city if a car that was that passive was recognized, people would just take total advantage of it and never let it in, cut it off, etc. I think that I would still get annoyed watching this as a passenger.
The car would have to make sudden stops to avoid accidents every time someone cut it off as well, which would be unpleasant for a passenger.
Yes, people will merge ahead of you, and it will slightly slow down your journey.
That's fine, and falls under the definition of safe driving.
Let them merge ahead of you.