Some of us are looking to learn or do a specific thing, not just waste time on whatever videos YouTube is recommending. This weekend I am planning to install a tow hitch on my car. I highly doubt YouTube is going to recommend just the right video for that at exactly the right time. YouTube knows me pretty well, but I doubt they know whether I want to learn about dark matter or modular synthesizers at this exact moment.
YouTube's entire business model is to occupy your time; whether it's a waste or not doesn't matter to their bottom line. They will absolutely not do anything to minimize the waste.
If YouTube notices people keep bouncing from your video it will not perform well due to the algorithm. YouTube wants you to be watching content, and not spending time searching around for content to watch.
What you are missing is that YouTube recommends videos that you will likely enjoy. YouTube's recommendations try to minimize this waste.