I'm not too sure about non-fiction books -- especially popular science -- but reading (good) fiction books is definitely worth it. You might think that fiction is nothing but made up stories, but usually it contains several life lessons that were hard-earned for the author and they're placed within a relevant context.

As for technical non-fiction books, some of them can be really good and irreplacable.