I have a similar issue, except I start to space out when I'm reading physical books. For me listening to someone's voice really helps with getting through a book. Typically when I listen to audiobooks I'm not doing anything strenuous, I'm usually just relaxed on the couch.