They "broke" that in the mobile app. It used to be that it would cache the stuff you had listened to (very useful in London where there is no network signal in the tube), but now it seems you always have to be online to listen.