I haven't used vimperator for a long time, but in petadactyl you can use C-o and C-i to go back and forth, respectively. The key bind matches pretty well to what it is in Vim too.