Effective with fzf

When you input:

z -I vim

History directories matching vim will be sorted by frecent and sent to fzf:

You can use arrow key UP/DOWN (as well as CTRL+J/K) to move around the indicator (> symbol) then <ENTER> to accept or <ESC>/CTRL+D to give up.