How did I not know about this capability?

This is the one thing that I used to miss in Powershell all this while. And just recently I got to know that this can be enabled very simply.

vi mode can be enabled in the profile by adding this –

# Enable Vi editing mode
Set-PSReadLineOption -EditMode Vi