I think when do a source .bashrc or exec bash which is like a restart then you loose the virtual setting and you have precisely the same final result as putting deactivate. So you might want to adjust your solution. This may be valuable for reproducing the habits, seeing if you can make it vanish