You can get some context on this here: microsoft/vscode#123805

Basically PS integrated consoles get reconnected when the window is reloaded currently by design, the PS extension should detect these and kill them before trying to start up another one (or even better re-establish the connection if that's possible).