Exchange PST Capture 2.0 has a hard coded requirement in the setup file for PowerShell 3.0. Newer versions of Windows come with Powershell 4.0 nowadays, and the MSI fails installation.
To fix this, download SuperOrca, run it and open the PSTCapture MSI file:
Find the row shown, right click and choose drop row
Save the MSI and you should be good to go!