I have had performance issues with Visual Studio for a long time. For example open projects, adding files and installing NuGet packages had taken very long time.
Last week I talked one of our TFS experts at Sogeti and he asked me how many files I had in my TFS workspace. I had more than 60 000 files in the workspace. I said that it could be the problem.
When using local workspace, Visual Studio scanning the file system for changes. If a workspace contains more than 50 000 files it could affect the performance.
I tried to split my workspaces into smaller parts, and he had right, Visual Studio is much faster now than before.
The conclusion of this is, try to keep your workspace as small as possible and if you have to have a workspace that contains more than 50 000 files, use server workspace instead.