Hi Adam @Adam_Meshulam 
I’ve seen similar slowness issue has been reported before for Windows and Mac users. I only have Windows and Linux machines but don’t have Mac here (and have no experiences using Mac before) so couldn’t really check/test/replicate this further, but I saw this previous post which suggested to enable virtiofs option in the Docker Desktop, as mentioned here (and here).
Maybe you may want to check your Docker Desktop and (if you haven’t enabled yet) please try to enable the virtiofs option as suggested in the other posts above, and hopefully if that will make any differences 
Cheers,
Agus