Going into the Docker Desktop menu in the Mac menu bar and selecting “Check for Updates” fixed the problem.
My Docker version was old, and the DevKinsta installer didn’t know what to do if the Docker version was older than it expected. The DevKinsta installer just froze waiting for a message that would never come.