If you look at Makefile.pre.in, you'll see that on Unix it builds a special binary: Modules/_freezeimportlib.c;  it uses most of Python machinery (except importlib, of course), and manually open importlib/_bootstrap.py, compiles it, and marshals the result to importlib.h.

Your solution on Windows is to use the full python.exe instead.