As some of you might be aware, since CPython 3.13, there is experimental support for an alternative interpreter distribution (via PEP703) that disables the GIL altogether, thus enabling support for real thread parallelism.
As of now, sentencepiece can be build without any issues on 3.13t, however, more testing is required in order to ensure free-threading compatibility, which can be summarized in performing the following tasks:
I can volunteer in taking charge of these tasks if necessary
As some of you might be aware, since CPython 3.13, there is experimental support for an alternative interpreter distribution (via PEP703) that disables the GIL altogether, thus enabling support for real thread parallelism.
As of now, sentencepiece can be build without any issues on 3.13t, however, more testing is required in order to ensure free-threading compatibility, which can be summarized in performing the following tasks:
I can volunteer in taking charge of these tasks if necessary