About the problem that Cot Layer cannot run on multiple cards

Hello author, I tried to extract the Cot Layer in CotNet, but found that the Cot Layer can only run on a single card. If running on multiple cards, the following error will be reported: &rdquo;ValueError: Caught ValueError in replica 0 on device 0&ldquo;.
I don't know why, and I hope to get your guidance.