Avoid 100% CPU usage while socket is closed (sleep)

After stop/start kafka service, kafka-python may use 100% CPU caused by busy-retry while the socket was closed. This fix the issue by sleep 0.1 second if the fd is negative.
aiven · Feb 28, 2024 · ce7d853 · ce7d853
1 parent b68f61d
commit ce7d853
Showing 1 changed file with 3 additions and 0 deletions.
diff --git a/kafka/client_async.py b/kafka/client_async.py
@@ -637,6 +637,9 @@ def _poll(self, timeout):
             self._sensors.select_time.record((end_select - start_select) * 1000000000)
 
         for key, events in ready:
+            if key.fileobj.fileno() < 0:
+                time.sleep(0.1)
+
             if key.fileobj is self._wake_r:
                 self._clear_wake_fd()
                 continue