1 Pull request opened by 1 person

• Fix typo

  #83 opened Feb 11, 2025

1 Issue closed by 1 person

• Subsequent requests cannot be sent until 'num_concurrent_requests' requests have all finished

  #56 closed Feb 22, 2025

2 Issues opened by 2 people

• Cannot build with `ray` in Docker

  #84 opened Feb 23, 2025

• commit: f1d6bed , In some scenarios, the number of requests will double and the input length will be fixed at two number

  #82 opened Feb 10, 2025

2 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Sagemaker client issue

  #53 commented on Feb 7, 2025 • 0 new comments

• Divide by zero: request_metrics[common_metrics.REQ_OUTPUT_THROUGHPUT] = num_output_tokens / request_metrics[common_metrics.E2E_LAT]

  #55 commented on Feb 20, 2025 • 0 new comments