Hello,

Context

It seems that when the payload sent to the LLM Observability endpoint (llmobs-intake.datadoghq.eu) exceeds 1MB, the corresponding LLM Obs spans are not correctly ingested. Specifically, we notice that:

• No LLM Obs spans appear in the platform.
• There are no links between APM spans and LLM Obs spans.

In the codebase:

• The dd-trace library sets the max payload size as EVP_PAYLOAD_SIZE_LIMIT = 5 << 20 (i.e. 5MB, with an actual limit of 5.1MB).
• The Datadog Agent configures the EVP proxy with MaxPayloadSize: 5 * 1024 * 1024.

Question

Does the LLM Observability intake endpoint (llmobs-intake.datadoghq.eu) support and process payloads larger than 1MB? If not, is there a recommended way to handle larger payloads for LLM Obs spans?

Thanks in advance!