Anyone able to configure Datadog for AI Trust Layer OpenTelemetry?

I am interested in sending LLM traces to Datadog and not sure the AI Trust Layer’s preview OpenTelemetry Collector supports it yet. Datadog’s OpenTelemetry requirements are stated here. Has anyone succeeded in setting this up, with Datadog or other endpoints?

Thanks,
Brian

No the preview ai trust layer OTEL collector doesnt support datalog directly. it only exports raw OTLP, and datalog needs conversion through a datalog agent or OLTP proxy. so u must route tarces through datalog’s OTEL reciver, dircet export isnt availbale yet

for now u must forward traces to a Datalog agent otlp endpoint to handle protocol conversion

Thanks Manish,

Datadog has OTLP ingest endpoints for traces/logs/metrics, but still I am not able to see any messages coming in. Have you seen this feature working?

Hi @Brian_Williams

Welcome to the community

The AI Trust Layer OTEL collector cannot send traces directly to Datadog.

Data-dog’s cloud OTLP endpoint does not accept raw OTLP from the preview collector.

Please try with this approach

AI Trust Layer → OTEL Collector → Datadog Agent (OTLP enabled) → Datadog APM

You must send your traces to the Data-dog Agent’s OTLP receiver:

  • gRPC: 4317

  • HTTP: 4318

The Datadog Agent converts the traces into the Datadog format.

Direct export to Datadog cloud will not work

Cheers

hi @Brian_Williams

You can send AI Trust Layer LLM traces to Datadog, but the preview collctor may not support a builtin Datadog exporter yet

The simplest setup is to point the Trust Layer’s OTLP output to either the Datadog Agent which accepts OTLP or to your own opentelemetry Collector that forwards data to Datadog.

Thanks @nishiijain2000 and @Jp_Khetan. I set up a vanilla OpenTelemetry Collector on a GCP VM, without TLS, and do not see traces coming in, trying an endpoint URL with and without /v1/traces. Perhaps I must wait for the official documentation to appear.

Your welcome @Brian_Williams

If solution will help u please mark as solved

Hi @nishiijain2000 , unfortunately, I don’t have a solution yet.

Okay please let me know what error you are fasing now