Skip to content

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #16833

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #16833

Annotations

2 warnings

The logs for this run have expired and are no longer available.