Skip to content

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #10263

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #10263

Annotations

2 warnings

The logs for this run have expired and are no longer available.