Skip to content

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #319

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #319

Annotations

1 warning

The logs for this run have expired and are no longer available.