Skip to content

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #7378

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding

[Speculative decoding] Add serving benchmark for llama3 70b + speculative decoding #7378