Resolve Speculative Decode RTE #1019

Job	Run time
Dependency Review	4s
CodeQL Scan	3m 10s
Calculate Tests To Trigger	4s
Test / gsm8k_small_g3_tp1	1s
Test / gsm8k_small_g3_tp2	2s
Test / gsm8k_small_g2_tp1	1s
Test / gsm8k_small_g2_tp2	2s
Test / gsm8k_large_g3_tp2	1s
Test / gsm8k_large_g2_tp4	1s
Test / gsm8k_small_g3_tp1_fp8	1s
Test / gsm8k_small_g3_tp2_fp8	1s
Test / gsm8k_small_g3_tp1_mss	1s
Test / gsm8k_small_g2_tp1_mss	1s
Test / gsm8k_small_g3_tp2_mss	2s
Test / gsm8k_small_g2_tp2_mss	1s
Test / gsm8k_small_g2_tp1_spec_decode	2s
Test / gsm8k_small_g2_tp1_mlp_spec_decode	2s
Test / gsm8k_small_g2_tp1_medusa_spec_decode	1s
Test / gsm8k_small_g2_tp1_eagle_spec_decode	1s
Test / test_llama_lora	1s
Test / test_multilora	2s
Test / test_long_context	1s
Test / multimodal_small_g3_tp1	1s
Test / multimodal_small_g3_tp2	1s
Test / multimodal_small_g3_tp1_mss	2s
Test / multimodal_small_g3_tp2_mss	2s
Test / test_awq	1s
Test / test_gptq	2s
Test / test_lazy_outlines	1s
Test / test_guided_generate	2s
	3m 55s

Provide feedback