13bL40_new.log

Max Length :384, Decode Length :1, Prefix Length :192, inference time:0.03910466811656952s
Max Length :384, Decode Length :2, Prefix Length :192, inference time:0.04092909181118012s
Max Length :384, Decode Length :4, Prefix Length :192, inference time:0.041168826079368594s
Max Length :384, Decode Length :8, Prefix Length :192, inference time:0.041443499350547794s
Max Length :384, Decode Length :16, Prefix Length :192, inference time:0.04220516695976257s
Max Length :384, Decode Length :32, Prefix Length :192, inference time:0.04697649834156036s
Max Length :384, Decode Length :64, Prefix Length :192, inference time:0.04870879485607147s
Max Length :384, Decode Length :128, Prefix Length :192, inference time:0.05437597572803497s