Always run SiLU activation in float32 for LLaMA and Mistral#1540

Merged

mattdangerw merged 2 commits intokeras-team:masterfrom tirthasheshpatel:fix-llama-silu

Apr 1, 2024

+22-2

Commits on Mar 31, 2024

Fix discrepency between HF LLaMA and our implementation
tirthasheshpatel
committed

Commits on Apr 1, 2024

Fix Mistral transformer decoder
tirthasheshpatel
committed