crash when running GFS PBL/sfclay and clm lake in RRFS ensemble

[JiliDong-NOAA]

Description

A couple of RRFS ensemble members crashed with GFS PBL (TKE-EDMF)/sfclay and clm lake combined. This happened when lake water was frozen to lake ice in clm lake.

Steps to Reproduce

1. perform a forecast with GFS PBL/sfclayer combined with clm lake
2. wait for lake water turning into lake ice, which could happen in winter time further north
3. model crashed with AVOST error message from RUC LSM

Additional Context

The reason for the crash is because clm lake is called between surface layer scheme and PBL scheme. If there is a state change in clm lake, particularly water turning into ice, stability related variables over ice will be missing and cause the crash.
Please see the attached slides for more information.

clm_lake_bug_fix.pptx

A PR will be submitted soon.

Output

Please include any relevant log files, screenshots or other output here.