[Fix][Engine-Server] close task when job finished to release resource.

[sohurdc]

Purpose of this pull request

close resource when job finished.

the class SeaTunnelChildFirstClassLoader refered by FileSystem$Cache which not close when job finished.

Does this PR introduce any user-facing change?

no

How was this patch tested?

no, i will add it later after reviewd.

Check list

• If any new Jar binary package adding in your PR, please add License Notice according
  New License Guide
• If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
• If you are contributing the connector code, please check that the following files are updated:
  1. Update plugin-mapping.properties and add new connector information in it
  2. Update the pom file of seatunnel-dist
  3. Add ci label in label-scope-conf
  4. Add e2e testcase in seatunnel-e2e
  5. Update connector plugin_config
• Update the release-note.

[Hisoka-X]

We don't add close method before because Flink/Spark doesn't has close method too. If we add close method on seatunnel api. Flink/Spark can not invoke it for now.

[Hisoka-X]

Have you tried enable classloader-cache-mode? https://seatunnel.apache.org/docs/2.3.9/seatunnel-engine/hybrid-cluster-deployment#45-class-loader-cache-mode

[sohurdc]

It is enabled, but there are still memory leaks in FileSystem$CACHE and HiveConf. I still have the problem of off-heap memory leak. I can't find the reason. I suspect it is related to the FileSystem not being closed.

[Hisoka-X]

It is enabled, but there are still memory leaks in FileSystem$CACHE and HiveConf. I still have the problem of off-heap memory leak. I can't find the reason. I suspect it is related to the FileSystem not being closed.

Maybe you can provide your server log and heap dump file in new issue so we can help to loc the root problem.

[sohurdc]

see there, #8637.
this can be closed.