set spark base image tag to that from .make.versions

[daw3rd]

Why are these changes needed?

Releasing has problems since the tag for the base spark image was fixed to be latest.
It now is set from .make.versions, like other images.

Related issue number (if any).

#625

[blublinsky]

Can you also fix https://github.com/IBM/data-prep-kit/blob/dev/.make.defaults#L52. We should not use data-prep-kit-spark-3.5.2 we already have it defined here https://github.com/IBM/data-prep-kit/blob/dev/data-processing-lib/spark/Makefile#L4. Maybe move Spark version make version, similar to https://github.com/IBM/data-prep-kit/blob/dev/.make.versions#L115

[blublinsky]

Also, I do not think it works as desired https://github.com/IBM/data-prep-kit/actions/runs/11036249651/job/30654242163?pr=626#step:4:9415

[daw3rd]

Also, I do not think it works as desired https://github.com/IBM/data-prep-kit/actions/runs/11036249651/job/30654242163?pr=626#step:4:9415

When using a version suffix (i.e. dev0), the image tags are always set to latest (see .make.versions), but when there is no suffix (i.e. when cutting a release), the tag should be the release versions (i.e. 0.2.1). The ci/cd link above is for a dev0 suffix so has the latest tag.

[blublinsky]

Also, I do not think it works as desired https://github.com/IBM/data-prep-kit/actions/runs/11036249651/job/30654242163?pr=626#step:4:9415

When using a version suffix (i.e. dev0), the image tags are always set to latest (see .make.versions), but when there is no suffix (i.e. when cutting a release), the tag should be the release versions (i.e. 0.2.1). The ci/cd link above is for a dev0 suffix so has the latest tag.

How can we prove this? It is soooo confusing

[daw3rd]

Also, I do not think it works as desired https://github.com/IBM/data-prep-kit/actions/runs/11036249651/job/30654242163?pr=626#step:4:9415

Can you be more specific?