[Feature][API] SeaTunnel Transform API

[EricJoy2048]

Search before asking

• I had searched in the feature and found no similar feature requirement.

Description

We already have SeaTunnel Source API and SeaTunnel Sink API, but we don't have SeaTunnel Transform API now.
We need SeaTunnel Transform API and it must have some key features:

• Like source and sink, it is decoupled from the engine and can run on different engines.
• In order to ensure seatunnel's positioning as a data integration platform and not introduce work beyond the plan, the SeaTunnel Transform API will only support UDF level data conversion.
• In theory, UDF level transform does not require checkpoint and state storage.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[EricJoy2048]

@TyrantLucifer @laglangyue @legendtkl @zhuangchong @hailin0 @ashulin @Hisoka-X @CalvinKirs @ic4y @lhyundeadsoul @wolfboys @2013650523 @531651225

I try @ everyone I know.

[ashulin]

+1, I expect to reduce row conversions in the engine translation.

[2013650523]

+1

[TyrantLucifer]

It's great to hear about this exciting decision from the community and I want to be a part of it. It's necessary to develop our own transform API.

[laglangyue]

+1

[lhyundeadsoul]

+1
Looking forward to more details.

[EricJoy2048]

It's great to hear about this exciting decision from the community and I want to be a part of it. It's necessary to develop our own transform API.

YYDS

[hailin0]

In order to ensure seatunnel's positioning as a data integration platform and not introduce work beyond the plan

+1

[ic4y]

+1

[531651225]

+1

[Hisoka-X]

+1

[EricJoy2048]

Is anyone interested in this feature and can create a pr for it?

[TyrantLucifer]

Is anyone interested in this feature and can create a pr for it?

As of now, the api for this part is not designed yet, right?

[EricJoy2048]

Is anyone interested in this feature and can create a pr for it?

As of now, the api for this part is not designed yet, right?

Yes. We need to design it from scratch.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[hailin0]

@EricJoy2048 please assign to me

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[github-actions]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.