Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only decode plan in LaunchMultiTaskParams once #743

Merged
merged 16 commits into from
Apr 13, 2023
Merged

Only decode plan in LaunchMultiTaskParams once #743

Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
28f6029
Only decode plan once
Apr 12, 2023
882a9d5
WIP
Apr 12, 2023
da7614f
Merge branch 'main' into only_decode_once
Dandandan Apr 12, 2023
71e5f79
WIP
Apr 12, 2023
1805931
Clippy
Apr 13, 2023
dd448a3
Refactor
Apr 13, 2023
85c4657
Refactor
Apr 13, 2023
da5ea80
Refactor
Apr 13, 2023
2a77ba8
Refactor
Apr 13, 2023
7bc47e5
Fmt
Apr 13, 2023
dd1750e
clippy
Apr 13, 2023
f1ff895
clippy
Apr 13, 2023
bdab37d
Cleanup
Apr 13, 2023
5ca8bf7
Reuse querystage exec
Apr 13, 2023
c98f504
Fmt
Apr 13, 2023
62ef371
Cleanup
Apr 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
WIP
  • Loading branch information
Daniël Heres committed Apr 12, 2023
commit 71e5f7960dfe45a1faa18c92bc658442320a90a0
12 changes: 9 additions & 3 deletions ballista/executor/src/executor_server.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -303,7 +303,13 @@ impl<T: 'static + AsLogicalPlan, U: 'static + AsExecutionPlan> ExecutorServer<T,
) -> Result<Arc<dyn ExecutionPlan>, BallistaError> {
let runtime = self.executor.runtime.clone();
let task = curator_task;
let task_props = task.props.clone();
let task_props = task.props;
let mut config = ConfigOptions::new();
for (k, v) in task_props {
config.set(&k, &v)?;
}
let session_config = SessionConfig::from(config);

let mut task_scalar_functions = HashMap::new();
let mut task_aggregate_functions = HashMap::new();
for scalar_func in self.executor.scalar_functions.clone() {
Expand All @@ -314,9 +320,9 @@ impl<T: 'static + AsLogicalPlan, U: 'static + AsExecutionPlan> ExecutorServer<T,
}

let task_context = Arc::new(TaskContext::new(
task_identity.clone(),
Some(task_identity.clone()),
task.session_id.clone(),
task_props,
session_config,
task_scalar_functions,
task_aggregate_functions,
runtime.clone(),
Expand Down