Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path. #1519

Closed
wants to merge 1 commit into from

Conversation

wForget
Copy link
Member

@wForget wForget commented Dec 7, 2021

Why are the changes needed?

Make KYUUBI_WORK_DIR_ROOT as the default root path. For details: #1509.

How was this patch tested?

  • Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • Add screenshots for manual tests if appropriate

  • Run test locally before make a pull request

@yaooqinn
Copy link
Member

yaooqinn commented Dec 7, 2021

will it work properly for cluster mode? when KYUUBI_WORK_DIR_ROOT only exists on server node but is passed to a remote engine

@codecov-commenter
Copy link

Codecov Report

Merging #1519 (ff078e5) into master (542cead) will decrease coverage by 0.17%.
The diff coverage is 84.61%.

Impacted file tree graph

@@             Coverage Diff              @@
##             master    #1519      +/-   ##
============================================
- Coverage     59.38%   59.21%   -0.18%     
  Complexity      172      172              
============================================
  Files           238      241       +3     
  Lines         12168    12192      +24     
  Branches       1491     1496       +5     
============================================
- Hits           7226     7219       -7     
- Misses         4331     4359      +28     
- Partials        611      614       +3     
Impacted Files Coverage Δ
...ommon/src/main/scala/org/apache/kyuubi/Utils.scala 66.33% <75.00%> (+0.74%) ⬆️
.../engine/spark/session/SparkSQLSessionManager.scala 89.74% <100.00%> (+0.26%) ⬆️
...rg/apache/kyuubi/metrics/JsonReporterService.scala 86.66% <100.00%> (ø)
...g/apache/kyuubi/session/KyuubiSessionManager.scala 97.29% <100.00%> (+0.07%) ⬆️
...cala/org/apache/kyuubi/session/SessionHandle.scala 46.42% <0.00%> (-34.83%) ⬇️
.../org/apache/kyuubi/operation/OperationHandle.scala 67.44% <0.00%> (-29.23%) ⬇️
...ache/kyuubi/engine/spark/SparkProcessBuilder.scala 84.76% <0.00%> (-2.86%) ⬇️
...ache/kyuubi/operation/KyuubiOperationManager.scala 81.57% <0.00%> (-2.64%) ⬇️
...apache/kyuubi/server/api/v1/SessionsResource.scala 78.78% <0.00%> (-0.35%) ⬇️
...ngine/trino/TrinoThriftBinaryFrontendService.scala 0.00% <0.00%> (ø)
... and 7 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 542cead...ff078e5. Read the comment docs.

@wForget
Copy link
Member Author

wForget commented Dec 7, 2021

will it work properly for cluster mode? when KYUUBI_WORK_DIR_ROOT only exists on server node but is passed to a remote engine

When only KYUUBI_WORK_DIR_ROOT is configured, it can work properly for cluster mode. Related screenshots: #1509 (comment)

Under what circumstances will environment variables be passed to remote engine?

@yaooqinn yaooqinn added this to the v1.4.1 milestone Dec 7, 2021
@yaooqinn yaooqinn closed this in 986d983 Dec 7, 2021
yaooqinn pushed a commit that referenced this pull request Dec 7, 2021
<!--
Thanks for sending a pull request!

Here are some tips for you:
  1. If this is your first time, please read our contributor guidelines: https://kyuubi.readthedocs.io/en/latest/community/contributions.html
  2. If the PR is related to an issue in https://github.com/apache/incubator-kyuubi/issues, add '[KYUUBI #XXXX]' in your PR title, e.g., '[KYUUBI #XXXX] Your PR title ...'.
  3. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP][KYUUBI #XXXX] Your PR title ...'.
-->

### _Why are the changes needed?_
<!--
Please clarify why the changes are needed. For instance,
  1. If you add a feature, you can talk about the use case of it.
  2. If you fix a bug, you can clarify why it is a bug.
-->

Make KYUUBI_WORK_DIR_ROOT as the default root path. For details: #1509.

### _How was this patch tested?_
- [X] Add some test cases that check the changes thoroughly including negative and positive cases if possible

- [X] Add screenshots for manual tests if appropriate

- [X] [Run test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests) locally before make a pull request

Closes #1519 from wForget/KYUUBI-1509.

Closes #1509

ff078e5 [Wang Zhen] [KYUUBI-1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.

Authored-by: Wang Zhen <[email protected]>
Signed-off-by: Kent Yao <[email protected]>
(cherry picked from commit 986d983)
Signed-off-by: Kent Yao <[email protected]>
@yaooqinn
Copy link
Member

yaooqinn commented Dec 7, 2021

thanks, merged to master and v1.4.1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants