From 319136e1ff48075899a87f2372520bc59a309e75 Mon Sep 17 00:00:00 2001 From: Hans Van Akelyen Date: Tue, 3 Jan 2023 14:19:48 +0100 Subject: [PATCH 1/2] [DOC] change image name [DOC] fix al warning is master branch --- .../modules/ROOT/pages/hopweb/developer-guide.adoc | 4 +++- .../modules/ROOT/pages/hopweb/index.adoc | 6 ++++-- ...-menu-pipeline.PNG => preview-menu-pipeline.png} | Bin .../modules/ROOT/pages/database/databases.adoc | 4 +++- .../ROOT/pages/database/databases/mssqlnative.adoc | 2 +- .../modules/ROOT/pages/hop-server/index.adoc | 9 ++------- .../ROOT/pages/hop-tools/hop-translator.adoc | 2 ++ .../apache-hop-web-services-docker.adoc | 6 ++++-- .../beam-flink-pipeline-engine.adoc | 4 +++- .../beam-spark-pipeline-engine.adoc | 4 +++- .../native-remote-pipeline-engine.adoc | 12 +++++++----- .../pages/pipeline/transforms/mongodbdelete.adoc | 1 + .../pages/pipeline/transforms/tokenreplacement.adoc | 4 +++- .../ROOT/pages/plugins/import/kettle-import.adoc | 4 ++-- .../modules/ROOT/pages/projects/index.adoc | 2 +- .../pages/snippets/best-practices/variables.adoc | 4 +++- .../modules/ROOT/pages/workflow/actions/shell.adoc | 6 ++++-- .../native-remote-workflow-engine.adoc | 12 +++++++----- 18 files changed, 53 insertions(+), 33 deletions(-) rename docs/hop-user-manual/modules/ROOT/assets/images/hop-gui/pipeline/{preview-menu-pipeline.PNG => preview-menu-pipeline.png} (100%) diff --git a/docs/hop-dev-manual/modules/ROOT/pages/hopweb/developer-guide.adoc b/docs/hop-dev-manual/modules/ROOT/pages/hopweb/developer-guide.adoc index c0ca975218a..3ec3df5f95e 100644 --- a/docs/hop-dev-manual/modules/ROOT/pages/hopweb/developer-guide.adoc +++ b/docs/hop-dev-manual/modules/ROOT/pages/hopweb/developer-guide.adoc @@ -15,6 +15,8 @@ specific language governing permissions and limitations under the License. //// :description: RAP is multi user framework by its nature. Every user session is associated with a display. In RAP, Display#getDefault() will not create a new display when it's called from non-UI thread - read Display#getDefault JavaDoc. When you execute a code in a background thread, RAP needs to know for which UI session (display) it belongs. That's why you have to provide the correct UISession/display from outside. +:openvar: ${ +:closevar: } = Developer Guide @@ -109,7 +111,7 @@ To then run it simply execute: == Configuring Hop Web -The main configuration of Hop is done through a single configuration file called `hop-config.json` and it is found in folder `${HOP_CONFIG_FOLDER}` +The main configuration of Hop is done through a single configuration file called `hop-config.json` and it is found in folder `{openvar}HOP_CONFIG_FOLDER{closevar}` It is possible to set pass this standard Hop environment variable `HOP_CONFIG_FOLDER` to the docker container. You can point it to a mounted volume for example: diff --git a/docs/hop-dev-manual/modules/ROOT/pages/hopweb/index.adoc b/docs/hop-dev-manual/modules/ROOT/pages/hopweb/index.adoc index 06c3561ce71..a6d7975f086 100644 --- a/docs/hop-dev-manual/modules/ROOT/pages/hopweb/index.adoc +++ b/docs/hop-dev-manual/modules/ROOT/pages/hopweb/index.adoc @@ -15,6 +15,8 @@ specific language governing permissions and limitations under the License. //// :description: Building and setting up your own Hop Web environment is straightforward. The steps to set up the default Docker image are included in a helper script docker/create_hop_web_container.sh in the Hop code base. This should get you started to make modifications or create your own version entirely. +:openvar: ${ +:closevar: } = Hop Web Development Guide @@ -82,11 +84,11 @@ export CATALINA_OPTS='${HOP_OPTIONS} -DHOP_AES_ENCODER_KEY="${HOP_AES_ENCODER_KE ---- -If you want to run Hop Web with the `default` and `samples` projects, make sure the project root path in `hop-config.json` is set to `${HOP_CONFIG_FOLDER}. +If you want to run Hop Web with the `default` and `samples` projects, make sure the project root path in `hop-config.json` is set to `{openvar}HOP_CONFIG_FOLDER{closevar}. On Linux or Mac, use the following sed command to fix this in one line: -`sed -i 's/config\/projects/${HOP_CONFIG_FOLDER}\/projects/g' webapps/hop/config/hop-config.json` +`sed -i 's/config\/projects/{openvar}HOP_CONFIG_FOLDER{closevar}\/projects/g' webapps/hop/config/hop-config.json` On Windows, modify `hop-config.json` to make sure `projectsConf` looks like the one below: diff --git a/docs/hop-user-manual/modules/ROOT/assets/images/hop-gui/pipeline/preview-menu-pipeline.PNG b/docs/hop-user-manual/modules/ROOT/assets/images/hop-gui/pipeline/preview-menu-pipeline.png similarity index 100% rename from docs/hop-user-manual/modules/ROOT/assets/images/hop-gui/pipeline/preview-menu-pipeline.PNG rename to docs/hop-user-manual/modules/ROOT/assets/images/hop-gui/pipeline/preview-menu-pipeline.png diff --git a/docs/hop-user-manual/modules/ROOT/pages/database/databases.adoc b/docs/hop-user-manual/modules/ROOT/pages/database/databases.adoc index 49b8564b3e2..622d2d863a2 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/database/databases.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/database/databases.adoc @@ -16,6 +16,8 @@ under the License. //// [[database-plugins]] :imagesdir: ../../assets/images +:openvar: ${ +:closevar: } :description: Hop supports tens of databases out of the box. If your preferred database has no specific support, you can probably still connect through a generic database connection. = Database Plugins @@ -23,7 +25,7 @@ Creating a database connection in HOP is done using one of the many database typ To create a database connection go to file -> New and select Database connection. The connection is saved in a central location and can then be used by all pipelines and workflows. -If you have set your project to work with Hop, the database information will be in the `${PROJECT_HOME}/metadata/rdbms` folder. +If you have set your project to work with Hop, the database information will be in the `{openvar}PROJECT_HOME{closevar}/metadata/rdbms` folder. Each connection created will generate a .json file in this folder with the name of the connection, containing the connection information. If the license allowed it, a jdbc driver is included in the distribution, in a folder specific for each driver, in the general path: `Installation directory/plugins/databases/Database type/lib`. diff --git a/docs/hop-user-manual/modules/ROOT/pages/database/databases/mssqlnative.adoc b/docs/hop-user-manual/modules/ROOT/pages/database/databases/mssqlnative.adoc index 8588ac8c239..9b52b6bb2ec 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/database/databases/mssqlnative.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/database/databases/mssqlnative.adoc @@ -32,7 +32,7 @@ under the License. |Driver folder | Hop Installation/plugins/databases/mssqlnative/lib |=== -= Integrated Authentication / Windows Based Authentication +== Integrated Authentication / Windows Based Authentication The native Microsoft SQL JDBC driver ships with extra files that enables authentication using your current MS Windows credentials. When you download the JDBC drivers from Microsoft's site and unzip them, there will be a directory structure like the following: diff --git a/docs/hop-user-manual/modules/ROOT/pages/hop-server/index.adoc b/docs/hop-user-manual/modules/ROOT/pages/hop-server/index.adoc index d2735abac25..903c6ae6ce8 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/hop-server/index.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/hop-server/index.adoc @@ -182,6 +182,7 @@ Listen to all interfaces on the server: [source,shell] hop-server.sh 0.0.0.0 8080-- +-- ==== @@ -232,9 +233,7 @@ The syntax of this configuration file is fairly simple: ---- -Example startup commands with a configuration file are: - -  + +Example startup commands with a configuration file are: + [tabs] ==== @@ -260,16 +259,12 @@ Linux, macOS:: + -- [source,shell] ----- hop-server.sh /foo/bar/hop-server-config.xml ----- Or with a remote configuration file: [source,shell] ----- hop-server.sh http://www.example.com/hop-server-config.xml ----- You can also enable a project lifecyfle environment for the Hop server: diff --git a/docs/hop-user-manual/modules/ROOT/pages/hop-tools/hop-translator.adoc b/docs/hop-user-manual/modules/ROOT/pages/hop-tools/hop-translator.adoc index a155778d845..e0109815a6c 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/hop-tools/hop-translator.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/hop-tools/hop-translator.adoc @@ -52,3 +52,5 @@ Linux, macOS:: ---- Expected output: the Hop Translator tool starts. +-- +==== \ No newline at end of file diff --git a/docs/hop-user-manual/modules/ROOT/pages/how-to-guides/apache-hop-web-services-docker.adoc b/docs/hop-user-manual/modules/ROOT/pages/how-to-guides/apache-hop-web-services-docker.adoc index 4e613f7de27..3f3c902c5aa 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/how-to-guides/apache-hop-web-services-docker.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/how-to-guides/apache-hop-web-services-docker.adoc @@ -16,6 +16,8 @@ under the License. //// [[HopServer]] :imagesdir: ../../assets/images +:openvar: ${ +:closevar: } :description: This tutorial explains how to run Apache Hop web services from a Docker container = Web Services in Apache Hop @@ -72,7 +74,7 @@ In Apache Hop it is possible to set up runtime environments for different enviro Connection details (e.g. DB server URL) for database connections, etc. can be stored as variables in configuration files. -For example, to set up a new database connection whose connection details may differ depending on the environment, enter the name of the environment variable (e.g. `${DB_HOST}`) instead of a concrete server URL. + +For example, to set up a new database connection whose connection details may differ depending on the environment, enter the name of the environment variable (e.g. `{openvar}DB_HOST{closevar}`) instead of a concrete server URL. + As soon as you select an environment and the variable is contained in its configuration file, the variable in the DB configuration is replaced by the value from the environment configuration. @@ -80,7 +82,7 @@ This functionality is very helpful, for example, to test the pipeline against di This functionality is also essential for multi-container applications (see above: full-stack architecture), whose service results from the interaction of different and externally isolated containers. -A separate environment configuration is therefore necessary if you want to start your application with Docker Compose in addition to your development environment (in this example, the `${DB_HOST}` variable would have the service name of the DB Container instead of the IP address of the DB Server). +A separate environment configuration is therefore necessary if you want to start your application with Docker Compose in addition to your development environment (in this example, the `{openvar}DB_HOST{closevar}` variable would have the service name of the DB Container instead of the IP address of the DB Server). === Step 4: Set up and start Docker Container diff --git a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.adoc b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.adoc index ed5ef6645c0..2c820e0a288 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-flink-pipeline-engine.adoc @@ -16,6 +16,8 @@ under the License. //// [[BeamFlinkPipelineEngine]] :imagesdir: ../assets/images +:openvar: ${ +:closevar: } :description: Apache Hop supports running pipelines on Apache Flink using an Apache Beam Flink runner. This page describes how to configure this runner. = Apache Beam Flink Pipeline Engine @@ -130,7 +132,7 @@ In the meantime pass variables to the JVM by setting these in the conf/flink-con env.java.opts: -DPROJECT_HOME=/path/to/project-home ---- -In general, it is better not to use relative paths like `${Internal.Entry.Current.Folder}` when specifying filenames when executing pipelines remotely. +In general, it is better not to use relative paths like `{openvar}Internal.Entry.Current.Folder{closevar}` when specifying filenames when executing pipelines remotely. It's usually better to pick a few root folders as variables. PROJECT_HOME is as good as any variable to use. diff --git a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-spark-pipeline-engine.adoc b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-spark-pipeline-engine.adoc index 3e86f55bc0f..e881a4d8ccd 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-spark-pipeline-engine.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/beam-spark-pipeline-engine.adoc @@ -16,6 +16,8 @@ under the License. //// [[BeamSparkPipelineEngine]] :imagesdir: ../assets/images +:openvar: ${ +:closevar: } :description: Apache Hop supports running pipelines on Apache Spark over Apache Beam. The Apache Spark Runner can be used to execute Beam pipelines using Apache Spark. = Apache Beam Spark Pipeline Engine @@ -118,7 +120,7 @@ In the meantime pass variables to the JVM with the option: --driver-java-options '-DPROJECT_HOME=/path/to/project-home' ---- -In general, it is better not to use relative paths like `${Internal.Entry.Current.Folder}` when specifying filenames when executing pipelines remotely. +In general, it is better not to use relative paths like `{openvar}Internal.Entry.Current.Folder{closevar}` when specifying filenames when executing pipelines remotely. It's usually better to pick a few root folders as variables. PROJECT_HOME is as good as any variable to use. diff --git a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/native-remote-pipeline-engine.adoc b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/native-remote-pipeline-engine.adoc index ffac2d9a35a..d608424f0d8 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/native-remote-pipeline-engine.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/pipeline/pipeline-run-configurations/native-remote-pipeline-engine.adoc @@ -16,6 +16,8 @@ under the License. //// [[RemotePipelineEngine]] :imagesdir: ../assets/images +:openvar: ${ +:closevar: } :description: The remote run configuration runs Hop pipelines on a remote Hop Server. This run configuration requires little configuration, but requires a Hop server and a Hop Server metadata definition. = Remote Pipeline Engine @@ -55,7 +57,7 @@ If you don't specify a value this defaults to 2000ms (2 seconds) See below for detailed information |Named resources reference source folder -|This is the reference source folder for the named resources that are being used (e.g. `${PROJECT_HOME}`). +|This is the reference source folder for the named resources that are being used (e.g. `{openvar}PROJECT_HOME{closevar}`). See below for detailed information. |Named resources reference target folder @@ -71,16 +73,16 @@ For example if you have mapping pipelines or workflows referenced they will be s All the used pipelines and workflows together with the XML presentation of the pipeline execution configuration will be sent over to the server in the form of a ZIP archive. The server receives this archive and without unzipping runs the pipeline. To make this function correctly, Hop changes the references as well as references to filenames. -For example `${PROJECT_HOME}/mapping.hpl` will be changed to `${Internal.Entry.Current.Folder}/mapping.hpl`. +For example `{openvar}PROJECT_HOME{closevar}/mapping.hpl` will be changed to `{openvar}Internal.Entry.Current.Folder{closevar}/mapping.hpl`. This means that it will try to use a relative path to the parent file. If you have are using data files then those file names will be renamed as well. -For example, you might be reading a file called `${PROJECT_HOME}/files/bigfile.csv` in a `CSV File Input` transform. -During the export the referenced filename will be changed to `${DATA_PATH_1}/bigfile.csv`. +For example, you might be reading a file called `{openvar}PROJECT_HOME{closevar}/files/bigfile.csv` in a `CSV File Input` transform. +During the export the referenced filename will be changed to `{openvar}DATA_PATH_1{closevar}/bigfile.csv`. For every folder that is referenced a new variable will be defined and set in the execution configuration. By default, the path set for this variable will be the same as on the executing (local) machine. On the server this might not make a lot of sense. -For this reason you can specify a reference source folder like `${PROJECT_HOME}` in combination with a target folder like `/server/`. +For this reason you can specify a reference source folder like `{openvar}PROJECT_HOME{closevar}` in combination with a target folder like `/server/`. In that example variable `DATA_PATH_1` will get value `/server/files/`. This in turn allows you to transfer required files in advance or map a folder into a docker container and so on. It gives you flexibility when executing remotely while having ease of development on your client. diff --git a/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/mongodbdelete.adoc b/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/mongodbdelete.adoc index c88e05e4aef..006a24e1aed 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/mongodbdelete.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/mongodbdelete.adoc @@ -80,4 +80,5 @@ Delete based on document paths and stream fields (`use JSON query` disabled): |=== Delete based on JSON query (`use JSON query` enabled): +[source] `{$or: [{"name": "${NAME1}"},{"name": "${NAME2}"}, {"name": "${NAME3}"} ]}` diff --git a/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/tokenreplacement.adoc b/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/tokenreplacement.adoc index 7d1746f0b99..e80f1716128 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/tokenreplacement.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/pipeline/transforms/tokenreplacement.adoc @@ -16,6 +16,8 @@ under the License. //// :documentationPath: /pipeline/transforms/ :language: en_US +:openvar: ${ +:closevar: } :description: The Token Replacement transform replaces tokens in an input string or file. = image:transforms/icons/token.svg[Token Replacement transform Icon, role="image-doc-icon"] Token Replacement @@ -31,7 +33,7 @@ The transform can then output this data either to a file or a field on the strea A token contains a start string, a name, and an end string. -For example ${my_token} could be a token. +For example {openvar}my_token{closevar} could be a token. The start string, and end string are configurable and can be any series of characters. diff --git a/docs/hop-user-manual/modules/ROOT/pages/plugins/import/kettle-import.adoc b/docs/hop-user-manual/modules/ROOT/pages/plugins/import/kettle-import.adoc index 63a5142ed16..457db60ac2b 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/plugins/import/kettle-import.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/plugins/import/kettle-import.adoc @@ -47,7 +47,7 @@ During this process the XML metadata is converted to the appropriate Hop format. During this process the XML metadata is converted to the appropriate Hop format. |kettle.properties -|The Kettle properties file in your .kettle folder (typically found in the home directory or `${KETTLE_HOME}`) often contains variables and values regarding your environment. +|The Kettle properties file in your .kettle folder (typically found in the home directory or `{openvar}KETTLE_HOME{closevar}`) often contains variables and values regarding your environment. These variables and values are converted into an environment configuration file if you specified the `-c` or `--target-config-file` option. When you create an environment in Hop you can simply add this file to it to make everything work. If the configuration file already exists it will be updated, not overwritten. @@ -55,7 +55,7 @@ The description of the newly imported variables is set to `Imported from Kettle` Values of existing variables are overwritten and the existing description is kept. |shared.xml -|The shared.xml file in your .kettle folder (typically found in the home directory or `${KETTLE_HOME}`) often contains connections which are shared across many transformations and jobs. +|The shared.xml file in your .kettle folder (typically found in the home directory or `{openvar}KETTLE_HOME{closevar}`) often contains connections which are shared across many transformations and jobs. These connections are imported as Relational Database Connection metadata stored in the target folder `metadata/rdbms` folder. |jdbc.properties diff --git a/docs/hop-user-manual/modules/ROOT/pages/projects/index.adoc b/docs/hop-user-manual/modules/ROOT/pages/projects/index.adoc index 56d55c99f47..83327a92495 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/projects/index.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/projects/index.adoc @@ -45,7 +45,7 @@ To match standard development best practices you would check all these files int TIP: project variables should only be used when you need variables on the project level. All variables to connect to infrastructure, e.g. database connection parameters, mail servers etc that take different values in different environments should be created at the environment level. -TIP: Project configurations are stored in hop-config.json, which is read from `hop/config` by default. Use the `${HOP_CONFIG_FOLDER}` operating system variable to store your Hop configuration in a folder outside your Hop folder. This will let you keep your project list if you switch Hop installations or upgrade to a newer Hop version. +TIP: Project configurations are stored in hop-config.json, which is read from `hop/config` by default. Use the `{openvar}HOP_CONFIG_FOLDER{closevar}` operating system variable to store your Hop configuration in a folder outside your Hop folder. This will let you keep your project list if you switch Hop installations or upgrade to a newer Hop version. Projects can inherit metadata and variables from a parent project. diff --git a/docs/hop-user-manual/modules/ROOT/pages/snippets/best-practices/variables.adoc b/docs/hop-user-manual/modules/ROOT/pages/snippets/best-practices/variables.adoc index 6ffa20d4364..b2008dc2484 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/snippets/best-practices/variables.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/snippets/best-practices/variables.adoc @@ -16,6 +16,8 @@ under the License. //// [[Variables]] +:openvar: ${ +:closevar: } :imagesdir: ../../assets/images xref:variables.adoc[Variables] provide an easy way to avoid hard-coding all sorts of things in your system, environment or project. @@ -23,6 +25,6 @@ Here is some best practices advice on the subject: * Put environment specific settings in an environment (Duh!) configuration file. Create an environment for this. -* When referencing file locations, prefer `${PROJECT_HOME}` over expressions like `${Internal.Entry.Current.Directory}` or `${Internal.Pipeline.Filename.Directory}` +* When referencing file locations, prefer `{openvar}PROJECT_HOME{closevar}` over expressions like `{openvar}Internal.Entry.Current.Directory{closevar}` or `{openvar}Internal.Pipeline.Filename.Directory{closevar}` * Configure transform copies with variables to allow for easy transition between differently sized environments. diff --git a/docs/hop-user-manual/modules/ROOT/pages/workflow/actions/shell.adoc b/docs/hop-user-manual/modules/ROOT/pages/workflow/actions/shell.adoc index f51aa42b7c9..8f270938457 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/workflow/actions/shell.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/workflow/actions/shell.adoc @@ -15,6 +15,8 @@ specific language governing permissions and limitations under the License. //// :documentationPath: /workflow/actions/ +:openvar: ${ +:closevar: } :language: en_US :description: @@ -50,10 +52,10 @@ You can pass command line arguments and set up logging for the Shell workflow ac This is also useful, when you want to execute operating system commands like dir, ls or ipconfig without giving a specific path. This option creates a temporary script in the working directory and executes it. Note: Variables are resolved within the script when given. -|Script file name|The filename of the shell script to start, should include full path else ${user.dir} is used as path. +|Script file name|The filename of the shell script to start, should include full path else {openvar}user.dir{closevar} is used as path. |Working directory|The directory that will be used as working directory for the shell script. The working directory only becomes active when the shell script starts so "Filename" should still include the full path to the script. -When the field is left empty or the working directory is invalid ${user.dir} will be used as working directory. +When the field is left empty or the working directory is invalid {openvar}user.dir{closevar} will be used as working directory. |Specify log file|Enable to specify a separate logging file for the execution of this workflow. |Append logfile|Enable to append to the logfile as opposed to creating a new one |Name of log file|The directory and base name of the log file (for example C:\logs) diff --git a/docs/hop-user-manual/modules/ROOT/pages/workflow/workflow-run-configurations/native-remote-workflow-engine.adoc b/docs/hop-user-manual/modules/ROOT/pages/workflow/workflow-run-configurations/native-remote-workflow-engine.adoc index 3fb2fe0aeac..02827459104 100644 --- a/docs/hop-user-manual/modules/ROOT/pages/workflow/workflow-run-configurations/native-remote-workflow-engine.adoc +++ b/docs/hop-user-manual/modules/ROOT/pages/workflow/workflow-run-configurations/native-remote-workflow-engine.adoc @@ -16,6 +16,8 @@ under the License. //// [[RemoteWorkflowEngine]] :imagesdir: ../assets/images +:openvar: ${ +:closevar: } :description: The remote run configuration runs workflows on a remote Hop Server. This run configuration requires little configuration, but requires a Hop Server and a Hop Server metadata definition. = Remote Workflow Engine @@ -59,7 +61,7 @@ If you don't specify a value this defaults to 2000ms (2 seconds) See below for detailed information |Named resources reference source folder -|This is the reference source folder for the named resources that are being used (e.g. `${PROJECT_HOME}`). +|This is the reference source folder for the named resources that are being used (e.g. `{openvar}PROJECT_HOME{closevar}`). See below for detailed information. |Named resources reference target folder @@ -75,16 +77,16 @@ For example if you have pipelines or workflows referenced in actions they will b All the used pipelines and workflows together with the XML presentation of the workflow execution configuration will be sent over to the server in the form of a ZIP archive. The server receives this archive and without unzipping runs the workflow. To make this function correctly, Hop changes the references as well as references to filenames. -For example `${PROJECT_HOME}/update-dimensions.hwf` will be changed to `${Internal.Entry.Current.Folder}/update-dimensions.hwf`. +For example `{openvar}PROJECT_HOME{closevar}/update-dimensions.hwf` will be changed to `{openvar}Internal.Entry.Current.Folder{closevar}/update-dimensions.hwf`. As you can see Hop will try to use a relative path to the parent file. If you have are using data files then those file names will be renamed as well. -For example, you might be reading a file called `${PROJECT_HOME}/files/bigfile.csv` in a `CSV File Input` transform. -During the export the referenced filename will be changed to `${DATA_PATH_1}/bigfile.csv`. +For example, you might be reading a file called `{openvar}PROJECT_HOME{closevar}/files/bigfile.csv` in a `CSV File Input` transform. +During the export the referenced filename will be changed to `{openvar}DATA_PATH_1{closevar}/bigfile.csv`. For every folder that is referenced a new variable will be defined and set in the execution configuration. By default, the path set for this variable will be the same as on the executing (local) machine. On the server this might not make a lot of sense. -For this reason you can specify a reference source folder like `${PROJECT_HOME}` in combination with a target folder like `/server/`. +For this reason you can specify a reference source folder like `{openvar}PROJECT_HOME{closevar}` in combination with a target folder like `/server/`. In that example variable `DATA_PATH_1` will get value `/server/files/`. This in turn allows you to transfer required files in advance or map a folder into a docker container and so on. It gives you flexibility when executing remotely while having ease of development on your client. From 8b8b940ba40d9b54b96866989f9204c6f84108bb Mon Sep 17 00:00:00 2001 From: Hans Van Akelyen Date: Tue, 3 Jan 2023 14:29:30 +0100 Subject: [PATCH 2/2] [BUILD] Fix header --- .github/pr-rules.yml | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/.github/pr-rules.yml b/.github/pr-rules.yml index 3cb8e024a1c..97a787d324e 100644 --- a/.github/pr-rules.yml +++ b/.github/pr-rules.yml @@ -1,4 +1,3 @@ -# # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership. @@ -6,14 +5,13 @@ # (the "License"); you may not use this file except in compliance with # the License. You may obtain a copy of the License at # -# https://www.apache.org/licenses/LICENSE-2.0 +# http://www.apache.org/licenses/LICENSE-2.0 # # Unless required by applicable law or agreed to in writing, software # distributed under the License is distributed on an "AS IS" BASIS, # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. # See the License for the specific language governing permissions and # limitations under the License. -# # Please keep the entries sorted lexicographically in each category.