digdag-operator-param

digdag plugin for operating params.

Overview

• Plugin type: operator

Usage

_export:
  plugin:
    repositories:
      - https://jitpack.io
    dependencies:
      - pro.civitaspo:digdag-operator-param:0.0.2

+show1:
  echo>: "hoge: ${typeof(hoge) == 'undefined' ? 'None' : hoge}, a.b: ${typeof(a) == 'undefined' ? 'None' : typeof(a.b) == 'undefined' ? 'None' : a.b}"

+store:
  param_store>:
    hoge: fuga
    a:
      b: c

+show2:
  echo>: "hoge: ${typeof(hoge) == 'undefined' ? 'None' : hoge}, a.b: ${typeof(a) == 'undefined' ? 'None' : typeof(a.b) == 'undefined' ? 'None' : a.b}"

+reset:
  +hoge:
    param_reset>: hoge
  +a.b:
    param_reset>: a.b

+show3:
  echo>: "hoge: ${typeof(hoge) == 'undefined' ? 'None' : hoge}, a.b: ${typeof(a) == 'undefined' ? 'None' : typeof(a.b) == 'undefined' ? 'None' : a.b}"

+eval:
  _export:
    a: aaa
    b: bbb
    c: ccc
    d: ${a}-${b}-${c}

  +a:
    _export:
      e: ${d}
      f:
        g: ${d}
        h:
          - ${d}
    +b:
      echo>: ${d}
    +c:
      echo>: ${e}
    +d:
      echo>: ${f.g}
    +e:
      param_eval>: f.g
    +f:
      echo>: ${f.g}
    +g:
      +h:
        for_each>: {i: "${f.h}"}
        _do:
          echo>: ${i}
      +i:
        echo>: ${f.h}
    +j:
      param_eval>: f.h
    +k:
      +l:
        for_each>: {i: "${f.h}"}
        _do:
          echo>: ${i}
      +m:
        echo>: ${f.h}

Configuration

Configuration for param_store> operator

Options

• param_store>: Params to store. (string to object map, required)

Configuration for param_reset> operator

Options

• param_reset>: Param name to reset. (string, required)

Configuration for param_eval> operator

Options

• param_eval>: Param name to eval. (string, required)

NOTE:

• This operator is a workaround for the issue: Exported vars are not evaluated recursively in the context of nested params
• Use single quote' instead of double quote" for injecting javascript code to avoide SyntaxError: <function>: Missing close quote error: Fails param_eval>: when using custom variables in nested variables

Development

Run an Example

build

./gradlew publish

Artifacts are build on local repos: ./build/repo.

run an example

./example/run.sh

Dependencies

This project's dependencies are managed by the gradle dependency locking feature.

# Update the dependencies
./gradlew dependencies --write-locks

# Update the paticular dependency
./gradlew dependencies --update-locks org.junit.jupiter:junit-jupiter-api

(TODO) Run Tests

./gradlew test

ChangeLog

CHANGELOG.md

License

Apache License 2.0

Author

@civitaspo