Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve CLI docs on running and re-running workflows locally #537

Open
mtuchi opened this issue Aug 20, 2024 · 2 comments
Open

Improve CLI docs on running and re-running workflows locally #537

mtuchi opened this issue Aug 20, 2024 · 2 comments

Comments

@mtuchi
Copy link
Contributor

mtuchi commented Aug 20, 2024

Description:

The current CLI documentation lacks detailed instructions on how to effectively run and re-run workflows locally. This enhancement will focus on providing clear guidance, especially on using specific options to control workflow execution.

Proposed Improvements:

  1. Running Workflows Locally:

    • Add a section that explains how to run a workflow locally, emphasizing the use of the --cache-steps option to save all step results locally and avoid reprocessing. For example:
      openfn workflow.json -o tmp/output.json --cache-steps
      
  2. Re-running Workflows:

    • Provide detailed instructions on how users can re-run workflows after making changes or upon failure, using the following options:
      • --start: Re-run from a specific start step. For example:
        openfn workflow.json -o tmp/output.json --start step2
        
      • --end: Re-run up to a specific end step. For example:
        openfn workflow.json -o tmp/output.json --end step3
        
      • --only: Re-run only a single specified step. For example:
        openfn workflow.json -o tmp/output.json --only step2
        
    • Emphasize that when re-running a workflow using --start, --end, or --only, the results will be loaded from the cache. Therefore, it's crucial to run the entire workflow first with --cache-steps enabled before using these options.
  3. Best Practices:(Opt)

    • Suggest best practices for organizing workflows and managing local executions using the mentioned options.
    • Highlight common pitfalls and troubleshooting tips related to these options.
  4. Using Help Command:(Opt)

    • Include instructions on how users can use openfn help to learn more about available commands and options within the OpenFn CLI.

Impact:
This improvement will provide users with precise control over workflow execution, reducing errors and improving efficiency when running and re-running workflows locally.

Additional Notes:
CLI Cache Steps Docs 👇🏽

@mtuchi mtuchi changed the title Improve documentation on running and re-running workflows locally via CLI Improve docs on running and re-running workflows locally via CLI Aug 20, 2024
@mtuchi mtuchi changed the title Improve docs on running and re-running workflows locally via CLI Improve CLI docs on running and re-running workflows locally Aug 20, 2024
@josephjclark
Copy link
Contributor

Regarding steps and cache-steps, is the problem that the information isn't there, or that it's not discoverable?

There is a section on running workflows, but it could use more examples and docs on steps I guess. It's maybe in the wrong place too.

The tutorial docs here might want a bit of an update too: https://docs.openfn.org/documentation/cli-walkthrough#7-running-workflows

@mtuchi
Copy link
Contributor Author

mtuchi commented Aug 20, 2024

Information is there but not discoverable

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: No status
Development

No branches or pull requests

2 participants