Code

KEP-2401: Kubeflow LLM Trainer V2#2410

Code

Open

Electronic-Waste wants to merge 44 commits intokubeflow:masterkubeflow/trainer:masterfrom Electronic-Waste:doc/KEP-2401Electronic-Waste/training-operator:doc/KEP-2401Copy head branch name to clipboard

+832

Commits

Commits on Feb 19, 2025

• doc: add initial doc for KEP-2401.

  Show description for dc8d6bb
  Electronic-Waste

  committed
  dc8d6bb

  Copy full SHA for dc8d6bb

• doc: update motivation.

  Show description for d564618
  Electronic-Waste

  committed
  d564618

  Copy full SHA for d564618

• doc: add llm lifecycle picture.

  Show description for 02dd56d
  Electronic-Waste

  committed
  02dd56d

  Copy full SHA for 02dd56d

• doc: add goals and non-goals.

  Show description for a695ec5
  Electronic-Waste

  committed
  a695ec5

  Copy full SHA for a695ec5

• doc: add alternatives.

  Show description for 65c1d17
  Electronic-Waste

  committed
  65c1d17

  Copy full SHA for 65c1d17

• doc: add proposal chapter.

  Show description for 779024a
  Electronic-Waste

  committed
  779024a

  Copy full SHA for 779024a

• doc: add multiple frameworks support section in design chapter.

  Show description for 4cd104d
  Electronic-Waste

  committed
  4cd104d

  Copy full SHA for 4cd104d

• doc: add data preprocess section in design chapter.

  Show description for f673865
  Electronic-Waste

  committed
  f673865

  Copy full SHA for f673865

• doc: add fine-tuning config section in design details chapter.

  Show description for e6db3ce
  Electronic-Waste

  committed
  e6db3ce

  Copy full SHA for e6db3ce

• fix(doc): remote all trailing whitespaces.

  Show description for 24dd0e4
  Electronic-Waste

  committed
  24dd0e4

  Copy full SHA for 24dd0e4

• doc: update llm-trainer-v2-workflow img.

  Show description for 1e46874
  Electronic-Waste

  committed
  1e46874

  Copy full SHA for 1e46874

• doc: update goals and non-goals.

  Show description for 86e10b3
  Electronic-Waste

  committed
  86e10b3

  Copy full SHA for 86e10b3

• doc: remove torchrun proposal to alternatives.

  Show description for 75e8494
  Electronic-Waste

  committed
  75e8494

  Copy full SHA for 75e8494

• doc: move torchrun design to alternatives.

  Show description for 1b698ec
  Electronic-Waste

  committed
  1b698ec

  Copy full SHA for 1b698ec

• doc: move some fine-tuning config not support by torchtune to alternatives.

  Show description for 618db86
  Electronic-Waste

  committed
  618db86

  Copy full SHA for 618db86

• doc: move torchtune sections to proposal and design chapters.

  Show description for ed502c6
  Electronic-Waste

  committed
  ed502c6

  Copy full SHA for ed502c6

• doc: update proposal & move FSDP config to alternatives.

  Show description for 49f5f02
  Electronic-Waste

  committed
  49f5f02

  Copy full SHA for 49f5f02

• doc: update fine-tuning config & unify lora/qlora/dora.

  Show description for 8e5f256
  Electronic-Waste

  committed
  8e5f256

  Copy full SHA for 8e5f256

• fix(doc): update fine-tuning config & fix doc according to comments.

  Show description for bdc4ef7
  Electronic-Waste

  committed
  bdc4ef7

  Copy full SHA for bdc4ef7

• doc: add model & dataset initialization / model exporting.

  Show description for 30c8b84
  Electronic-Waste

  committed
  30c8b84

  Copy full SHA for 30c8b84

• doc: add dataset preprocess/tokenizer chapter.

  Show description for 11f9cc4
  Electronic-Waste

  committed
  11f9cc4

  Copy full SHA for 11f9cc4

• doc: fix some errors in doc.

  Show description for 7a0411c
  Electronic-Waste

  committed
  7a0411c

  Copy full SHA for 7a0411c

• doc: update chapter name.

  Show description for 86033ae
  Electronic-Waste

  committed
  86033ae

  Copy full SHA for 86033ae

• doc: add type in the diagrams.

  Show description for 3a39c2b
  Electronic-Waste

  committed
  3a39c2b

  Copy full SHA for 3a39c2b

• doc: add optimizer and scheduler config.

  Show description for ae15088
  Electronic-Waste

  committed
  ae15088

  Copy full SHA for ae15088

• fix(doc): fix some errors in doc.

  Show description for a19603e
  Electronic-Waste

  committed
  a19603e

  Copy full SHA for a19603e

• doc: add initial parameter override.

  Show description for 935bb67
  Electronic-Waste

  committed
  935bb67

  Copy full SHA for 935bb67

• doc: update config override.

  Show description for e910167
  Electronic-Waste

  committed
  e910167

  Copy full SHA for e910167

• doc: fix some errors in doc.

  Show description for 39a54da
  Electronic-Waste

  committed
  39a54da

  Copy full SHA for 39a54da

Commits on Feb 20, 2025

• fix(doc): add CustomTrainingConfig dataclass.

  Show description for 8d29318
  Electronic-Waste

  committed
  8d29318

  Copy full SHA for 8d29318

Commits on Feb 21, 2025

• fix(doc): integrate torchtune mutation logic into torch plugin.

  Show description for 67bd3b7
  Electronic-Waste

  committed
  67bd3b7

  Copy full SHA for 67bd3b7

Commits on Feb 23, 2025

• fix(doc): split torchtune config chapter.

  Show description for e946c19
  Electronic-Waste

  committed
  e946c19

  Copy full SHA for e946c19

• fix(doc): add two options for SDK & seperate LoRA chapter.

  Show description for 2b1bccc
  Electronic-Waste

  committed
  2b1bccc

  Copy full SHA for 2b1bccc

Commits on Feb 25, 2025

• doc: add an example to show parameters mutation.

  Show description for f4fee07
  Electronic-Waste

  committed
  f4fee07

  Copy full SHA for f4fee07

• doc: add detailed design on mutation in torch plugin.

  Show description for b16de4d
  Electronic-Waste

  committed
  b16de4d

  Copy full SHA for b16de4d

• doc: add dir structure for option 1.

  Show description for 7605cb8
  Electronic-Waste

  committed
  7605cb8

  Copy full SHA for 7605cb8

• doc: add dir structure for option 2.

  Show description for b84a61b
  Electronic-Waste

  committed
  b84a61b

  Copy full SHA for b84a61b

• doc: add Test Plans chapter.

  Show description for a2eb388
  Electronic-Waste

  committed
  a2eb388

  Copy full SHA for a2eb388

• fix(doc): remove device parameter.

  Show description for a9ac42e
  Electronic-Waste

  committed
  a9ac42e

  Copy full SHA for a9ac42e

• fix(doc): fix typo error.

  Show description for 9d95b75
  Electronic-Waste

  committed
  9d95b75

  Copy full SHA for 9d95b75

• fix(doc): fix code line format.

  Show description for 54ab01e
  Electronic-Waste

  committed
  54ab01e

  Copy full SHA for 54ab01e

• fix(doc): update error in proposal example & add num_nodes and resources_per_node to TorchtuneConfig.

  Show description for 99c8a56
  Electronic-Waste

  committed
  99c8a56

  Copy full SHA for 99c8a56

Commits on Feb 26, 2025

• fix(doc): update manifests dir in option 1.

  Show description for 35438f3
  Electronic-Waste

  committed
  35438f3

  Copy full SHA for 35438f3

• fix(doc): split complement torch plugin chapter.

  Show description for 95e0465
  Electronic-Waste

  committed
  95e0465

  Copy full SHA for 95e0465