Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v21.7.8 #1003

Merged
merged 32 commits into from
Jun 17, 2023
Merged

v21.7.8 #1003

merged 32 commits into from
Jun 17, 2023

Conversation

bmaltais
Copy link
Owner

  • Add tkinter to dockerised version (thanks to @burdokow)
  • Add option to create caption files from folder names to the group_images.py tool.
  • Prodigy optimizer is supported in each training script. It is a member of D-Adaptation and is effective for DyLoRA training. PR #585 Please see the PR for details. Thanks to sdbds!
    • Install the package with pip install prodigyopt. Then specify the option like --optimizer_type="prodigy".
  • Arbitrary Dataset is supported in each training script (except XTI). You can use it by defining a Dataset class that returns images and captions.
    • Prepare a Python script and define a class that inherits train_util.MinimalDataset. Then specify the option like --dataset_class package.module.DatasetClass in each training script.
    • Please refer to MinimalDataset for implementation. I will prepare a sample later.
  • The following features have been added to the generation script.
    • Added an option --highres_fix_disable_control_net to disable ControlNet in the 2nd stage of Highres. Fix. Please try it if the image is disturbed by some ControlNet such as Canny.
    • Added Variants similar to sd-dynamic-propmpts in the prompt.
      • If you specify {spring|summer|autumn|winter}, one of them will be randomly selected.
      • If you specify {2$$chocolate|vanilla|strawberry}, two of them will be randomly selected.
      • If you specify {1-2$$ and $$chocolate|vanilla|strawberry}, one or two of them will be randomly selected and connected by and.
      • You can specify the number of candidates in the range 0-2. You cannot omit one side like -2 or 1-.
      • It can also be specified for the prompt option.
      • If you specify e or E, all candidates will be selected and the prompt will be repeated multiple times (--images_per_prompt is ignored). It may be useful for creating X/Y plots.
      • You can also specify --am {e$$0.2|0.4|0.6|0.8|1.0},{e$$0.4|0.7|1.0} --d 1234. In this case, 15 prompts will be generated with 5*3.
      • There is no weighting function.

mio7690 and others added 30 commits June 8, 2023 23:39
Append sys path for make_captions.py to load blip module in the same folder to fix the error when you don't run this script under the folder
with bracket dependencies
Bug fixes for validate_requirements.py
* Update train_util.py for DAdaptLion

* Update train_README-zh.md for dadaptlion

* Update train_README-ja.md for DAdaptLion

* add DAdatpt V3

* Alignment

* Update train_util.py for experimental

* Update train_util.py V3

* Update train_README-zh.md

* Update train_README-ja.md

* Update train_util.py fix

* Update train_util.py

* support Prodigy

* add lower
prodigyopt, arbitrary dataset etc.
Add prefix and postfix for WD14 captioning
@bmaltais bmaltais merged commit eec7d05 into master Jun 17, 2023
bmaltais pushed a commit that referenced this pull request Dec 23, 2023
IPEX support for Torch 2.1 and fix dtype erros
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants