summaryrefslogtreecommitdiffstats
path: root/training/functional.py
Commit message (Expand)AuthorAgeFilesLines
* UpdateVolpeon2023-04-011-5/+13
* Add support for Adafactor, add TI initializer noiseVolpeon2023-04-011-1/+2
* Improved inverted tokensVolpeon2023-03-261-10/+9
* Fix training with guidanceVolpeon2023-03-251-3/+9
* UpdateVolpeon2023-03-251-15/+21
* UpdateVolpeon2023-03-241-6/+5
* Refactoring, fixed Lora trainingVolpeon2023-03-241-7/+2
* Bring back Perlin offset noiseVolpeon2023-03-231-1/+14
* UpdateVolpeon2023-03-231-5/+2
* FixVolpeon2023-03-221-1/+1
* Log DAdam/DAdan dVolpeon2023-03-211-0/+14
* Fixed SNR weighting, re-enabled xformersVolpeon2023-03-211-10/+25
* Restore min SNRVolpeon2023-03-191-13/+12
* New loss weighting from arxiv.org:2204.00227Volpeon2023-03-181-2/+5
* Better SNR weightingVolpeon2023-03-181-3/+3
* Fixed snr weight calculationVolpeon2023-03-171-1/+4
* Fix loss=nanVolpeon2023-03-171-2/+2
* Test: https://arxiv.org/pdf/2303.09556.pdfVolpeon2023-03-171-3/+8
* UpdateVolpeon2023-03-071-1/+5
* UpdateVolpeon2023-03-061-16/+0
* Added Perlin noise to trainingVolpeon2023-03-041-0/+17
* Removed offset noise from training, added init offset to pipelineVolpeon2023-03-031-10/+2
* Implemented different noise offsetVolpeon2023-03-031-21/+10
* Low freq noise with randomized strengthVolpeon2023-03-031-1/+8
* Better low freq noiseVolpeon2023-03-021-1/+1
* Changed low freq noiseVolpeon2023-03-011-23/+10
* UpdateVolpeon2023-03-011-23/+27
* Fixed TI normalization orderVolpeon2023-02-211-4/+4
* FixVolpeon2023-02-211-6/+3
* Don't rely on Accelerate for gradient accumulationVolpeon2023-02-211-24/+29
* Embedding normalization: Ignore tensors with grad = 0Volpeon2023-02-211-2/+5
* UpdateVolpeon2023-02-181-7/+14
* Added Lion optimizerVolpeon2023-02-171-4/+5
* Remove xformers, switch to Pytorch NightlyVolpeon2023-02-171-2/+1
* FixVolpeon2023-02-161-4/+2
* Integrated WIP UniPC schedulerVolpeon2023-02-161-8/+22
* UpdateVolpeon2023-02-151-1/+1
* Made low-freq noise configurableVolpeon2023-02-141-6/+11
* Better noise generation during training: https://www.crosslabs.org/blog/diffu...Volpeon2023-02-131-0/+7
* UpdateVolpeon2023-02-131-1/+1
* Fix Lora memory usageVolpeon2023-02-071-2/+2
* Add LoraVolpeon2023-02-071-20/+11
* Restored LR finderVolpeon2023-01-201-10/+25
* Move Accelerator preparation into strategyVolpeon2023-01-191-14/+14
* UpdateVolpeon2023-01-171-4/+8
* UpdateVolpeon2023-01-171-5/+14
* Training updateVolpeon2023-01-161-3/+1
* Moved multi-TI code from Dreambooth to TI scriptVolpeon2023-01-161-3/+14
* More training adjustmentsVolpeon2023-01-161-2/+3
* Handle empty validation datasetVolpeon2023-01-161-45/+56