summaryrefslogtreecommitdiffstats
path: root/training/functional.py
Commit message (Collapse)AuthorAgeFilesLines
* New offset noise testVolpeon2023-04-051-8/+89
|
* TI: Bring back old embedding decayVolpeon2023-04-041-2/+2
|
* TI: Delta learningVolpeon2023-04-031-2/+2
|
* Update dataset format: Separate prompt and keywordsVolpeon2023-04-021-3/+6
|
* UpdateVolpeon2023-04-021-3/+3
|
* RevertVolpeon2023-04-011-1/+1
|
* UpdateVolpeon2023-04-011-5/+13
|
* Add support for Adafactor, add TI initializer noiseVolpeon2023-04-011-1/+2
|
* Improved inverted tokensVolpeon2023-03-261-10/+9
|
* Fix training with guidanceVolpeon2023-03-251-3/+9
|
* UpdateVolpeon2023-03-251-15/+21
|
* UpdateVolpeon2023-03-241-6/+5
|
* Refactoring, fixed Lora trainingVolpeon2023-03-241-7/+2
|
* Bring back Perlin offset noiseVolpeon2023-03-231-1/+14
|
* UpdateVolpeon2023-03-231-5/+2
|
* FixVolpeon2023-03-221-1/+1
|
* Log DAdam/DAdan dVolpeon2023-03-211-0/+14
|
* Fixed SNR weighting, re-enabled xformersVolpeon2023-03-211-10/+25
|
* Restore min SNRVolpeon2023-03-191-13/+12
|
* New loss weighting from arxiv.org:2204.00227Volpeon2023-03-181-2/+5
|
* Better SNR weightingVolpeon2023-03-181-3/+3
|
* Fixed snr weight calculationVolpeon2023-03-171-1/+4
|
* Fix loss=nanVolpeon2023-03-171-2/+2
|
* Test: https://arxiv.org/pdf/2303.09556.pdfVolpeon2023-03-171-3/+8
|
* UpdateVolpeon2023-03-071-1/+5
|
* UpdateVolpeon2023-03-061-16/+0
|
* Added Perlin noise to trainingVolpeon2023-03-041-0/+17
|
* Removed offset noise from training, added init offset to pipelineVolpeon2023-03-031-10/+2
|
* Implemented different noise offsetVolpeon2023-03-031-21/+10
|
* Low freq noise with randomized strengthVolpeon2023-03-031-1/+8
|
* Better low freq noiseVolpeon2023-03-021-1/+1
|
* Changed low freq noiseVolpeon2023-03-011-23/+10
|
* UpdateVolpeon2023-03-011-23/+27
|
* Fixed TI normalization orderVolpeon2023-02-211-4/+4
|
* FixVolpeon2023-02-211-6/+3
|
* Don't rely on Accelerate for gradient accumulationVolpeon2023-02-211-24/+29
|
* Embedding normalization: Ignore tensors with grad = 0Volpeon2023-02-211-2/+5
|
* UpdateVolpeon2023-02-181-7/+14
|
* Added Lion optimizerVolpeon2023-02-171-4/+5
|
* Remove xformers, switch to Pytorch NightlyVolpeon2023-02-171-2/+1
|
* FixVolpeon2023-02-161-4/+2
|
* Integrated WIP UniPC schedulerVolpeon2023-02-161-8/+22
|
* UpdateVolpeon2023-02-151-1/+1
|
* Made low-freq noise configurableVolpeon2023-02-141-6/+11
|
* Better noise generation during training: ↵Volpeon2023-02-131-0/+7
| | | | https://www.crosslabs.org/blog/diffusion-with-offset-noise
* UpdateVolpeon2023-02-131-1/+1
|
* Fix Lora memory usageVolpeon2023-02-071-2/+2
|
* Add LoraVolpeon2023-02-071-20/+11
|
* Restored LR finderVolpeon2023-01-201-10/+25
|
* Move Accelerator preparation into strategyVolpeon2023-01-191-14/+14
|