Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Improved sparse embeddings | Volpeon | 2023-04-03 | 1 | -4/+4 |
| | |||||
* | TI: Delta learning | Volpeon | 2023-04-03 | 1 | -23/+0 |
| | |||||
* | Lora: Only register params with grad to optimizer | Volpeon | 2023-04-02 | 1 | -1/+0 |
| | |||||
* | Revert | Volpeon | 2023-04-01 | 1 | -19/+81 |
| | |||||
* | Fix | Volpeon | 2023-04-01 | 1 | -1/+3 |
| | |||||
* | Combined TI with embedding and LoRA | Volpeon | 2023-04-01 | 1 | -58/+18 |
| | |||||
* | Experimental: TI via LoRA | Volpeon | 2023-04-01 | 1 | -26/+4 |
| | |||||
* | Fix TI | Volpeon | 2023-03-27 | 1 | -8/+10 |
| | |||||
* | Sparse TI embeddings without sparse tensors | Volpeon | 2023-03-27 | 1 | -10/+8 |
| | |||||
* | Improved TI embeddings | Volpeon | 2023-03-26 | 1 | -2/+1 |
| | |||||
* | Refactoring, fixed Lora training | Volpeon | 2023-03-24 | 1 | -10/+12 |
| | |||||
* | Update | Volpeon | 2023-03-23 | 1 | -2/+2 |
| | |||||
* | Update | Volpeon | 2023-03-01 | 1 | -1/+1 |
| | |||||
* | Fixed TI normalization order | Volpeon | 2023-02-21 | 1 | -5/+10 |
| | |||||
* | Embedding normalization: Ignore tensors with grad = 0 | Volpeon | 2023-02-21 | 1 | -4/+11 |
| | |||||
* | Remove xformers, switch to Pytorch Nightly | Volpeon | 2023-02-17 | 1 | -2/+2 |
| | |||||
* | Update | Volpeon | 2023-02-13 | 1 | -1/+1 |
| | |||||
* | Fix Lora memory usage | Volpeon | 2023-02-07 | 1 | -2/+0 |
| | |||||
* | Add Lora | Volpeon | 2023-02-07 | 1 | -9/+29 |
| | |||||
* | Restored LR finder | Volpeon | 2023-01-20 | 1 | -3/+2 |
| | |||||
* | Move Accelerator preparation into strategy | Volpeon | 2023-01-19 | 1 | -1/+21 |
| | |||||
* | Update | Volpeon | 2023-01-17 | 1 | -6/+8 |
| | |||||
* | Fix | Volpeon | 2023-01-17 | 1 | -4/+5 |
| | |||||
* | Fix | Volpeon | 2023-01-17 | 1 | -1/+0 |
| | |||||
* | Make embedding decay work like Adam decay | Volpeon | 2023-01-17 | 1 | -9/+5 |
| | |||||
* | Update | Volpeon | 2023-01-17 | 1 | -4/+4 |
| | |||||
* | Update | Volpeon | 2023-01-17 | 1 | -6/+13 |
| | |||||
* | Training update | Volpeon | 2023-01-16 | 1 | -6/+7 |
| | |||||
* | More training adjustments | Volpeon | 2023-01-16 | 1 | -1/+1 |
| | |||||
* | Handle empty validation dataset | Volpeon | 2023-01-16 | 1 | -1/+1 |
| | |||||
* | Update | Volpeon | 2023-01-15 | 1 | -28/+26 |
| | |||||
* | Removed unused code, put training callbacks in dataclass | Volpeon | 2023-01-15 | 1 | -10/+10 |
| | |||||
* | Added functional TI strategy | Volpeon | 2023-01-15 | 1 | -0/+164 |