[WIP] Codebase Refactor#22

Draft

maddox-j wants to merge 120 commits intomainfrom

jen/eval-refactor

Commits on Aug 16, 2024

Restructure as python package (#19)

shawseanyang
authored and
ArmandNM
committed

Commits on Aug 20, 2024

Commits on Aug 22, 2024

Create class interfaces
ArmandNM
committed

Commits on Aug 23, 2024

Commits on Aug 25, 2024

Add local transformers inference
ArmandNM
committed

Commits on Aug 26, 2024

Commits on Aug 28, 2024

Commits on Sep 1, 2024

Add FFT runner
ArmandNM
committed

Commits on Sep 3, 2024

Commits on Sep 4, 2024

Commits on Sep 6, 2024

update training script for RoSA
Eugenia Iofinova
committed
Merge branch 'refactor' into jen/train-refactor
Eugenia Iofinova
committed
remove redundant, unnecessary and problematic use_rag and use_thread arguments from prompt building
Eugenia Iofinova
committed
minor training cleanups
Eugenia Iofinova
committed

Commits on Sep 10, 2024

add config for peft writer
Eugenia Iofinova
committed

Commits on Sep 11, 2024

Commits on Sep 12, 2024

refactor configs to get unnecessary params out of configs/base
Eugenia Iofinova
committed
allow code execution during model loading to allow phi3.5
Eugenia Iofinova
committed
greatly simplify the .sh training script to take advantage of the configs
Eugenia Iofinova
committed
add streaming to cli
shawseanyang
committed
add streaming to transformers
shawseanyang
committed

Commits on Sep 13, 2024

update training scripts to process arguments correctly
Eugenia Iofinova
committed
minor fix for train_fft
Eugenia Iofinova
committed
write the full checkpoint to the expected location
Eugenia Iofinova
committed
add sampling parameters to ollama LLM

shawseanyang
authored and
ArmandNM
committed
Refactor data summarization
ArmandNM
committed
add streaming to cli

shawseanyang
authored and
ArmandNM
committed
add streaming to transformers

shawseanyang
authored and
ArmandNM
committed
update web.py to match LLM interface

shawseanyang
authored and
ArmandNM
committed

Commits on Sep 16, 2024

Merge branch 'refactor' of github.com:IST-DASLab/PanzaMail into refactor
Eugenia Iofinova
committed
first pass at porting evaluation to new framework
Eugenia Iofinova
committed
do NOT split test and train data by default
Eugenia Iofinova
committed

Commits on Sep 17, 2024

make the json interface more robust to json file format
Eugenia Iofinova
committed

Commits on Sep 19, 2024

fix bug where RoSA FFT still tries to move folder over
Eugenia Iofinova
committed
emergency bugfix for streaming to cli
Eugenia Iofinova
committed

Commits on Oct 18, 2024

Merge branch 'refactor' into jen/eval-refactor
Eugenia Iofinova
committed
add creating RAG DB to data preparation script
Eugenia Iofinova
committed
add test-train splitting to data preparation
Eugenia Iofinova
committed
undo accidental commenting out
Eugenia Iofinova
committed
bug fix
Eugenia Iofinova
committed
add tqdm to json interface
Eugenia Iofinova
committed
let panza writer load latest checkpoint
Eugenia Iofinova
committed

Commits on Oct 21, 2024

add email extraction to data preparation
Eugenia Iofinova
committed
update panza readme
Eugenia Iofinova
committed
update env preparation script
Eugenia Iofinova
committed

Commits on Oct 28, 2024

slight refactor of runner.py
Eugenia Iofinova
committed
remove some unused .sh files
Eugenia Iofinova
committed
qq
Eugenia Iofinova
committed

Commits on Oct 29, 2024

make the first part of the data preparation script optional (in case of manual modifications
Eugenia Iofinova
committed

Commits on Oct 31, 2024

Edits and Bug Fixes
maddox-j
committed

Commits on Nov 4, 2024

Add additional clarification on username importance
maddox-j
committed
update data preparation
Eugenia Iofinova
committed

Commits on Nov 8, 2024

Miscellanous updates
Andrej Jovanovic
committed
Fix function address
Andrej Jovanovic
committed

Commits on Nov 12, 2024

Clean up code TODOs and revert to defaults
Andrej Jovanovic
committed
move top-level README to default location
Eugenia Iofinova
committed
update the scripts/ readme
Eugenia Iofinova
committed
remove useless assert
Eugenia Iofinova
committed
Merge branch 'jen/eval-refactor' of github.com:IST-DASLab/PanzaMail into jen/eval-refactor
Eugenia Iofinova
committed
Merge changes.
Eugenia Iofinova
committed
Once again, try to centralize the main README.
Eugenia Iofinova
committed
Update the README
Eugenia Iofinova
committed

Commits on Nov 13, 2024

Update README.md remove resolved TODO
ohaijen
authored
update hyperparameter tuning guide
Eugenia Iofinova
committed
Merge branch 'jen/eval-refactor' of github.com:IST-DASLab/PanzaMail into jen/eval-refactor
Eugenia Iofinova
committed
Refactor panza3 -> panza
Andrej Jovanovic
committed

Commits on Nov 14, 2024

Clear ollama and web use-case
Andrej Jovanovic
committed

Commits on Nov 18, 2024

Update README.md remove confusing period.
ohaijen
authored
Update README.md Add instructions for quantized training

ohaijen
authored and
Eugenia Iofinova
committed
correct README for quantized training
Eugenia Iofinova
committed