Code

Build2024#1

Code

Draft

cedricvidal wants to merge 104 commits intomaincedricvidal/gorilla:mainfrom build2024cedricvidal/gorilla:build2024Copy head branch name to clipboard

+2,648-261

Commits

Commits on May 13, 2024

• Resolve default logging conf file relative to logconf.py

  cedricvidal

  committed
  4780d60

  Copy full SHA for 4780d60

• RAFT FTaaS Notebook

  cedricvidal

  committed
  ab80ca1

  Copy full SHA for ab80ca1

• FTaaS Pin azure-storage-file-datalake==12.14.0 to avoid dependency conflict

  cedricvidal

  committed
  08783a0

  Copy full SHA for 08783a0

• Fails creating job

  cedricvidal

  committed
  9127ff9

  Copy full SHA for 9127ff9

• Dataset

  cedricvidal

  committed
  a0185d9

  Copy full SHA for a0185d9

• Adding deployment

  cedricvidal

  committed
  e5c2788

  Copy full SHA for e5c2788

• Stopping attempts to do full code first FTaaS

  cedricvidal

  committed
  a990a3a

  Copy full SHA for a990a3a

• eval notebook

  Show description for 727c257
  cedricvidal

  committed
  727c257

  Copy full SHA for 727c257

• Eval progress

  cedricvidal

  committed
  b48472a

  Copy full SHA for b48472a

• Format support for eval format

  cedricvidal

  committed
  d24e4e6

  Copy full SHA for d24e4e6

• Delete dataset files

  cedricvidal

  committed
  8544fba

  Copy full SHA for 8544fba

• WIP

  cedricvidal

  committed
  160240f

  Copy full SHA for 160240f

• Using instruction field for prompt

  cedricvidal

  committed
  0868f9b

  Copy full SHA for 0868f9b

Commits on May 14, 2024

• RAFT Fix wrong chunk being checkpointed

  Show description for ead7a37
  cedricvidal

  committed
  ead7a37

  Copy full SHA for ead7a37

• RAFT format.py Fix jsonl input type

  cedricvidal

  committed
  9ff66b2

  Copy full SHA for 9ff66b2

• RAFT ftaas notebook splitting datasets before converting

  cedricvidal

  committed
  290e9fa

  Copy full SHA for 290e9fa

• ARFT format.py more logs

  cedricvidal

  committed
  81ea8eb

  Copy full SHA for 81ea8eb

• RAFT format.py Field names can be customized

  Show description for 1e69ede
  cedricvidal

  committed
  1e69ede

  Copy full SHA for 1e69ede

• RAFT format.py support for eval format

  cedricvidal

  committed
  24fff86

  Copy full SHA for 24fff86

• RAFT ftaas.ipynb changing column names

  cedricvidal

  committed
  66c6dbd

  Copy full SHA for 66c6dbd

• RAFT eval.ipynb eval format

  cedricvidal

  committed
  1019f0f

  Copy full SHA for 1019f0f

• RAFT format.py renamed answer to gold_answer

  Show description for b56e4b6
  cedricvidal

  committed
  b56e4b6

  Copy full SHA for b56e4b6

• RAFT pfeval.py

  cedricvidal

  committed
  4cfaf39

  Copy full SHA for 4cfaf39

Commits on May 15, 2024

• RAFT eval notebook works end to end

  cedricvidal

  committed
  67956a2

  Copy full SHA for 67956a2

• RAFT raft.py add --checkpoint-size arg

  cedricvidal

  committed
  3649c7c

  Copy full SHA for 3649c7c

• RAFT raft.py fix chunk and progress logging

  cedricvidal

  committed
  217f54e

  Copy full SHA for 217f54e

• RAFT raft.py saving checkpoints in a single directory

  Show description for cde331c
  cedricvidal

  committed
  cde331c

  Copy full SHA for cde331c

• RAFT ftaas notebook WIP

  cedricvidal

  committed
  1817873

  Copy full SHA for 1817873

• RAFT raft.py disbale datasets progress bars when saving checkpoints

  cedricvidal

  committed
  b8bbc84

  Copy full SHA for b8bbc84

• RAFT raft.py add llama template

  cedricvidal

  committed
  838a7c9

  Copy full SHA for 838a7c9

• RAFT raft.py llama prompt test 1

  cedricvidal

  committed
  866e6cd

  Copy full SHA for 866e6cd

• RAFT raft.py fixed missed change to formatter

  cedricvidal

  committed
  463e392

  Copy full SHA for 463e392

• RAFT raft.py specific template for llama to generate questions

  cedricvidal

  committed
  05682f9

  Copy full SHA for 05682f9

Commits on May 16, 2024

• RAFT format.py stop keyword

  cedricvidal

  committed
  b52b6dd

  Copy full SHA for b52b6dd

• RAFT eval.py stop keyword

  cedricvidal

  committed
  2b304c9

  Copy full SHA for 2b304c9

• RAFT raft.py gpt qa temaplte formatting

  cedricvidal

  committed
  4114fe9

  Copy full SHA for 4114fe9

• RAFT pfeval.py SimilarityEvaluator

  cedricvidal

  committed
  15092f0

  Copy full SHA for 15092f0

• RAFT format.py final_answer

  cedricvidal

  committed
  a5e309c

  Copy full SHA for a5e309c

• RAFT pfeval.py retry

  cedricvidal

  committed
  1d476e8

  Copy full SHA for 1d476e8

Commits on May 17, 2024

• RAFT pfeval.py More fine grained pbar

  cedricvidal

  committed
  871488d

  Copy full SHA for 871488d

• RAFT raft.py save chunks to checkpoints folder

  cedricvidal

  committed
  b32b2cd

  Copy full SHA for b32b2cd

• RAFT raft.py moved chunks checkpoint support to method

  cedricvidal

  committed
  c285197

  Copy full SHA for c285197

• RAFT eval.ipynb

  cedricvidal

  committed
  1f0f04f

  Copy full SHA for 1f0f04f

• RAFT cleaning up

  cedricvidal

  committed
  1445d9e

  Copy full SHA for 1445d9e

Commits on May 18, 2024

• RAFT raft.py rename chunks func

  cedricvidal

  committed
  a9389b3

  Copy full SHA for a9389b3

• RAFT format.py more logging

  cedricvidal

  committed
  21ea0db

  Copy full SHA for 21ea0db

• RAFT raft.py Moved checkpointing logic

  cedricvidal

  committed
  25aa04b

  Copy full SHA for 25aa04b

• RAFT raft.py more checkpoint refactoring

  cedricvidal

  committed
  8f6a9b0

  Copy full SHA for 8f6a9b0

• RAFT raft.py relying on checkpoint directories instead of state file

  cedricvidal

  committed
  bf3dbeb

  Copy full SHA for bf3dbeb

• RAFT raft.py removed globald ds

  cedricvidal

  committed
  abed6ae

  Copy full SHA for abed6ae

• RAFT raft.py multi threading

  cedricvidal

  committed
  7e84a5d

  Copy full SHA for 7e84a5d

• RAFT raft.py --workers param

  cedricvidal

  committed
  f979651

  Copy full SHA for f979651

• RAFT raft.py ready to use

  cedricvidal

  committed
  efe9e00

  Copy full SHA for efe9e00

Commits on May 19, 2024

• RAFT raft.py tqdm for chunking

  cedricvidal

  committed
  a53f7db

  Copy full SHA for a53f7db

• RAFT raft.py removed --fast param to simplify code

  cedricvidal

  committed
  bd3c233

  Copy full SHA for bd3c233

• RAFT raft.py formatting

  cedricvidal

  committed
  0ae5267

  Copy full SHA for 0ae5267

• RAFT raft.py caching questions with HF's map

  cedricvidal

  committed
  6c10456

  Copy full SHA for 6c10456

• RAFT raft.py cot_answer multi threading

  cedricvidal

  committed
  f69ea7f

  Copy full SHA for f69ea7f

• RAFT raft.py renaming

  cedricvidal

  committed
  e3394fd

  Copy full SHA for e3394fd

• RAFT raft.py cot answers now checkpointed

  cedricvidal

  committed
  f217860

  Copy full SHA for f217860

• RAFT raft.py tuned completion max tokens

  cedricvidal

  committed
  08c7535

  Copy full SHA for 08c7535

• RAFT raft.py checkpointing questions and answers in the same chunk loop

  cedricvidal

  committed
  2c07c69

  Copy full SHA for 2c07c69

• RAFT ignore output dir

  cedricvidal

  committed
  551b163

  Copy full SHA for 551b163

• RAFT ignore datasets dir

  cedricvidal

  committed
  5e7bdf2

  Copy full SHA for 5e7bdf2

• RAFT raft.py moved checkpointing suff and removed hf fingerprint code

  cedricvidal

  committed
  d1aad52

  Copy full SHA for d1aad52

• RAFT raft.py ChatCompleter stats

  cedricvidal

  committed
  d0f991a

  Copy full SHA for d0f991a

• RAFT raft.py tok/s

  cedricvidal

  committed
  5fb6c7a

  Copy full SHA for 5fb6c7a

Commits on May 20, 2024

• RAFT clean notebooks

  cedricvidal

  committed
  12a371a

  Copy full SHA for 12a371a

• RAFT raft.py renamed UsageStats

  cedricvidal

  committed
  7286d1c

  Copy full SHA for 7286d1c

• RAFT raft.py setting initial in tqdm to avoid skewing the stats

  cedricvidal

  committed
  dc021a0

  Copy full SHA for dc021a0

• RAFT update openai version

  cedricvidal

  committed
  ccc1260

  Copy full SHA for ccc1260

• RAFT raft.py avg tok/s

  cedricvidal

  committed
  7f4c586

  Copy full SHA for 7f4c586

• RAFT raft.py --auto-clean-checkpoints

  cedricvidal

  committed
  a6c45e6

  Copy full SHA for a6c45e6

• RAFT format.py filter out empty rows and added descriptions ot HF map ops

  cedricvidal

  committed
  54bb04b

  Copy full SHA for 54bb04b

Commits on May 21, 2024

• RAFT format.py EvalDatasetFormatter

  cedricvidal

  committed
  ebd3830

  Copy full SHA for ebd3830

• RAFT raft.py Final log

  cedricvidal

  committed
  a31bfee

  Copy full SHA for a31bfee

• BUILD gen notebook looks ready

  cedricvidal

  committed
  e0deb89

  Copy full SHA for e0deb89

• RAFT raft.py more logging at the end

  cedricvidal

  committed
  c895200

  Copy full SHA for c895200

Commits on May 22, 2024

• RAFT eval.py retry and --workers param

  cedricvidal

  committed
  38a2f64

  Copy full SHA for 38a2f64

Commits on May 23, 2024

• RAFT client_utils.py stats support for completion

  cedricvidal

  committed
  a7b4034

  Copy full SHA for a7b4034

• RAFT eval.py more robust

  cedricvidal

  committed
  c5d631e

  Copy full SHA for c5d631e

• RAFT pfeval.py remote mode

  cedricvidal

  committed
  6eab9ca

  Copy full SHA for 6eab9ca

• RAFT raft.py tqdm postfix

  cedricvidal

  committed
  50bc7a9

  Copy full SHA for 50bc7a9

• RAFT eval.py logging retry stats

  cedricvidal

  committed
  925ab61

  Copy full SHA for 925ab61

• RAFT eval.py fixed main thread silent fail in case of exception

  cedricvidal

  committed
  074ec5a

  Copy full SHA for 074ec5a

• RAFT fomrat.py 'answer' column is optional

  cedricvidal

  committed
  96860f5

  Copy full SHA for 96860f5

• RAFT pfeval.py remote support + local fixes

  cedricvidal

  committed
  2ad000a

  Copy full SHA for 2ad000a

• RAFT pfeval_local.py

  cedricvidal

  committed
  ce84d47

  Copy full SHA for ce84d47

• RAFT pfeval_local.py more checks

  cedricvidal

  committed
  2b9b251

  Copy full SHA for 2b9b251

• RAFT pfeval_local.py fix bug

  cedricvidal

  committed
  3284737

  Copy full SHA for 3284737

• RAFT pfeval_local.py fix other bug

  cedricvidal

  committed
  5ec43bf

  Copy full SHA for 5ec43bf

• RAFT gen notebook

  cedricvidal

  committed
  0c04254

  Copy full SHA for 0c04254

Commits on May 25, 2024

• RAFT gen notebook cleaned cells

  cedricvidal

  committed
  be42647

  Copy full SHA for be42647

• Remove ftaas

  cedricvidal

  committed
  a5c2f6c

  Copy full SHA for a5c2f6c

Commits on May 29, 2024

• RAFT gen notebook display ft and eval datasets

  cedricvidal

  committed
  504da8e

  Copy full SHA for 504da8e

• RAFT adding promptflow flows

  cedricvidal

  committed
  a3564be

  Copy full SHA for a3564be

• RAFT Display PDFs in notebooks

  cedricvidal

  committed
  02baea8

  Copy full SHA for 02baea8

• RAFT gen notebook with PDF

  cedricvidal

  committed
  0b6f31d

  Copy full SHA for 0b6f31d

Commits on May 30, 2024

• RAFT gen notebook with generated sample overview

  cedricvidal

  committed
  b08caf8

  Copy full SHA for b08caf8

• RAFT pf jinja2

  cedricvidal

  committed
  6beebb7

  Copy full SHA for 6beebb7

• RAFT pf input default values

  cedricvidal

  committed
  7796845

  Copy full SHA for 7796845

Commits on Jun 18, 2024

• RAFT Fixed pf-evals column mappings

  cedricvidal

  committed
  2ed54f2

  Copy full SHA for 2ed54f2

Commits on Jul 18, 2024

• Vampire sample datas

  cedricvidal

  committed
  2565d88

  Copy full SHA for 2565d88

• Libmagic needs to be installed before the python package

  cedricvidal

  committed
  1d5700e

  Copy full SHA for 1d5700e