Repository navigation

Commits

Commits on Nov 14, 2023
- Update README to indicate project status
  tju01
  authored
  9f7cc4e
- Update README to indicate project status
  tju01
  authored
  ac8fbf7
- [FEAT] Allow setting custom openai api base (#90)
  
  ishaan-jaff
  and
  tju01
  authored
  d488c87
Commits on Oct 9, 2023
- Add `datasets` to requirements
  tju01
  committed
  43bae4b
- vLLM: Automatically determine max_num_batched_tokens
  tju01
  committed
  45c1fa7
Commits on Oct 2, 2023
- Add note about project status to readme
  tju01
  authored
  0b6d248
Commits on Sep 27, 2023
- Add mistralai/Mistral-7B-Instruct-v0.1
  tju01
  committed
  de7d774
Commits on Sep 11, 2023
- Add WizardMath-13B
  tju01
  committed
  c90e893
- Fix too early return from CoT evaluation
  tju01
  committed
  17ffcad
Commits on Sep 10, 2023
- README: Note that CoT tasks can be ran individually
  tju01
  authored
  f1b6234
Commits on Sep 7, 2023
- Fix OpenAI request rate limiting
  tju01
  committed
  5077add
- FastChat: Filter empty messages
  tju01
  committed
  cf9d4d5
Commits on Sep 5, 2023
- Update to changes in vLLM event loop behaviour
  tju01
  committed
  f02bd06
- Fix OpenAI max_new_tokens
  tju01
  committed
  bd5268f
- Fix OpenAI & FastChat
  tju01
  committed
  def9e73
Commits on Sep 4, 2023
- Small updates to documentation (#85)
  tju01
  authored
  c121807
Commits on Sep 3, 2023
- Fix vLLM/TGI correctness check for asyncio
  tju01
  committed
  60e5a0e
- Fix inference backend selection for asyncio
  tju01
  committed
  be823ab
- HumanEval+: Use asyncio
  tju01
  committed
  d8f30a3
- Replace `join_threads` with `join_tasks`
  tju01
  committed
  c918520
- Run until all asyncio tasks have finished
  tju01
  committed
  63532ca
- Fix LM-Eval asyncio
  tju01
  committed
  e910a9f
- Fix missing import
  tju01
  committed
  d371fc5
- MT-Bench: Use asyncio for judging
  tju01
  committed
  9433e8e
- LM-Eval: Use asyncio< 8000 /a>
  tju01
  committed
  3d4b141
- DS-1000: Use asyncio
  tju01
  committed
  a8442f0
- Fastchat: Use asyncio instead of threads
  tju01
  committed
  ac9d15c
- TGI: Replace thread with asyncio
  tju01
  committed
  b4b5fc4
- Undo changes in `reports` folder from #78
  tju01
  committed
  706b83c
- Use more asyncio for inference to prevent problems with too many threads (#78)
  tju01
  authored
  e475743
Commits on Sep 2, 2023
- Discord link, contributor guide, code formatting (#80)
  tju01
  committed
  af35133
- Use `isort` for sorting imports
  tju01
  committed
  6b2c813
- Use `black` code formatter
  tju01
  committed
  04ecefc
Commits on Aug 31, 2023
- Remove unneeded script for recomputing MATH results
  tju01
  committed
  745cf92
- Further improve CoT scoring
  tju01
  committed
  8d0d6b1

Branch selector

User selector

Datepicker

Commit history

Commits on Nov 14, 2023

Commits on Oct 9, 2023

Commits on Oct 2, 2023

Commits on Sep 27, 2023

Commits on Sep 11, 2023

Commits on Sep 10, 2023

Commits on Sep 7, 2023

Commits on Sep 5, 2023

Commits on Sep 4, 2023

Commits on Sep 3, 2023

Commits on Sep 2, 2023

Commits on Aug 31, 2023