8000 default model · Issue #65 · haesleinhuepf/bia-bob · GitHub
[go: up one dir, main page]

Skip to content

default model #65

Closed
Closed

Description

@haesleinhuepf

Following up an earlier discussion about changing the default model (see #47 ): I was just playing with gpt-4 and from my perspective, it is much slower than gpt-3.5-turbo.

Activity

  1. tischi commented on Nov 1, 2023

    @tischi
    Collaborator

    Related: https://community.openai.com/t/gpt-4-extremely-slow-compared-to-3-5/106298

    OK, not sure then maybe we leave 3.5-turbo as the default for now?

  2. tischi commented on Nov 2, 2023

    @tischi
    Collaborator
    image

    is blazing fast on the web. I wonder whether they do not ship the latest version for the API...

  3. tischi commented on Nov 2, 2023

    @tischi
    Collaborator

    gpt-4 via API is really super slow, maybe something is broken at openAI?

  4. haesleinhuepf commented on Nov 8, 2023

    @haesleinhuepf
    OwnerAuthor

    gpt-4-trubo seems cheaper and faster than gpt-4. we could consider it as new default...

    https://openai.com/blog/new-models-and-developer-products-announced-at-devday

  5. tischi commented on Nov 8, 2023

    @tischi
    Collaborator

    Side remark, did you try the latest web-API?
    They got rid of the streaming preview....

  6. haesleinhuepf commented on Nov 10, 2023

    @haesleinhuepf
    OwnerAuthor

    Side remark, did you try the latest web-API? They got rid of the streaming preview....

    I just tried and it's still streaming...

  7. tischi commented on Nov 10, 2023

    @tischi
    Collaborator

    now streaming for me too, again...

    I am fine with gpt-4-turbo as new default.

  8. tischi commented on Nov 10, 2023

    @tischi
    Collaborator

    just tried and gpt-4-turbo is awesome! best experience so far, by far!

    let's just hope that that does not degrade once more people are using it.....

    issue with adding this now as default model is that the name will likely change soon, right now it is something with "preview".

    anyway, right now, I am all for this being the new default!

  9. haesleinhuepf commented on Nov 11, 2023

    @haesleinhuepf
    OwnerAuthor

    I don't have access to it yet. Maybe we wait a bit before we make this default ;-)

    image

    https://github.com/haesleinhuepf/bia-bob/blob/main/demo/choose_model.ipynb

  10. haesleinhuepf commented on Nov 17, 2023

    @haesleinhuepf
    OwnerAuthor

    Ok, I just read gpt-4-turbo is called gpt-4-1106-preview.

    https://help.openai.com/en/articles/8555510-gpt-4-turbo

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      0