You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I think it would be good to count the number of tokens during a chat session and always also output how much the question and answer cost. What do you think? Is that technically possible?
Activity
haesleinhuepf commentedon Sep 18, 2023
And only chatGPT 3.5 can be fine-tuned at the moment (#6 )
tischi commentedon Sep 18, 2023
Interesting.
I think it would be good to count the number of tokens during a chat session and always also output how much the question and answer cost. What do you think? Is that technically possible?
haesleinhuepf commentedon Sep 19, 2023
I'm not sure. I didn't measure it so precisely, but playing with a notebook for an hour commonly costs 1-5 ct.
tischi commentedon Sep 19, 2023
My question would be whether this is 20x more expensive when you use gtp4.0 instead of gpt3.5 ...
Did you try this? Can we even get the costs for one session somehow?
tischi commentedon Oct 1, 2023
I implemented token counting like this:
https://www.educative.io/answers/how-to-count-tokens-before-sending-an-api-request-to-chatgpt
Now it would be nice to also obtain the prices:
https://community.openai.com/t/is-the-current-model-pricing-available-via-the-api/406893
Implement token counting, #5
tischi commentedon Oct 2, 2023
Seems that this is currently now available and we have to manually maintain a list of the prices, which I already did by implementing a
Modelsclass.https://community.openai.com/t/is-the-current-model-pricing-available-via-the-api/406893/2
haesleinhuepf commentedon Oct 4, 2023
If we put pricing in, it would be great if
_pricing.pyto keep it separatehaesleinhuepf commentedon Oct 7, 2023
See PR #24 for code doing this
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment