Thanks for the feedback, I see your Intervals payload returned is pretty big (great to see so much activity!).
“sizes”: { “athlete”: 92999, “activities_light”: 54216, “activities_full”: 53265, “wellness”: 45894, “calendar”: 86936, “power_curve”: 47419, “total”: 380896 bytes}
“rows”: { “athlete”: 1, “light”: 128, “full”: 12, “wellness”: 43, “calendar”: 29, “power_curve”: 2 }
After computation by the application, this returns a payload to ChatGPT of 106158 bytes for a weekly report ; this should not blow ChatGPT response in theory, but token calculations are sometimes a mystery, there is no easy way to accurately calculate what goes on behind the scenes aside dumping your JSON response into the tokeniser and then adding a “rule of thumb”.
I have made some further optimisations to reduce returned payload to ChatGPT, and I’m very grateful for this type of feedback as it’s not easy for devs to anticipate this behaviour inside GPT apps.
By comparison my weekly report:
“athlete”: 1, “light”: 121, “full”: 8, “wellness”: 43, “calendar”: 22, “power_curve”: 1, }
“sizes”: { “athlete”: 74043, “activities_light”: 54084, “activities_full”: 35200, “wellness”: 42584, “calendar”: 68034, “power_curve”: 30934, “total”: 305006 bytes,
This returns to ChatGPT a payload of 70121 byes, which is estimated as 20,063 tokens (A helpful rule of thumb is that one token generally corresponds to ~4 characters of text for common English text. This translates to roughly ¾ of a word (so 100 tokens ~= 75 words).
Total estimate (using tiktoken):
INPUT (semantic) ~20,000
SYSTEM PROMPT ~4,000
OUTPUT (markdown) ~2,500
--------------------------------
TOTAL ~26,500 tokens
this is very short of 128k limit for v5.x. Sorry for the technical explanation, but I am keen to address this issue.
Clive
p.s if you are a “free” chatgpt user then yes this is likely the issue; apologies for not making that clearer.
- Context Window (Memory): Free users generally have a smaller context window compared to paid tiers, with some models limited to around 16k tokens, while Plus users get upto 128k
| Tier |
Technical max |
Practical reliable |
| Free |
up to model limit (theoretically) |
~5k–15k |
| Paid |
up to ~128k |
~20k–50k+ |