token usage not right in stream mode #1357
Description
if strings.Contains(responseText, streamingEndMsg) {
resp := parseRespForUsage(ctx, responseText)
Actually streamingEndMsg = "data: [DONE]", it does not include tokeusage.
{{ message }}
if strings.Contains(responseText, streamingEndMsg) {
resp := parseRespForUsage(ctx, responseText)
Actually streamingEndMsg = "data: [DONE]", it does not include tokeusage.