I feel like Groq isn’t always accurate about their reported latency

https://preview.redd.it/30lqkveogu0g1.png?width=2226&format=png&auto=webp&s=86e4d970f30d0a9a8117269bdae7d4d3ef3e0954

https://preview.redd.it/zefw49nygu0g1.png?width=338&format=png&auto=webp&s=523168eda069f3642a54a4ff5b020f5984f17ff6

I have logging of Langfuse on my server side, which always works well. When I felt some delay in usage, I went and checked the logs, and Langfuse was able to detect the latency , but Groq is hiding the latency. I don’t know how they calculate it, but since the message was streamed, I can definitely say the latency didn’t match. Just want to know if anyone else felt the same.

Posted Nov 12, 2025, 3:31 PM UTC

10
Loading comments…