I feel like Groq isn’t always accurate about their reported latency
I have logging of Langfuse on my server side, which always works well. When I felt some delay in usage, I went and checked the logs, and Langfuse was able to detect the latency , but Groq is hiding the latency. I don’t know how they calculate it, but since the message was streamed, I can definitely say the latency didn’t match. Just want to know if anyone else felt the same.
Posted Nov 12, 2025, 3:31 PM UTC
10