The title says it. In a nutshell, no matter how many of the 128k tokens are left after input, the model will never output more than 4k including via the API. That works for some RAG apps but can be an issue for others. Just be aware. (source)
bolddata
u/bolddata
Over the summer, I created a working retrieval-augmented generation (RAG) product prototype for a sizeable potential customer using OpenAI API. It became a ChatGPT-like expert agent with deep, up-to-date domain knowledge and conversational skills. But I am shutting it down instead of rolling it out. Here is why, how I got there and what it means for the future.
https://www.bolddata.org/blog/llamar-ai-infeasibility-retrieval-augmented-generation-llm/
(tl;dr - its not viable, $100k/month API costs)
EDIT: Solved, it was an AWS Amplify rewrite rule with a space, not Route53.
Hello,
I am redirecting an apex-domain to www.apex-domain using Route53 and record type A. I thought it worked since Google search and Chrome redirect correctly but on closer inspection Bing and curl fail. turns out the former are more forgiving than the latter.
What happens is apex-domain/some/where gets redirected to www.apex-domain /some/where (note the space/tab) instead of www.apex-domain/some/where.
I checked the redirect record for spaces or errors and even recreated it. No luck. I cannot find any information on this kind of issue (or I am searching the wrong terms). Any
Why I became a Solo Founder [What was your motivation and experience?]
bolddata.org/blog/why-i-became-a-solo-founder/I want to share some free data (maybe regularly) to attract future users and get more insights into their needs. The first dataset I am considering sharing is Amazon sales rank data from multiple countries. Each country has roughly 1.2 to 2m products ranked. My problem is the usual Excel limit of 1m rows and bias towards CSV. I expect at least part of the users to be more familiar with Excel than Python, R or other tools.
I considered exporting the data as GZipped CSVs, sampling or limiting the dataset to 1m rows per country or split it into multiple files but it seems inelegant. If I was not worried about Excel I could use compressed JSON, which I presume would be most portable for non-Exc
You've reached the end of this feed.