Sarah Yoo • over 1 year ago
Built-in APIs are so slow (+ where to email project api keys and configs?)
I'm using Prompt and Summarization APIs, and they are giving responses so slowly that they affect my app's functionality. Is this expected behaviour because these APIs are still on test?
Additionally, how can I send you api keys and configs (firebase config) required to run my apps? Thank you!
Comments are closed.
3 comments
minhaj uddin • over 1 year ago
Yep, same here. My prompt response is taking something around 10-30 secounds for reponse. The hack is to use to do segmentation of the prompt and call it asyn using Promise.all method
dragonjump sean • over 1 year ago
Faced the same and i recommend all of you to
1. use streaming
2. stagger or lazy load the event . Example if the screen section not loaded/scrolled, begin call in the background
Venetta Smithen • over 1 year ago
Hi, I’m a bit late but I researched the issue and found from your experienced issues with the API response times that these steps can be caused by .
1. Slow API Responses
• Possible Causes:
• APIs in testing environments or beta phases might have slower response times due to limited infrastructure or debugging processes.
• Network latency or region-based server delays could also contribute to the issue.
• Rate limits, high traffic, or API quotas being exceeded may slow responses.
Possible solutions to mitigate this issue include:
1. Check API Status: Verify if the API provider has any ongoing maintenance or known issues. Look for a status page or announcements.
2. Optimize Requests: Reduce payload size, use concise inputs, and ensure your code doesn’t make unnecessary calls.
3. Caching: Cache frequent responses if possible, reducing the need for repeated API calls.
4. Batch Requests: If the API supports it, send multiple requests in a single batch to reduce overhead.
5. Reach Out to Support: Contact the API provider’s support team to confirm if slow responses are expected or to report the issue.