What alternative mo...
 
Notifications
Clear all

What alternative model should I use? AI4I Chat With your Document

4 Posts
2 Users
1 Likes
139 Views
(@rayn)
Active Member Member
Joined: 3 months ago
Posts: 7
Topic starter  
 
Apparently bigscience/Bloomz inference has been turned off. and for some reason google/flan-t5-xxl is returning empty string. the later is working on hugging face.
 
flan: xl model hang, large model didn't give me the right answer.
 
Both are tested on google colab
 
May I know what alternative model should I use?

   
Quote
Topic Tags
llm
Gayathriy
(@gayathriy)
Reputable Member Moderator
Joined: 12 months ago
Posts: 191
 

Hi Ryan, 

Please refer to our response to your email query on the same.

Best regards,
Gayathriy


   
Ryan Ng reacted
ReplyQuote
(@rayn)
Active Member Member
Joined: 3 months ago
Posts: 7
Topic starter  

In the email I was suggested to use google/flan-t5-xxl.

The model gave me black responses

The input_docs have valid responses and the documents are loaded and there is no initial error right at the start other than a warning

image
image

 

The full warning from the first screenshot:

image
This post was modified 3 months ago by Ryan Ng

   
ReplyQuote
(@rayn)
Active Member Member
Joined: 3 months ago
Posts: 7
Topic starter  

Even in Google colab, google/flan-t5-xxl is returning only empty string


   
ReplyQuote
Share: