Try to use other ai provider with cheaper models for filtering before OpenAI kicks in

[samgozman]

Like https://www.together.ai/ or https://www.anyscale.com/endpoints, because llama and mistral ai can cost 10x cheaper

LLama 70b chat was really good in filtering news with this prompt, but it responded with text also. But with good explanation..

You will be given a JSON array of financial news. You need to remove from array blank, purposeless, clickbait, advertising or non-financial news. Most  important news right know is inflation, interest rates, war, elections, crisis, unemployment index etc.
Return the response in the same JSON format. If none of the news are important, return empty array [].

[{"ID":"1","Title":"This key element of ESG investing could drive real change at companies and boost returns","Description":"As environment and board diversity initiatives have gained broad acceptance, some are now trying to clarify the case for the middle pillar of ESG.","Link":"https://www.cnbc.com/","Date":"2023-11-19T16:48:26.569248+04:00","ProviderName":"cnbc"},{"ID":"2","Title":"Goldman Sachs analysts have increased conviction in these 5 stocks","Description":"Goldman Sachs analysts named a slew of stocks to buy heading into the holiday season.","Link":"https://www.cnbc.com/","Date":"2023-11-19T16:48:26.569248+04:00","ProviderName":"cnbc"},{"ID":"3","Title":"Ray Dalio says U.S. reaching an inflection point where the debt problem quickly gets even worse","Description":"Soaring U.S. government debt is reaching a point where it will begin creating larger problems, the hedge fund titan said Friday.","Link":"https://www.cnbc.com/","Date":"2023-11-19T16:48:26.569248+04:00","ProviderName":"cnbc"},{"ID":"4","Title":"The market thinks the Fed is going to start cutting rates aggressively. Investors could be in for a letdown","Description":"Markets may be at least a tad optimistic, particularly considering the cautious approach central bank officials have taken.","Link":"https://www.cnbc.com/","Date":"2023-11-19T16:48:26.569248+04:00","ProviderName":"cnbc"},{"ID":"5","Title":"Wholesale prices fell 0.5% in October for biggest monthly drop since April 2020","Description":"Wholesale prices fell 0.5% in October for biggest monthly drop since April 2020","Link":"https://www.cnbc.com/","Date":"2023-11-19T16:48:26.569248+04:00","ProviderName":"cnbc"}]