groq support

[kasun]

Is supporting groq as a llm provider desirable to have in the project?

https://groq.com

[chandralegend]

Yeah i was just checking it out. the only issue is it doesnt support pydantic models, we have to pass the json schema and them validate the output through the pydantic. But its fine

[kasun]

Implemented via #132