[Bug]: Groq - Tool / Function Calling Example throws function_call is not nullable error

[timlrx]

What happened?

Following the example provided in the docs for groq tool usage throws the following error:

litellm.exceptions.BadRequestError: litellm.BadRequestError: GroqException - Error code: 400 - {'error': {'message': "'messages.2' : for 'role:assistant' the following must be satisfied[('messages.2.function_call' : Value is not nullable)]", 'type': 'invalid_request_error'}}

Simple work around is to just update the docs pass back a dict without function_call. E.g:

d = response_message.model_dump()
message.append({"role": d.get("role"), "tool_calls": d.get("tool_calls")})

Or you could consider modifying Message and not add function_call by default.

Relevant log output

No response

Twitter / LinkedIn details

No response