.Net: About Function Calling deserialization

[moonbox3]

Discussed in #9620

^{Originally posted by goranged-intc November 8, 2024}
Hello team,

First, some context, our company group has been heavily using SK for the past year and a half. However, we are using it as a backend, we abstract multiple models through it and we expose chat completion, embedding and other services through APIs:

Client -> Inference API -> SK AI Backend -> Provider

Now, it works but now we are trying to enable FUnction Calling for clients using function calling:

Client (Using SK with function calling) -> Inference API -> SK AI Backend -> Provider.

And the challenge is that, since the SK in the client is serializing the tools and passing that in the payload, the SK in the backend is just receiving those tools, but we don't see a way to convert (in the backend) those tools (json) into plugin function with parameters since the functions are not in the context of the backend SK.

Do you know a way to handle the function calling passthrough in the backend?

Best,
Guillermo.