How to tell LLM to generate SQLs that suit the verions of db server?

[zifeiYv]

I test vanna in my local machine with MySQL verison 5.7.x, llama3.1-405b-instruct as backend LLM, chromadb as VDB.

If no specific version info of database server is set, LLM tends to generate SQL that suits somewhat newer version. In my case, for example, it generated a SQL using WITH statment, which is not supported for <8.0 version of MySQL.

I tried to solve this by:

1. Added a document:

"The version of MySQL server is 5.7.44, take it into consideration when generating SQL."

2. Added a sample of (question, sql):

The result showed that, approch 2 took effect while approch 1 did not.

I guess the language of document might not be the root cause of why approch 1 was invalid.

So, are there any other methods we could use to solve the problems?