can textgrad read diffs?

[rawwerks]

can textgrad read diffs? i think this would be particularly useful to applying textgrad to coding agents, which are often operating on files that are too large to fit into the context window.

(bonus points if this can be integrated with git, so the teacher LLM is evaluating git commits of the student.)

[mertyg]

Great idea! Quick digression: I recently saw this paper doing this for agent optimization.
Need to think a bit about how to implement this. This feels akin to the current momentum implementation, where instead of keeping the latest k states of the variable, keep the diffs or something?

[rawwerks]

https://github.com/paul-gauthier/aider/ is the best example i can think of. but only "smart" LLMs can operate in "diff mode" (dumb ones need to keep the whole file in context).