We’ve been grappling with making it local but two considerations
1. Haven’t figured out what should trigger updates. Every commit sounds crazy, every save would be perfect but too intensive also.
2. LLMs will not be self hosted. We haven’t been able to get the same results with any smaller LLMs
To answer your questions we definitely want to make this available for local repos and ideally self hosted, on a technical level that’s probably several month away.
I've given it a fairly serious shot and my conclusion is that building IDE hooks is seriously depressing. IntelliJ deprecates APIs constantly and the docs don't really keep up.
And then there's the total dumpster fire that is trying to support GPU acceleration on multiple platforms.
Unfortunately it's easily 10x the work to do this kind of thing local only.