Gilles Castel (RIP) published a couple articles on taking math notes with Vim + LaTeX which I found eye-opening. In another article he posted about how he integrates Inkscape into the process. If you haven’t read the articles, they may be helpful for what you are doing.