software for producing LaTeX from image?

[TADAitsnick]

Hi folks!

I was searching for some software that I could use for taking handwritten notes on my laptop using my USB tablet. Since I could not find one, I decided to start writing my own as an open source project yesterday. My philosophy with software is do one thing and do it well, so I want it to be a very simple-lightweight program using C++/GTK4. So that's the context for this question to the community.

On the one hand, a program would be very simple to just use GtkDrawingArea and handle file IO, settings, and a toolbar. Then, incrementally add updates and if others are interested in contributing then it could grow from there if it finds a user base.

But thinking ahead, I'm looking for a backend that I could use to make it more powerful. The idea I have is instead of storing notes as raw images, to include a tool that converts a selected section of the image into LaTeX markup and uses pdflatex to produce a rendered text image and embed that in place. I don't have the time to do an exhaustive literature search on neural networks for handwriting recognition nor the capital to invest in hundreds of GPUs to train a model just for implementing one feature into my little project. So I'm looking for some API or external dependency that can do what I'm looking for.

The closest thing that I've found is this project here: kingyiusuen/image-to-latex.
I have not used this software yet, and I will try it out if I don't find something more promising first.

I have also found a python project for specifically math -> LaTeX that is in beta: pix2tex.

But I'm curious if anyone knows of any production software for converting handwriting into LaTeX that I'm missing.
Thanks in advance!

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Nick