In retrospect we should have opened the "programmer" first, then we would have seen that it's actually a dumb matrix-keyboard and all the smarts are in the display itself.
The plan was to implement to "programming protocol" in Arduino (or similar) so that we could do more with the display, well we can still do it but it required a different approach (need to detect when a scan starts and then do some bit-fiddling)