The horrible mess
Whenever I search for embedded Raspberry Pi Zero projects, almost everything is made with super slow Python and some insanely buggy library full of hacks that are already broken from existing system patches and relying on low-level libraries that are not even maintained anymore, only to call 10 lines of assembly code at the bottom of the mess. They even have redundant security permissions to make calls that are directly exposed in assembler.
The main problem
The boot times of Raspbian in CLI mode is not nearly enough for robotic C++ projects and there are too many things that can go wrong when starting and stopping the program. Now I'm looking for a cleaner read-only-system that can be flashed the SD card via USB and maybe debug via wifi using SSH.
A good starting point, but a library might help
Found a guide for older Pi computers using pure assembly without any operating system which is a little lower than what I need.
https://www.studica.com/blog/program-embedded-systems-raspberry-pi
Writing a large scale application needs at least Micro-C/C/C++ for hardware portability and some abstraction for accessing the camera. I don't like mixing C and whole assembler functions due to undefined behavior in call conventions.
My goal is to actually use the system, so I'm not going to spend the rest of my life writing a whole operating system from scratch, just need something in between the bloated mess and nothing at all.