After 25 days I have successfully got pixels on screen from scratch! No firmware or UEFI, just interacting directly with the hardware on an SOC.