I wonder how it'd work if the layers were more physical based. In other words something like rough 3d shape -> details -> color -> perspective -> lighting.

Also wonder if you'd get better results in generating something like blender files and using its engine to render the result.