You had to work with graphics hardware directly. How would you like to toggle port 0x8034 manually just to produce a pixel on the screen? Drivers for graphics hardware abstracted drawing of primitives and simple management of resources. Still not a piece of cake. High-level libraries for anything from 3D rendering to movie playback.