Use static compiled modules or compile with --prefer-non-pic

Enable all compiler optimizations with -O3

Tell the compiler what CPU you use via -march -mcpu

Use CPU specfic features -msse -mmmx -mfpmath=sse

Other options: -fomit-frame-pointer