According to our patented, totally-not-made-up Sock Sorting Theory, this is what happens when you try to sort socks by color.
Step 1: Take your socks out of the drawer and onto the floor. Step 1.1: Sort by Heel Size
Step 2: Sort by color, but not too much. Step 2.1: Sort by Toe Shape