The Sox have drafted a ton of college pitches over the years with mixed success. Going back Rauch, Fernandez, McDowell, Parque, Wright, off the top of my head, were all college pitchers.
The Sox biggest problem in general is we really haven't had high enough draft picks to get the Mark Prior type picks. And even if we have, we have avoided most of them due to salary/agent worries.