Here is a paper by Mark Seidenberg that has some interesting thoughts about ways in which connectionism could be used to develop linguistic theory (contrast Embick and Marantz’s claim that connectionism has contributed *nothing* to our understanding of the language faculty). This elaborates in some ways on our own speculations about hidden layers and hidden structure. And here is an article in which Smolensky talks to a connectionist audience about how he views the relationship between generative grammar and connectionism.

Here is Jeff Elman’s annotated (“very selective”) bibliography on the past tense debate (and some other useful stuff – from a course he gave in Bulgaria).