I'm not sure how poor the Summoner was, but think the poor tended to wear low quality wool, wooden shoes etc. I found this very useful resource though - there is a huge glosssary of clothing terms, and if you scroll right down to the bottom, you find descriptions of all Chaucer's pilgrims which you can match to contemporary illustrations. Hope this helps.
