Designers draw to explore ideas and solutions. We look at empirical studies of the use of drawing in design, including our own work on the connection between graphic symbols and specific design concerns. We describe an empirical study on sketching for designing an architect's office. We found that designers use different drawing conventions when thinking about different design concerns. We are implementing a freehand drawing program to recognize these drawing conventions and to deliver appropriate knowledge based support for the task at hand.