Terahertz fields are now available will sufficient strengths to drive nonlinear responses in a wide range of materials. THz field interactions with lattice, electronic, and spin degrees of freedom and monitoring of THz-induced responses with THz, optical, and x-ray probes will be illustrated, with emphasis on THz-driven structural and electronic phase transitions. Recently developed methods that will enable combined control over multiple degrees of freedom will also be introduced.