For deep cleaning, first, unplug the toaster oven, remove the crumb tray and racks and plunge them into a sink with some mild dish soap and warm water to soak. Consumer Reports recommends mixing vinegar, warm water, and a little dish soap and using good old-fashioned elbow grease to wipe the oven.