An optimizer that uses properties of weight matrices (like their structure) to compute better updates.