Fix some latexdef's. (#3800)

* consistently begin a new line for new definitions
* add some `\mathbin` for more consistent spacing
* upright omega when not a variable
* calligraphic $\mathcal{C}^n$ for continuity classes