This one is new in Domino 8.5.1 and later, but I just came across it the other day.

You can use COMPACT_FILTER= followed by a comma (or semi colon) separated list of databases to exclude from Compact when it is run server wide or against a specific directory

Technote 1415204: COMPACT_FILTER – notes.ini parameter to prevent compaction of specified files