Make the model fit.
A smaller weight file is the beginning of a memory budget. Context, runtime and quality still have a bill to pay.
Models.
Model editions, quantization and what changes inside a checkpoint.
Model editions, quantization and what changes inside a checkpoint.