RAM Capacity Constraints
The total installed RAM strictly determines which model sizes can be loaded; on a 16GB M2 Mac Mini this limits practical use to 4-bit quantised models under 7B parameters, and RAM cannot be upgraded after purchase.
Related
gguf-4-bit-quantisation unified-memory-architecture local-llm-inference mac-mini-m2 mac-mini-m4-pro