DFloat11 is a lossless compression framework for large language and diffusion models. It shrinks model weights by about 30% and decompresses them on the GPU on the fly, enabling inference on memory-constrained hardware.
665compression,gpu,llmDFloat11 is a lossless compression framework for large language and diffusion models. It shrinks model weights by about 30% and decompresses them on the GPU on the fly, enabling inference on memory-constrained hardware.