Skip to content

vllm.utils.mem_constants

GB_bytes module-attribute

GB_bytes = 1000000000

The number of bytes in one gigabyte (GB).

GiB_bytes module-attribute

GiB_bytes = 1 << 30

The number of bytes in one gibibyte (GiB).

KB_bytes module-attribute

KB_bytes = 1000

The number of bytes in one kilobyte (KB).

KiB_bytes module-attribute

KiB_bytes = 1 << 10

The number of bytes in one kibibyte (KiB).

MB_bytes module-attribute

MB_bytes = 1000000

The number of bytes in one megabyte (MB).

MiB_bytes module-attribute

MiB_bytes = 1 << 20

The number of bytes in one mebibyte (MiB).