inteldpo/vllm-cpu:0.5.3

Manifest digest

sha256:e62e5f8f5e1cae712a9f8e58863c9d99df153b7c65e54156990a8b9f9afdc1bf

OS/ARCH

linux/amd64

Compressed size

1.83 GB

Last pushed

about 2 years by inteldpo

Type

Image

Manifest digest

sha256:e62e5f8f5e1cae712a9f8e58863c9d99df153b7c65e54156990a8b9f9afdc1bf

Image Layers

1ARG RELEASE0 B

2ARG LAUNCHPAD_BUILD_ARCH0 B

3LABEL org.opencontainers.image.ref.name=ubuntu0 B

4LABEL org.opencontainers.image.version=22.040 B

5ADD file ... in / 28.17 MB

6CMD ["/bin/bash"]0 B

7RUN /bin/sh -c apt-get update244.76 MB

8RUN /bin/sh -c pip install68.23 MB

9ENV LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libtcmalloc_minimal.so.4:/usr/local/lib/libiomp5.so:0 B

10RUN /bin/sh -c pip install231.43 MB

11RUN /bin/sh -c pip install5.47 MB

12COPY ./ /workspace/vllm # buildkit71.15 MB

13WORKDIR /workspace/vllm32 B

14RUN /bin/sh -c pip install1.17 GB

15ARG VLLM_CPU_DISABLE_AVX5120 B

16ENV VLLM_CPU_DISABLE_AVX512=0 B

17RUN |1 VLLM_CPU_DISABLE_AVX512= /bin/sh -c25.1 MB

18WORKDIR /workspace/32 B

19RUN |1 VLLM_CPU_DISABLE_AVX512= /bin/sh -c182 B

20ENTRYPOINT ["python3" "-m" "vllm.entrypoints.openai.api_server"]0 B

Command

 ARG RELEASE