Instructions to use HuggingFaceM4/tiny-random-idefics with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use HuggingFaceM4/tiny-random-idefics with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="HuggingFaceM4/tiny-random-idefics")

# Load model directly
from transformers import AutoProcessor, AutoModelForImageTextToText

processor = AutoProcessor.from_pretrained("HuggingFaceM4/tiny-random-idefics")
model = AutoModelForImageTextToText.from_pretrained("HuggingFaceM4/tiny-random-idefics")

Notebooks
Google Colab
Kaggle
Local Apps

vLLM

How to use HuggingFaceM4/tiny-random-idefics with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "HuggingFaceM4/tiny-random-idefics"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/tiny-random-idefics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/HuggingFaceM4/tiny-random-idefics

SGLang

How to use HuggingFaceM4/tiny-random-idefics with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "HuggingFaceM4/tiny-random-idefics" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/tiny-random-idefics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "HuggingFaceM4/tiny-random-idefics" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "HuggingFaceM4/tiny-random-idefics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use HuggingFaceM4/tiny-random-idefics with Docker Model Runner:
```
docker model run hf.co/HuggingFaceM4/tiny-random-idefics
```

tiny-random-idefics

Commit History

Update config.json

e8ba442

ybelkada commited on Jul 25, 2023

Update config.json

b241ecf

ybelkada commited on Jul 25, 2023

Update config.json

d95f7c5

ybelkada commited on Jul 25, 2023

Update config.json

7f8395b

ybelkada commited on Jul 25, 2023

Update config.json

14f552a

ybelkada commited on Jul 25, 2023

Update config.json

6987413

ybelkada commited on Jul 25, 2023

Update config.json

fe0f997

ybelkada commited on Jul 25, 2023

Update config.json (#1)

1ad887a

stas

ybelkada commited on Jul 25, 2023

processor config

7a370ca

stas commited on Jul 19, 2023

tokenizer

0968114

stas commited on Jul 12, 2023

Update config.json

af110e6

stas commited on Jul 12, 2023

fix

51ef8da

stas commited on Jul 10, 2023

clone HuggingFaceM4/tiny-random-LlamaForCausalLM and rename

5a73ed1

stas commited on Jul 10, 2023

initial commit

2496b33

Stas Bekman commited on Jul 10, 2023

Commit History

Update config.json e8ba442

Update config.json b241ecf

Update config.json d95f7c5

Update config.json 7f8395b

Update config.json 14f552a

Update config.json 6987413

Update config.json fe0f997

Update config.json (#1) 1ad887a

processor config 7a370ca

tokenizer 0968114

Update config.json af110e6

fix 51ef8da

clone HuggingFaceM4/tiny-random-LlamaForCausalLM and rename 5a73ed1

initial commit 2496b33

Update config.json

e8ba442

Update config.json

b241ecf

Update config.json

d95f7c5

Update config.json

7f8395b

Update config.json

14f552a

Update config.json

6987413

Update config.json

fe0f997

Update config.json (#1)

1ad887a

processor config

7a370ca

tokenizer

0968114

Update config.json

af110e6

fix

51ef8da

clone HuggingFaceM4/tiny-random-LlamaForCausalLM and rename

5a73ed1

initial commit

2496b33