9 4 11

Jonna Matthiesen

JonnaMat

AI & ML interests

None yet

Recent Activity

updated a collection about 3 hours ago

Cosmos-Reason2

updated a collection about 3 hours ago

Cosmos-Reason2

updated a collection about 3 hours ago

Cosmos-Reason2

View all activity

Organizations

updated 3 collections about 3 hours ago

reacted to AINovice2005's post with 👍 1 day ago

Post

357

Pro tip: If you are finetuning any model with tensorboard logs enabled, be sure to upload them to HF Hub as event artifacts, they can be viewed instantly. 🚀

I previously remembered this done in the notus model release: argilla/notus-7b-v1

Examples:

AINovice2005/ModernBERT-base-lora-cicflow-1m-r8

AINovice2005/ModernBERT-base-lora-cicflow-1m-r4

AINovice2005/ModernBERT-base-lora-cicflow-1m-r16

cc: @davidberenstein1957

replied to their post 1 day ago

🤓 Want to learn more about FlashHead? Check out this blog post: https://huggingface.co/blog/JonnaMat/flashhead

published an article 1 day ago

Article

FlashHead: Accelerating Language Model Inference ~ Efficient drop-in replacement for the classification head

1 day ago

updated a dataset 2 days ago

embedl/documentation-images

Viewer • Updated 2 days ago • 7 • 3.67k

posted an update 2 days ago

Post

5029

🚀 FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference

🔎 Check out our latest FlashHead-enabled model: embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead

🧩 Seamless integration with vllm:

docker run --rm -it \
  --network host \
  --shm-size=8g \
  --ulimit memlock=-1 \
  --ulimit stack=67108864 \
  --runtime=nvidia \
  --name=vllm-serve \
  -e HF_TOKEN=hf_*** \
  -e HF_HOME=/root/.cache/huggingface \
  embedl/vllm:latest-jetson-orin-flashhead \
  vllm serve "embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead" \
    --max-model-len 8192 \
    --gpu-memory-utilization 0.75 \
    --max-num-seqs 2 \
    --trust-remote-code