# Model fine-tuning briefing Date: 06/08/2025 > For `.pt` model files, please go to https://huggingface.co/lygitdata/garmentiq. Ranking: - 🏆 1st place: tinyViT (`tiny_vit_inditex_finetuned.pt`) - execellent performance on new Zara data (99.16% accuracy), preserves strong performance on the original Nordstrom & Myntra testing data (94.84% accuracy). - 🥈 2nd place: CNN4 (`cnn_4_inditex_finetuned.pt`) - 🥉 3rd place: CNN3 (`cnn_3_inditex_finetuned.pt`) *Note*: All these models were fine-tuned using optimizer `AdamW` with learning rate `0.00001` and weight decay `0.0001`. Data: - Zara data: https://www.kaggle.com/datasets/lygitdata/zara-clothes-image-data - Nordstrom & Myntra data: https://www.kaggle.com/datasets/lygitdata/garmentiq-classification-set-nordstrom-and-myntra --- ## tinyViT performance with fine-tuning ### Training evaluation on Zara data ``` Test Loss: 0.0390 Test Accuracy: 0.9916 Test F1 Score: 0.9917 Classification Report: precision recall f1-score support long sleeve dress 1.00 0.99 0.99 80 long sleeve top 0.99 0.99 0.99 352 short sleeve dress 0.93 1.00 0.97 14 short sleeve top 1.00 1.00 1.00 84 shorts 1.00 1.00 1.00 56 skirt 1.00 1.00 1.00 62 trousers 1.00 1.00 1.00 80 vest 0.96 0.98 0.97 94 vest dress 1.00 1.00 1.00 12 accuracy 0.99 834 macro avg 0.99 0.99 0.99 834 weighted avg 0.99 0.99 0.99 834 ``` ### Test on original Nordstrom & Myntra testing data ``` Test Loss: 0.1683 Test Accuracy: 0.9484 Test F1 Score: 0.9483 Classification Report: precision recall f1-score support long sleeve dress 0.89 0.95 0.92 384 long sleeve top 0.94 1.00 0.97 442 short sleeve dress 0.90 0.88 0.89 382 short sleeve top 0.98 0.98 0.98 523 shorts 0.99 0.97 0.98 485 skirt 0.98 0.90 0.94 281 trousers 0.97 0.99 0.98 320 vest 0.95 0.89 0.92 230 vest dress 0.94 0.93 0.93 442 accuracy 0.95 3489 macro avg 0.95 0.94 0.95 3489 weighted avg 0.95 0.95 0.95 3489 ``` --- ## CNN4 performance with fine-tuning ### Training evaluation on Zara data ``` Test Loss: 0.1355 Test Accuracy: 0.9592 Test F1 Score: 0.9585 Classification Report: precision recall f1-score support long sleeve dress 0.98 0.99 0.98 80 long sleeve top 0.99 0.97 0.98 352 short sleeve dress 0.75 0.86 0.80 14 short sleeve top 0.92 0.98 0.95 84 shorts 0.96 0.88 0.92 56 skirt 0.88 0.97 0.92 62 trousers 0.98 1.00 0.99 80 vest 0.97 0.97 0.97 94 vest dress 0.86 0.50 0.63 12 accuracy 0.96 834 macro avg 0.92 0.90 0.90 834 weighted avg 0.96 0.96 0.96 834 ``` ### Test on original Nordstrom & Myntra testing data ``` Test Loss: 0.3326 Test Accuracy: 0.9132 Test F1 Score: 0.9137 Classification Report: precision recall f1-score support long sleeve dress 0.92 0.83 0.87 384 long sleeve top 0.97 0.88 0.92 442 short sleeve dress 0.75 0.97 0.84 382 short sleeve top 0.91 0.97 0.94 523 shorts 0.94 0.98 0.96 485 skirt 0.95 0.83 0.88 281 trousers 0.96 0.97 0.97 320 vest 0.95 0.85 0.90 230 vest dress 0.94 0.88 0.91 442 accuracy 0.91 3489 macro avg 0.92 0.91 0.91 3489 weighted avg 0.92 0.91 0.91 3489 ``` --- ## CNN3 performance with fine-tuning ### Training evaluation on Zara data ``` Test Loss: 0.2756 Test Accuracy: 0.9197 Test F1 Score: 0.9216 Classification Report: precision recall f1-score support long sleeve dress 0.89 0.95 0.92 80 long sleeve top 0.97 0.95 0.96 352 short sleeve dress 0.62 0.71 0.67 14 short sleeve top 0.94 0.95 0.95 84 shorts 0.94 0.86 0.90 56 skirt 0.79 0.92 0.85 62 trousers 0.99 1.00 0.99 80 vest 0.92 0.82 0.87 94 vest dress 0.35 0.50 0.41 12 accuracy 0.92 834 macro avg 0.82 0.85 0.83 834 weighted avg 0.93 0.92 0.92 834 ``` ### Test on original Nordstrom & Myntra testing data ``` Test Loss: 0.3338 Test Accuracy: 0.9074 Test F1 Score: 0.9068 Classification Report: precision recall f1-score support long sleeve dress 0.84 0.89 0.86 384 long sleeve top 0.94 0.93 0.94 442 short sleeve dress 0.76 0.94 0.84 382 short sleeve top 0.93 0.98 0.95 523 shorts 0.96 0.97 0.96 485 skirt 0.94 0.81 0.87 281 trousers 0.94 0.99 0.97 320 vest 0.99 0.69 0.81 230 vest dress 0.94 0.84 0.89 442 accuracy 0.91 3489 macro avg 0.92 0.89 0.90 3489 weighted avg 0.91 0.91 0.91 3489 ```