MultiPRIDE-DualEncoder-MainStage-it

README.md

@@ -4,6 +4,11 @@ license: apache-2.0
 base_model: nickprock/setfit-italian-hate-speech
 tags:
 - generated_from_trainer
+metrics:
+- accuracy
+- f1
+- precision
+- recall
 model-index:
 - name: MultiPRIDE-DualEncoder-MainStage-it
   results: []
@@ -15,6 +20,12 @@ should probably proofread and complete it, then remove this comment. -->
 # MultiPRIDE-DualEncoder-MainStage-it
 
 This model is a fine-tuned version of [nickprock/setfit-italian-hate-speech](https://huggingface.co/nickprock/setfit-italian-hate-speech) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2481
+- Accuracy: 0.9571
+- F1: 0.8772
+- Precision: 0.9615
+- Recall: 0.8065
 
 ## Model description
 
@@ -36,11 +47,25 @@ The following hyperparameters were used during training:
 - learning_rate: 2e-05
 - train_batch_size: 8
 - eval_batch_size: 8
-- seed: 85
+- seed: 42
 - optimizer: Use adamw_torch_fused with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 10
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| 0.703         | 1.0   | 95   | 0.5968          | 0.8466   | 0.3590 | 0.875     | 0.2258 |
+| 0.5651        | 2.0   | 190  | 0.4460          | 0.9018   | 0.7333 | 0.7586    | 0.7097 |
+| 0.4051        | 3.0   | 285  | 0.2983          | 0.9202   | 0.7869 | 0.8       | 0.7742 |
+| 0.2546        | 4.0   | 380  | 0.2531          | 0.9448   | 0.8475 | 0.8929    | 0.8065 |
+| 0.2111        | 5.0   | 475  | 0.2445          | 0.9571   | 0.8772 | 0.9615    | 0.8065 |
+| 0.2201        | 6.0   | 570  | 0.2539          | 0.9509   | 0.8571 | 0.96      | 0.7742 |
+| 0.2024        | 7.0   | 665  | 0.2577          | 0.9509   | 0.8571 | 0.96      | 0.7742 |
+| 0.2162        | 8.0   | 760  | 0.2481          | 0.9571   | 0.8772 | 0.9615    | 0.8065 |
+
+
 ### Framework versions
 
 - Transformers 4.57.3

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:491a103df44ba4b3b30e85292875891324f489f11865bb1a972ff6c71c095d63
+oid sha256:116bd2ab8ec6a70884c00d4f6479e764abe0a4c1aad4dcdd0edab0b50a43a691
 size 443306324

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e2643cba0eca6ac8fbcb21b2ff068fb4676cca80076c59fc883b781191a99109
+oid sha256:58a5fa00a910d91b18f801ab7801bbe644bd6cb5d1082ef69bb8c4c044a801b4
 size 5969