my_local_model

This model is a fine-tuned version of facebook/wav2vec2-base on the audiofolder dataset. It achieves the following results on the evaluation set:

• Loss: 0.0386
• Accuracy: 0.9524

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e-05
• train_batch_size: 4
• eval_batch_size: 4
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 8
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 40

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
0.6887	0.9524	10	0.6923	0.5238
0.6833	2.0	21	0.6725	0.7619
0.6583	2.9524	31	0.6211	0.8571
0.601	4.0	42	0.5974	0.5714
0.4914	4.9524	52	0.4224	0.9048
0.4634	6.0	63	0.5449	0.7619
0.3808	6.9524	73	0.2323	0.9048
0.5913	8.0	84	0.4654	0.7619
0.5274	8.9524	94	0.3076	0.9048
0.2544	10.0	105	0.2538	0.9048
0.1891	10.9524	115	0.4620	0.7619
0.3321	12.0	126	0.6089	0.7619
0.2672	12.9524	136	0.0960	0.9524
0.0898	14.0	147	0.1759	0.9524
0.1003	14.9524	157	0.1802	0.9524
0.0513	16.0	168	0.3874	0.9048
0.0173	16.9524	178	0.4244	0.9048
0.3301	18.0	189	0.4579	0.9048
0.0098	18.9524	199	0.0067	1.0
0.0074	20.0	210	0.0056	1.0
0.1317	20.9524	220	0.0067	1.0
0.0058	22.0	231	0.5024	0.9048
0.0052	22.9524	241	0.0043	1.0
0.0047	24.0	252	0.2305	0.9524
0.0042	24.9524	262	0.0260	1.0
0.0038	26.0	273	0.0040	1.0
0.0035	26.9524	283	0.0034	1.0
0.0033	28.0	294	0.0034	1.0
0.0031	28.9524	304	0.0047	1.0
0.0028	30.0	315	0.0159	1.0
0.0027	30.9524	325	0.0738	0.9524
0.0026	32.0	336	0.0840	0.9524
0.0025	32.9524	346	0.0737	0.9524
0.0025	34.0	357	0.0622	0.9524
0.0024	34.9524	367	0.0505	0.9524
0.0024	36.0	378	0.0433	0.9524
0.0023	36.9524	388	0.0400	0.9524
0.0023	38.0	399	0.0386	0.9524
0.0023	38.0952	400	0.0386	0.9524

Framework versions

• Transformers 4.46.3
• Pytorch 2.4.1+cu121
• Datasets 2.20.0
• Tokenizers 0.20.3