--- tags: - sentence-transformers - sentence-similarity - feature-extraction - dense - generated_from_trainer - dataset_size:20000 - loss:MultipleNegativesRankingLoss base_model: google/embeddinggemma-300m widget: - source_sentence: Is radiological glenoid wear always associated with poor clinical results after humeral head replacement? sentences: - Patient-centred care in healthcare systems includes understanding the patient's treatment needs, experiences, satisfaction, and perceived overall quality of healthcare. In orthodontic treatment, patient-centred care involves considering the patient's oral health-related quality of life (OHRQoL) and self-esteem. It is important in orthodontics because it allows for a better understanding of the patient's perceived benefits and health gains associated with orthodontic therapy. - Radiological glenoid wear may be present after humeral head replacement, but it is not always associated with poor clinical results. Some patients may show signs of glenoid erosion on radiographic imaging while experiencing satisfactory clinical results. - The potential risks associated with intraoperative skull-femoral traction during scoliosis surgery include stretching of the vascular supply, which can lead to spinal cord ischemia and subsequent neurological injury. The spinal motor system is particularly vulnerable to ischemic insult caused by the application of corrective forces on the spine. - source_sentence: 'What are the treatment options for heterotopic mesenteric ossification (HMO)? ' sentences: - The recommended approach for managing orthopaedic infections associated with bone prostheses typically involves a two-stage surgery. This approach involves the removal of infected prostheses, eradication of causative pathogens, and subsequent replacement of devices. In addition to surgery, intracellular antimicrobials may be used to target bacteria that may be harbored within periprosthetic fibroblasts. This approach aims to prevent relapse and reduce the risk of infection recurrence. - The ligamentous support of the CMC joint, particularly the dorsoradial ligament (DRL), can make standard dorsal portals difficult to manipulate and stretch during surgery. This may increase the risk of nerve damage, as the standard dorsal portal includes a thin subcutaneous layer with a sensory nerve. In contrast, the TP is fashioned through the superficial anterior oblique ligament (SAOL) or radial capsule, which allows for easier manipulation and potentially reduces the risk of nerve damage. - The treatment of HMO can be either medical or surgical, depending on the patient's clinical condition and the extent of ossification. Nonsteroidal anti-inflammatory drugs and cimetidine have been reported to prevent the recurrence of ossification. Surgical therapy is reserved for patients experiencing bowel obstruction symptoms, while asymptomatic patients are observed with radiological examinations for progression of the disease. In the case described, the ossificated formations found in the mesocolon and the abdominal trauma were excised, while closure of Hartman's colostomy was avoided due to the presence of bone tissue in the sigmoid stump. - source_sentence: 'What factors are associated with better outcomes in the treatment of septic arthritis using arthroscopic drainage and debridement? ' sentences: - Developmental dysplasia of the hip (DDH) encompasses a spectrum of abnormalities affecting the hip joint, including dysplasia, subluxation, and dislocation. Hip dysplasia refers to abnormalities in the structure of the femoral head, acetabulum, or both. The acetabulum may be shallow, and the femoral head ossification may be delayed or altered. There are various classifications of hip abnormalities in DDH, including located/reduced hip (femoral head within the acetabulum), subluxated hip (femoral head partially out of the acetabulum), and dislocated hip (femoral head outside of the acetabulum). These classifications can further be described as subluxatable (femoral head can be partially displaced from the acetabulum) or dislocatable (femoral head can be completely displaced from the acetabulum), and dislocated hips can be reducible (femoral head goes back into the acetabulum with manipulation) or irreducible (femoral head cannot go back into the acetabulum). The development of the hip joint relies on proper positioning of the hip for the acetabulum and proximal femur to develop normally. - The fulfillment of expectations is a distinct outcome measure in spine surgery that differs from other global measures in several ways. Firstly, it includes both preoperative and postoperative perspectives, whereas other global measures only focus on the postoperative state. Secondly, the fulfillment of expectations is determined from prospectively gathered information, eliminating the reliance on patients' recall. Thirdly, it provides a detailed understanding of which symptoms and functions have improved to target levels and which have not, allowing for a rationale behind patients' rating of outcomes. Lastly, surgeons can use this information to address specific concerns of patients during postoperative discussions. - Factors associated with better outcomes in the treatment of septic arthritis using arthroscopic drainage and debridement include early diagnosis and treatment, proper joint drainage, appropriate systemic and oral antibiotics, and early rehabilitation. Other studies have also reported a positive correlation between lower Gachter stage and good to excellent functional results. The time interval between onset of symptoms and drainage also bears prognostic correlation on long-term results, with better outcomes observed in those drained within 12 days of symptom onset. - source_sentence: 'What are the selection criteria for using the Ilizarov technique in treating distal tibial fractures? ' sentences: - Trunk stabilization exercises are an important component of rehabilitation training as they re-educate the trunk muscles for proper activation and coordination, leading to improved vertebral stability. These exercises also help maintain spinal alignment, provide motion control for functional activity, and are widely used to prevent and treat back pain. - The selection criteria for using the Ilizarov technique in treating distal tibial fractures include patients aged 18-75 years with displaced distal metaphyseal tibial fractures with an angulation of more than 10 degrees in any plane. Intra-articular fractures are included if the incongruence of the articular surface is more than 2 mm. Only patients with isolated fractures, without other disorders affecting gait, who are able to understand and follow instructions in Swedish, are enrolled in the treatment. - Hindfoot deformities can be caused by various factors, including involvement of the talonavicular and naviculocuneiform joints, which can lead to pes planus and a valgus deformity of the hindfoot. Insufficient or damaged tibialis posterior tendon, dysfunction of the capsule, and weakening of collateral ligaments (deltoid, calcaneonavicular, talonavicular) can also contribute to the collapse of the longitudinal arch and the development of pes planovalgus. - source_sentence: 'How can the combination of distraction osteogenesis and osteotomy be beneficial in managing cases of vertical alveolar bone deficiencies? ' sentences: - Dry needling, which involves the insertion of a solid needle into the skin to regulate trigger points within the musculature, may serve as an effective therapeutic adjunct for patients with ankle instability. It is believed to reduce motor disturbances in the musculature and accelerate muscle fatigability. Studies have shown that inclusion of dry needling in active patients with ankle instability secondary to injury led to better outcomes in pain and function. However, further investigation is needed to determine the efficacy of dry needling in improving functional outcomes and return to play specifically in American football athletes. - The bracing phase of the Ponseti method lasts for four to five years and can be challenging for the child, the family, and the healthcare team. It requires consistent adherence to wearing the brace for long periods of time, which can be difficult for some families. Additionally, the cost of modern clubfoot braces can be prohibitive for many patients, particularly in developing countries. - The combination of distraction osteogenesis and osteotomy can be beneficial in managing cases of vertical alveolar bone deficiencies. In some cases, if the distraction process alone does not achieve the desired outcome, an osteotomy can be performed to further advance the affected segment. This combined approach allows for improved soft tissue gain and surgical advancement, which may not be achievable with osteotomy alone. pipeline_tag: sentence-similarity library_name: sentence-transformers --- # SentenceTransformer based on google/embeddinggemma-300m This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [google/embeddinggemma-300m](https://huggingface.co/google/embeddinggemma-300m). It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more. ## Model Details ### Model Description - **Model Type:** Sentence Transformer - **Base model:** [google/embeddinggemma-300m](https://huggingface.co/google/embeddinggemma-300m) - **Maximum Sequence Length:** 2048 tokens - **Output Dimensionality:** 768 dimensions - **Similarity Function:** Cosine Similarity ### Model Sources - **Documentation:** [Sentence Transformers Documentation](https://sbert.net) - **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers) - **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers) ### Full Model Architecture ``` SentenceTransformer( (0): Transformer({'max_seq_length': 2048, 'do_lower_case': False, 'architecture': 'Gemma3TextModel'}) (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) (2): Dense({'in_features': 768, 'out_features': 3072, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'}) (3): Dense({'in_features': 3072, 'out_features': 768, 'bias': False, 'activation_function': 'torch.nn.modules.linear.Identity'}) (4): Normalize() ) ``` ## Usage ### Direct Usage (Sentence Transformers) First install the Sentence Transformers library: ```bash pip install -U sentence-transformers ``` Then you can load this model and run inference. ```python from sentence_transformers import SentenceTransformer # Download from the 🤗 Hub model = SentenceTransformer("yasserrmd/ortho-gemma-300m-emb") # Run inference queries = [ "How can the combination of distraction osteogenesis and osteotomy be beneficial in managing cases of vertical alveolar bone deficiencies?\n", ] documents = [ 'The combination of distraction osteogenesis and osteotomy can be beneficial in managing cases of vertical alveolar bone deficiencies. In some cases, if the distraction process alone does not achieve the desired outcome, an osteotomy can be performed to further advance the affected segment. This combined approach allows for improved soft tissue gain and surgical advancement, which may not be achievable with osteotomy alone.', 'The bracing phase of the Ponseti method lasts for four to five years and can be challenging for the child, the family, and the healthcare team. It requires consistent adherence to wearing the brace for long periods of time, which can be difficult for some families. Additionally, the cost of modern clubfoot braces can be prohibitive for many patients, particularly in developing countries.', 'Dry needling, which involves the insertion of a solid needle into the skin to regulate trigger points within the musculature, may serve as an effective therapeutic adjunct for patients with ankle instability. It is believed to reduce motor disturbances in the musculature and accelerate muscle fatigability. Studies have shown that inclusion of dry needling in active patients with ankle instability secondary to injury led to better outcomes in pain and function. However, further investigation is needed to determine the efficacy of dry needling in improving functional outcomes and return to play specifically in American football athletes.', ] query_embeddings = model.encode_query(queries) document_embeddings = model.encode_document(documents) print(query_embeddings.shape, document_embeddings.shape) # [1, 768] [3, 768] # Get the similarity scores for the embeddings similarities = model.similarity(query_embeddings, document_embeddings) print(similarities) # tensor([[0.7862, 0.0777, 0.1950]]) ``` ## Training Details ### Training Dataset #### Unnamed Dataset * Size: 20,000 training samples * Columns: sentence_0 and sentence_1 * Approximate statistics based on the first 1000 samples: | | sentence_0 | sentence_1 | |:--------|:-----------------------------------------------------------------------------------|:------------------------------------------------------------------------------------| | type | string | string | | details | | | * Samples: | sentence_0 | sentence_1 | |:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| | What are some barriers and facilitators associated with the use and prescription of non-surgical treatments for knee or hip osteoarthritis in orthopaedic practice?
 | Barriers and facilitators associated with the use and prescription of non-surgical treatments for knee or hip osteoarthritis in orthopaedic practice may exist at various levels, including the professional, patient, social context, organizational context, and external environment. Some potential barriers may include lack of awareness or knowledge about non-surgical treatment options, time constraints, financial considerations, and patient preferences. Facilitators may include access to resources and support, clear guidelines and protocols, effective communication between healthcare professionals and patients, and a collaborative approach to decision-making. | | What are the different names used to refer to bipolar fracture dislocations of the clavicle?
 | Bipolar fracture dislocations of the clavicle are also known as complete dislocation, bipolar dislocation, panclavicular dislocation, bifocal clavicular dislocation, and traumatic floating clavicle. | | What is the association between returning to pivoting sports and the development of osteoarthritis after ACL reconstruction surgery?
 | Recent research has shown that patients who have returned to pivoting sports after ACL reconstruction surgery have a reduced risk of developing symptomatic and radiographic osteoarthritis compared to those who have not returned to pivoting sports. However, the reasons for this difference are unclear, and it is important to note that patients who failed to return to pivoting sports also reported poor knee function, which may have influenced the results. The rates of osteoarthritis after ACL reconstruction surgery increase over time, with higher rates observed with longer time intervals from injury to surgery. The role of activity in the development of osteoarthritis after ACL reconstruction surgery has not been thoroughly evaluated. | * Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters: ```json { "scale": 20.0, "similarity_fct": "cos_sim", "gather_across_devices": false } ``` ### Training Hyperparameters #### Non-Default Hyperparameters - `per_device_train_batch_size`: 6 - `per_device_eval_batch_size`: 6 - `num_train_epochs`: 1 - `multi_dataset_batch_sampler`: round_robin #### All Hyperparameters
Click to expand - `overwrite_output_dir`: False - `do_predict`: False - `eval_strategy`: no - `prediction_loss_only`: True - `per_device_train_batch_size`: 6 - `per_device_eval_batch_size`: 6 - `per_gpu_train_batch_size`: None - `per_gpu_eval_batch_size`: None - `gradient_accumulation_steps`: 1 - `eval_accumulation_steps`: None - `torch_empty_cache_steps`: None - `learning_rate`: 5e-05 - `weight_decay`: 0.0 - `adam_beta1`: 0.9 - `adam_beta2`: 0.999 - `adam_epsilon`: 1e-08 - `max_grad_norm`: 1 - `num_train_epochs`: 1 - `max_steps`: -1 - `lr_scheduler_type`: linear - `lr_scheduler_kwargs`: {} - `warmup_ratio`: 0.0 - `warmup_steps`: 0 - `log_level`: passive - `log_level_replica`: warning - `log_on_each_node`: True - `logging_nan_inf_filter`: True - `save_safetensors`: True - `save_on_each_node`: False - `save_only_model`: False - `restore_callback_states_from_checkpoint`: False - `no_cuda`: False - `use_cpu`: False - `use_mps_device`: False - `seed`: 42 - `data_seed`: None - `jit_mode_eval`: False - `use_ipex`: False - `bf16`: False - `fp16`: False - `fp16_opt_level`: O1 - `half_precision_backend`: auto - `bf16_full_eval`: False - `fp16_full_eval`: False - `tf32`: None - `local_rank`: 0 - `ddp_backend`: None - `tpu_num_cores`: None - `tpu_metrics_debug`: False - `debug`: [] - `dataloader_drop_last`: False - `dataloader_num_workers`: 0 - `dataloader_prefetch_factor`: None - `past_index`: -1 - `disable_tqdm`: False - `remove_unused_columns`: True - `label_names`: None - `load_best_model_at_end`: False - `ignore_data_skip`: False - `fsdp`: [] - `fsdp_min_num_params`: 0 - `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False} - `fsdp_transformer_layer_cls_to_wrap`: None - `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None} - `parallelism_config`: None - `deepspeed`: None - `label_smoothing_factor`: 0.0 - `optim`: adamw_torch_fused - `optim_args`: None - `adafactor`: False - `group_by_length`: False - `length_column_name`: length - `ddp_find_unused_parameters`: None - `ddp_bucket_cap_mb`: None - `ddp_broadcast_buffers`: False - `dataloader_pin_memory`: True - `dataloader_persistent_workers`: False - `skip_memory_metrics`: True - `use_legacy_prediction_loop`: False - `push_to_hub`: False - `resume_from_checkpoint`: None - `hub_model_id`: None - `hub_strategy`: every_save - `hub_private_repo`: None - `hub_always_push`: False - `hub_revision`: None - `gradient_checkpointing`: False - `gradient_checkpointing_kwargs`: None - `include_inputs_for_metrics`: False - `include_for_metrics`: [] - `eval_do_concat_batches`: True - `fp16_backend`: auto - `push_to_hub_model_id`: None - `push_to_hub_organization`: None - `mp_parameters`: - `auto_find_batch_size`: False - `full_determinism`: False - `torchdynamo`: None - `ray_scope`: last - `ddp_timeout`: 1800 - `torch_compile`: False - `torch_compile_backend`: None - `torch_compile_mode`: None - `include_tokens_per_second`: False - `include_num_input_tokens_seen`: False - `neftune_noise_alpha`: None - `optim_target_modules`: None - `batch_eval_metrics`: False - `eval_on_start`: False - `use_liger_kernel`: False - `liger_kernel_config`: None - `eval_use_gather_object`: False - `average_tokens_across_devices`: False - `prompts`: None - `batch_sampler`: batch_sampler - `multi_dataset_batch_sampler`: round_robin - `router_mapping`: {} - `learning_rate_mapping`: {}
### Training Logs | Epoch | Step | Training Loss | |:------:|:----:|:-------------:| | 0.1500 | 500 | 0.0309 | | 0.2999 | 1000 | 0.0107 | | 0.4499 | 1500 | 0.0078 | | 0.5999 | 2000 | 0.0081 | | 0.7499 | 2500 | 0.0017 | | 0.8998 | 3000 | 0.0018 | ### Framework Versions - Python: 3.12.11 - Sentence Transformers: 5.1.0 - Transformers: 4.56.2 - PyTorch: 2.8.0+cu128 - Accelerate: 1.10.1 - Datasets: 4.0.0 - Tokenizers: 0.22.1 ## Citation ### BibTeX #### Sentence Transformers ```bibtex @inproceedings{reimers-2019-sentence-bert, title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks", author = "Reimers, Nils and Gurevych, Iryna", booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing", month = "11", year = "2019", publisher = "Association for Computational Linguistics", url = "https://arxiv.org/abs/1908.10084", } ``` #### MultipleNegativesRankingLoss ```bibtex @misc{henderson2017efficient, title={Efficient Natural Language Response Suggestion for Smart Reply}, author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil}, year={2017}, eprint={1705.00652}, archivePrefix={arXiv}, primaryClass={cs.CL} } ```