samehkhattab/biomed-retrieval-qwen3-0.6b-expert-synthetic-medical-checkpoint

SentenceTransformer based on Qwen/Qwen3-0.6B

This is a sentence-transformers model finetuned from Qwen/Qwen3-0.6B on the biomed_retrieval_synthetic_medical dataset. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: Qwen/Qwen3-0.6B
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 1024 dimensions
• Similarity Function: Cosine Similarity
• Training Dataset:
  • biomed_retrieval_synthetic_medical

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: Qwen3Model 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': True, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Given a question, retrieve Pubmed passages that answer the question: ropivacaine effects on mitochondria',
    'Ropivacaine is one of the commonly used local anesthetics in medical and dental care. However, preclinical and observational studies indicate that ropivacaine could have substantial side effects including neurotoxicity, which has raised concern regarding the safety of this drug. In the present study, we investigated the effects of clinically relevant doses of ropivacaine on mitochondrial biogenesis and function in neuronal cells. Our data indicate that exposure to ropivacaine leads to reduced expression of the major mitochondrial regulator PGC-1 and its downstream transcription factors NRF1 and TFAM. Ropivacaine treatment induces impairment of mitochondrial biogenesis by reducing mitochondrial mass, the ratio of mtDNA to nDNA (mtDNA/nDNA), cytochrome C oxidase activity, and COX-1 expression. Additionally, treatment with ropivacaine causes "loss of mitochondrial function" by impairing the mitochondrial respiratory rate and ATP production. Mechanistically, the reduction of PGC-1 caused by ropivacaine exposure requires inactivation of CREB, while re-introduction of PGC-1 completely rescues ropivacaine-induced mitochondrial abnormalities. In summary, our results provide supporting evidence that mitochondrial impairment is a key event in ropivacaine-mediated neurotoxicity, and the reduction of PGC-1 and its downstream signals are likely the molecular mechanism behind its cellular toxicity.',
    'BACKGROUND: Aberrant mitochondrial function, including excessive reactive oxygen species (ROS) production, has been implicated in the pathogenesis of human diseases. The use of mitochondrial inhibitors to ascertain the sites in the electron transport chain (ETC) resulting in altered ROS production can be an important tool. However, the response of mouse mitochondria to ETC inhibitors has not been thoroughly assessed. Here we set out to characterize the differences in phenotypic response to ETC inhibitors between the more energetically demanding brain mitochondria and less energetically demanding liver mitochondria in commonly utilized C57BL/6J mice.RESULTS: We show that in contrast to brain mitochondria, inhibiting distally within complex I or within complex III does not increase liver mitochondrial ROS production supported by complex I substrates, and liver mitochondrial ROS production supported by complex II substrates occurred primarily independent of membrane potential. Complex I, II, and III enzymatic activities and membrane potential were equivalent between liver and brain and responded to ETC. inhibitors similarly. Brain mitochondria exhibited an approximately two-fold increase in complex I and II supported respiration compared with liver mitochondria while exhibiting similar responses to inhibitors. Elevated NADH transport and heightened complex II-III coupled activity accounted for increased complex I and II supported respiration, respectively in brain mitochondria.CONCLUSIONS: We conclude that important mechanistic differences exist between mouse liver and brain mitochondria and that mouse mitochondria exhibit phenotypic differences compared with mitochondria from other species. AIMS: The aim of this study was to develop a pharmacokinetic model in order to characterize the free and total ropivacaine concentrations after transversus abdominis plane block in a population of patients undergoing liver resection surgery. In particular, we evaluated the impact of the size of liver resection on ropivacaine pharmacokinetics.METHODS: This work is based on a single-centre, double-blinded, randomized, placebo-controlled study. Among the 39 patients included, 19 patients were randomized to the ropivacaine group. The free and total ropivacaine concentrations were measured in nine or 10 blood samples per patient. A pharmacokinetic model was built using a nonlinear mixed-effect modelling approach.RESULTS: The free ropivacaine concentrations remained under the previously published toxic threshold. A one-compartment model, including protein binding site with a first-order absorption, best described the data. The protein binding site concentration was considered as a latent variable. Bodyweight, the number of resected liver segments and postoperative fibrinogen evolution were, respectively, included in the calculation of the volume of distribution, clearance and binding site production rate. The resection of three or more liver segments was associated with a 53% decrease in the free ropivacaine clearance.CONCLUSIONS: Although large liver resections were associated with lower free ropivacaine clearance, the ropivacaine pharmacokinetic profile remained within the safe range after this type of surgery.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Triplet

• Dataset: bmretriever
• Evaluated with TripletEvaluator

Metric	Value
cosine_accuracy	0.997

Training Details

Training Dataset

biomed_retrieval_synthetic_medical

• Dataset: biomed_retrieval_synthetic_medical at fa38d60
• Size: 387,900 training samples
• Columns: anchor, positive, negative, and source
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative	source
  type	string	string	string	string
  details	min: 17 tokens mean: 22.7 tokens max: 50 tokens	min: 43 tokens mean: 314.48 tokens max: 512 tokens	min: 86 tokens mean: 478.98 tokens max: 512 tokens	min: 2 tokens mean: 2.0 tokens max: 2 tokens

• Samples:

  anchor	positive	negative	source
  Given a question, retrieve Pubmed passages that answer the question: median progression free survival of patients with metaplastic breast carcinoma	BACKGROUND: Metaplastic breast carcinoma (MBC) is a rare disease with incidence of less than 1%. MBC present with a larger tumor size, less number of nodes involved, mostly undifferentiated triple negative tumors. We aimed to determine progression-free and overall survival and reported hospital-based incidence of MBC.MATERIAL AND METHODS: A retrospective closed Cohort study elicited data of 42 patients with MBC from January 2008 to December 2013; followed till August 2016. Kaplan-Meier method was applied to compute overall and progression-free survival analysis. Cox Proportional hazard ratios were computed to assess associations between survival and independent variables.RESULTS: Hospital-based incidence of MBC was 1.92% (42/2187), 95% CI [1.41-2.56]. The median age at tumor diagnosis was 54 years (range, 25-81 years). Thirty-nine (92.9%) patients had Grade III tumor. The most common histopathology was squamous (69%). The median tumor size was 4.5 cm (range, 0.8-17 cm). Nineteen (45.2%...	A compariosn was made of survival outcomes of oncoplastic breast conserving therapy (oBCT) with nipple- areolar (NAC) preservation in women with centrally located breast cancer (CLBC) undergoing modified radical mastectomy (MRM) in China in a matched retrospective cohort study. We used a database including patients who received oBCT (n=91) or MRM (n=182) from 2003 to 2013 in our hospital. Matching was conducted according to five variables: age at diagnosis, axillary lymph node status, hormone receptor status, human epidermal growth factor-like receptor 2 status (HER-2) and tumor stage. The match ratio was 1:2. Median follow-up times for the oBCT and MRM groups were 83 and 81 months, respectively. There were no significant differences in 87-month overall, local, or distant recurrence-free survival between patients with oBCT and MRM (89%vs.90%; 93%vs.95%; 91%vs.92%;). For appropriate breast cancer patients, oBCT for CLBC is oncologically safe, oncoplastic techniques improving cosmetic ou...	synthetic
  Given a question, retrieve Pubmed passages that answer the question: what is the effect of acoustic stimulation on the hearing system	The structure and function of the auditory system may be influenced by acoustic stimulation, especially during the early postnatal period. This study explores the effects of an acoustically enriched environment applied during the third and fourth week of life on the responsiveness of inferior colliculus neurons in rats. The enrichment comprised a spectrally and temporally modulated complex sound reinforced with several target acoustic stimuli, one of which triggered a reward release. The exposure permanently influenced neuronal representation of the sound frequency and intensity, resulting in lower excitatory thresholds at neuronal characteristic frequency, an increased frequency selectivity, larger response magnitudes, steeper rate-intensity functions and an increased spontaneous activity. The effect was general and non-specific, spanning the entire hearing range - no changes specific to the frequency band of the target stimuli were found. The alterations depended on the activity of a...	UNLABELLED: Electroacoustic stimulation in subjects with residual hearing is becoming more widely used in clinical practice. However, little is known about the properties of electrically induced responses in the hearing cochlea. In the present study, normal-hearing guinea pig cochleae underwent cochlear implantation through a cochleostomy without significant loss of hearing. Using recordings of unit activity in the midbrain, we were able to investigate the excitation patterns throughout the tonotopic field determined by acoustic stimulation. With the cochlear implant and the midbrain multielectrode arrays left in place, the ears were pharmacologically deafened and electrical stimulation was repeated in the deafened condition. The results demonstrate that, in addition to direct neuronal (electroneuronal) stimulation, in the hearing cochlea excitation of the hair cells occurs ("electrophonic responses") at the cochlear site corresponding to the dominant temporal frequency components of t...	synthetic
  Given a question, retrieve Pubmed passages that answer the question: can women with cervical dysplasia start e-cigarettes	The aim of this study was to determine if 31 women with cervical dysplasia and associated conditions exacerbated by smoking would be successful substituting cigarettes with their choice of either nicotine replacement therapy (NRT) or electronic cigarettes (EC). Women received motivational interviewing and tried both NRT and ECs, choosing one method to use during a six-week intervention period. Daily cigarette consumption was measured at baseline, six, and 12 weeks, with differences analyzed by the Wilcoxon signed-rank test. Study analysis consisted only of women choosing to use ECs (29/31), as only two chose NRT. At the 12-week follow-up, the seven day point prevalence abstinence from smoking was 28.6%, and the median number of cigarettes smoked daily decreased from 18.5 to 5.5 (p < 0.0001). The median number of e-cigarette cartridges used dropped from 21 at the six-week follow-up to 12.5 at the 12-week follow-up. After initiating EC use, women at risk for cervical cancer were able to ...	e-Cigarettes have gained worldwide popularity as a substitute for smoking, but concern has been raised regarding the long-term effects associated with their use. We report a case of a 45-year-old female consumer of e-cigarettes who presented with 4 months of abdominal pain and fever. Initial imaging discovered multiple pulmonary nodules and liver lesions suspicious of widespread metastases; however, an extensive evaluation found no evidence of malignancy. Results of a lung biopsy revealed an area with multinucleated giant cells suggestive of a foreign body reaction to a lipophilic material. Upon cessation of e-cigarette use (known as vaping), the lung nodules disappeared, and the liver lesions regressed. Our case report suggests that vaping can induce an inflammatory reaction mimicking metastatic cancer. The complex interplay between HIV and human papillomavirus and its link to cervical dysplasia is poorly understood. This is the first study to assess the prevalence of oncogenic human ...	synthetic

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Evaluation Dataset

biomed_retrieval_synthetic_medical

• Dataset: biomed_retrieval_synthetic_medical at fa38d60
• Size: 21,550 evaluation samples
• Columns: anchor, positive, negative, and source
• Approximate statistics based on the first 1000 samples:

  	anchor	positive	negative	source
  type	string	string	string	string
  details	min: 17 tokens mean: 22.88 tokens max: 54 tokens	min: 53 tokens mean: 306.3 tokens max: 512 tokens	min: 80 tokens mean: 477.87 tokens max: 512 tokens	min: 2 tokens mean: 2.0 tokens max: 2 tokens

• Samples:

  anchor	positive	negative	source
  Given a question, retrieve Pubmed passages that answer the question: which protein is cleaved during podocytes?	Regulated intracellular proteostasis, controlled in part by proteolysis, is essential in maintaining the integrity of podocytes and the glomerular filtration barrier of the kidney. We applied a novel proteomics technology that enables proteome-wide identification, mapping, and quantification of protein N-termini to comprehensively characterize cleaved podocyte proteins in the glomerulus in vivo We found evidence that defined proteolytic cleavage results in various proteoforms of important podocyte proteins, including those of podocin, nephrin, neph1, -actinin-4, and vimentin. Quantitative mapping of N-termini demonstrated perturbation of protease action during podocyte injury in vitro, including diminished proteolysis of -actinin-4. Differentially regulated protease substrates comprised cytoskeletal proteins as well as intermediate filaments. Determination of preferential protease motifs during podocyte damage indicated activation of caspase proteases and inhibition of arginine-specifi...	Scaffolding proteins play pivotal roles in the assembly of macromolecular machines such as the spliceosome. The adaptor protein CD2BP2, originally identified as a binding partner of the adhesion molecule CD2, is a pre-spliceosomal assembly factor that utilizes its glycine-tyrosine-phenylalanine (GYF) domain to co-localize with spliceosomal proteins. So far, its function in vertebrates is unknown. Using conditional gene targeting in mice, we show that CD2BP2 is crucial for embryogenesis, leading to growth retardation, defects in vascularization, and premature death at embryonic day 10.5 when absent. Ablation of the protein in bone marrow-derived macrophages indicates that CD2BP2 is involved in the alternative splicing of mRNA transcripts from diverse origins. At the molecular level, we identified the phosphatase PP1 to be recruited to the spliceosome via the N-terminus of CD2BP2. Given the strong expression of CD2BP2 in podocytes of the kidney, we use selective depletion of CD2BP2, in c...	synthetic
  Given a question, retrieve Pubmed passages that answer the question: what is a relive	INTRODUCTION: Relive is a serious game focusing on increasing kids and young adults' awareness on CPR. We evaluated the use of Relive on schoolchildren.METHODS: A longitudinal, prospective study was carried out in two high schools in Italy over a 8-month period, divided in three phases: baseline, competition, and retention. Improvement in schoolchildren's CPR awareness, in terms of knowledge (MCQ results) and skills (chest compression (CC) rate and depth), was evaluated. Usability of Relive and differences in CC performance according to sex and BMI class were also evaluated.RESULTS: At baseline, students performed CC with a mean depth of 31mm and a rate of 95 cpm. In the competition phase, students performed CC with a mean depth of 46mm and a rate of 111 cpm. In the retention phase, students performed CC with a mean depth of 47mm and a rate of 131 cpm. Thus, the training session with Relive during the competition phase affected positively both CC depth (p<0.001) and rate (p<0.001). Suc...	A patient retraces her care pathway with authenticity and emotion. Whileher memories of her time in hospital are still raw, her path towards recovery was built on constructive stages and encounters, from one structure to another, towards refound freedom. Aninterview with Marie-Paule Chanel. Memory reprocessing following acquisition enhances memory consolidation. Specifically, neural activity during encoding is thought to be 'replayed' during subsequent slow-wave sleep. Such memory replay is thought to contribute to the functional reorganization of neural memory traces. In particular, memory replay may facilitate the exchange of information across brain regions by inducing a reconfiguration of connectivity across the brain. Memory reactivation can be induced by external cues through a procedure known as "targeted memory reactivation". Here, we analysed data from a published study with auditory cues used to reactivate visual object-location memories during slow-wave sleep. We characteriz...	synthetic
  Given a question, retrieve Pubmed passages that answer the question: effects of emulsion gels in frankfurter formulation	Emulsion gels prepared with olive oil, chia, and cold gelling agents (transglutaminase, alginate, or gelatin) were used as fat replacers in reduced-fat frankfurter formulation. Nutritional advantages, sensory analysis, technological properties, and microbiological populations of frankfurters were evaluated along with their lipid structural characteristics over chilled storage. Frankfurters with emulsion gels showed significant improvements in fat content (lower saturated fatty acid, higher mono- and polyunsaturated fatty acid contents) and had good fat and water-binding properties. The presence of an emulsion gel reduced lightness and redness, but increased yellowness. Textural behavior of samples was significantly affected by the presence of emulsion gels and by storage. Sensory properties were not affected by the incorporation of emulsion gels, and all frankfurters were judged acceptable. Attenuated total reflectance-Fourier transform infrared spectroscopy results showed that samples...	High internal phase emulsions (HIPE) prepared using whey protein microgels (WPMs) as a surfactant were demonstrated to have substantially higher stability than HIPEs prepared using similar loadings of non-gelled whey protein isolate (WPI) or Tween 20. Microgel colloids were prepared from WPI solutions by heat treatment at 85 C in a narrow pH range (5.8-6.0) to particle sizes of approximately 90, 160 and 350 nm in diameter. -potentials of the WPM increased in negativity with decreasing particle size from -7.4 2.5 down to -21.1 0.9 at 90 nm. All WPMs conferred high stability to corn oil based HIPE when used as an emulsifier. Light microscopy and cryo-scanning electron microscopy showed that both increasing WPM concentration and decreasing WPM particle size produced increasingly smaller and more hexagonally shaped corn oil emulsion droplets; WPI and Tween 20 based HIPE droplets were generally smaller and spherical in shape. The HIPE (75% w/w corn oil) produced with 1% (w/w) WPM as an em...	synthetic

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 256
• per_device_eval_batch_size: 256
• num_train_epochs: 1
• warmup_steps: 100
• bf16: True
• dataloader_drop_last: True
• optim: adamw_bnb_8bit
• ddp_find_unused_parameters: False
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: {'use_reentrant': False}
• use_liger_kernel: True

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 256
• per_device_eval_batch_size: 256
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 100
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• bf16: True
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: True
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• parallelism_config: None
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_bnb_8bit
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• project: huggingface
• trackio_space_id: trackio
• ddp_find_unused_parameters: False
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: None
• hub_always_push: False
• hub_revision: None
• gradient_checkpointing: True
• gradient_checkpointing_kwargs: {'use_reentrant': False}
• include_inputs_for_metrics: False
• include_for_metrics: []
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: no
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: True
• liger_kernel_config: None
• eval_use_gather_object: False
• average_tokens_across_devices: True
• prompts: None
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	Validation Loss	bmretriever_cosine_accuracy
0.0330	50	4.8069	-	-
0.0660	100	0.1822	-	-
0.0990	150	0.0506	-	-
0.1320	200	0.0368	-	-
0.1650	250	0.0283	-	-
0.1980	300	0.0264	-	-
0.2310	350	0.0239	-	-
0.2640	400	0.0233	-	-
0.2970	450	0.0209	-	-
0.3300	500	0.0218	-	-
0.3630	550	0.021	-	-
0.3960	600	0.0193	-	-
0.4290	650	0.0184	-	-
0.4620	700	0.0184	-	-
0.4950	750	0.0186	-	-
0.5281	800	0.0179	-	-
0.5611	850	0.016	-	-
0.5941	900	0.0167	-	-
0.6271	950	0.0159	-	-
0.6601	1000	0.0167	-	-
0.6931	1050	0.0149	-	-
0.7261	1100	0.0147	-	-
0.7591	1150	0.0157	-	-
0.7921	1200	0.0145	-	-
0.8251	1250	0.0139	-	-
0.8581	1300	0.0138	-	-
0.8911	1350	0.0141	-	-
0.9241	1400	0.014	-	-
0.9571	1450	0.0139	-	-
0.9901	1500	0.0135	-	-
1.0	1515	-	0.0129	0.9970

Framework Versions

• Python: 3.11.9
• Sentence Transformers: 4.1.0
• Transformers: 4.57.1
• PyTorch: 2.6.0+cu124
• Accelerate: 1.6.0
• Datasets: 2.21.0
• Tokenizers: 0.22.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}