| [2024-11-26 15:48:28,648] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| [2024-11-26 15:48:30,621] [WARNING] [runner.py:215:fetch_hostfile] Unable to find hostfile, will proceed with training with local resources only. | |
| [2024-11-26 15:48:30,621] [INFO] [runner.py:607:main] cmd = /scratch/huijaean/storage/miniconda3/envs/dpspd/bin/python -u -m deepspeed.launcher.launch --world_info=eyJsb2NhbGhvc3QiOiBbMCwgMSwgMiwgM119 --master_addr=127.0.0.1 --master_port=29500 --enable_each_rank_log=None main.py --data_path local/jsonfile --data_split 10,0,0 --data_output_path /scratch/huijaean/garbage --model_name_or_path meta-llama/CodeLlama-7b-Instruct-hf --per_device_train_batch_size 8 --per_device_eval_batch_size 8 --max_seq_len 512 --learning_rate 5e-5 --num_train_epochs 1 --gradient_accumulation_steps 32 --lr_scheduler_type cosine --num_warmup_steps 0 --seed 1234 --gradient_checkpointing --dtype bf16 --zero_stage 3 --deepspeed --lora_dim 32 --lora_module_name layers. --output_dir ./output_codellama_7b_lora_bf16 | |
| [2024-11-26 15:48:32,084] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| [2024-11-26 15:48:34,068] [INFO] [launch.py:146:main] WORLD INFO DICT: {'localhost': [0, 1, 2, 3]} | |
| [2024-11-26 15:48:34,068] [INFO] [launch.py:152:main] nnodes=1, num_local_procs=4, node_rank=0 | |
| [2024-11-26 15:48:34,068] [INFO] [launch.py:163:main] global_rank_mapping=defaultdict(<class 'list'>, {'localhost': [0, 1, 2, 3]}) | |
| [2024-11-26 15:48:34,068] [INFO] [launch.py:164:main] dist_world_size=4 | |
| [2024-11-26 15:48:34,068] [INFO] [launch.py:168:main] Setting CUDA_VISIBLE_DEVICES=0,1,2,3 | |
| [2024-11-26 15:48:34,069] [INFO] [launch.py:256:main] process 2980792 spawned with command: ['/scratch/huijaean/storage/miniconda3/envs/dpspd/bin/python', '-u', 'main.py', '--local_rank=0', '--data_path', 'local/jsonfile', '--data_split', '10,0,0', '--data_output_path', '/scratch/huijaean/garbage', '--model_name_or_path', 'meta-llama/CodeLlama-7b-Instruct-hf', '--per_device_train_batch_size', '8', '--per_device_eval_batch_size', '8', '--max_seq_len', '512', '--learning_rate', '5e-5', '--num_train_epochs', '1', '--gradient_accumulation_steps', '32', '--lr_scheduler_type', 'cosine', '--num_warmup_steps', '0', '--seed', '1234', '--gradient_checkpointing', '--dtype', 'bf16', '--zero_stage', '3', '--deepspeed', '--lora_dim', '32', '--lora_module_name', 'layers.', '--output_dir', './output_codellama_7b_lora_bf16'] | |
| [2024-11-26 15:48:34,069] [INFO] [launch.py:256:main] process 2980793 spawned with command: ['/scratch/huijaean/storage/miniconda3/envs/dpspd/bin/python', '-u', 'main.py', '--local_rank=1', '--data_path', 'local/jsonfile', '--data_split', '10,0,0', '--data_output_path', '/scratch/huijaean/garbage', '--model_name_or_path', 'meta-llama/CodeLlama-7b-Instruct-hf', '--per_device_train_batch_size', '8', '--per_device_eval_batch_size', '8', '--max_seq_len', '512', '--learning_rate', '5e-5', '--num_train_epochs', '1', '--gradient_accumulation_steps', '32', '--lr_scheduler_type', 'cosine', '--num_warmup_steps', '0', '--seed', '1234', '--gradient_checkpointing', '--dtype', 'bf16', '--zero_stage', '3', '--deepspeed', '--lora_dim', '32', '--lora_module_name', 'layers.', '--output_dir', './output_codellama_7b_lora_bf16'] | |
| [2024-11-26 15:48:34,070] [INFO] [launch.py:256:main] process 2980794 spawned with command: ['/scratch/huijaean/storage/miniconda3/envs/dpspd/bin/python', '-u', 'main.py', '--local_rank=2', '--data_path', 'local/jsonfile', '--data_split', '10,0,0', '--data_output_path', '/scratch/huijaean/garbage', '--model_name_or_path', 'meta-llama/CodeLlama-7b-Instruct-hf', '--per_device_train_batch_size', '8', '--per_device_eval_batch_size', '8', '--max_seq_len', '512', '--learning_rate', '5e-5', '--num_train_epochs', '1', '--gradient_accumulation_steps', '32', '--lr_scheduler_type', 'cosine', '--num_warmup_steps', '0', '--seed', '1234', '--gradient_checkpointing', '--dtype', 'bf16', '--zero_stage', '3', '--deepspeed', '--lora_dim', '32', '--lora_module_name', 'layers.', '--output_dir', './output_codellama_7b_lora_bf16'] | |
| [2024-11-26 15:48:34,070] [INFO] [launch.py:256:main] process 2980795 spawned with command: ['/scratch/huijaean/storage/miniconda3/envs/dpspd/bin/python', '-u', 'main.py', '--local_rank=3', '--data_path', 'local/jsonfile', '--data_split', '10,0,0', '--data_output_path', '/scratch/huijaean/garbage', '--model_name_or_path', 'meta-llama/CodeLlama-7b-Instruct-hf', '--per_device_train_batch_size', '8', '--per_device_eval_batch_size', '8', '--max_seq_len', '512', '--learning_rate', '5e-5', '--num_train_epochs', '1', '--gradient_accumulation_steps', '32', '--lr_scheduler_type', 'cosine', '--num_warmup_steps', '0', '--seed', '1234', '--gradient_checkpointing', '--dtype', 'bf16', '--zero_stage', '3', '--deepspeed', '--lora_dim', '32', '--lora_module_name', 'layers.', '--output_dir', './output_codellama_7b_lora_bf16'] | |
| [2024-11-26 15:48:36,148] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2024-11-26 15:48:36,242] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2024-11-26 15:48:36,244] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| [2024-11-26 15:48:36,338] [INFO] [real_accelerator.py:219:get_accelerator] Setting ds_accelerator to cuda (auto detect) | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| Warning: The cache directory for DeepSpeed Triton autotune, /home/eecs/huijae.an/.triton/autotune, appears to be on an NFS system. While this is generally acceptable, if you experience slowdowns or hanging when DeepSpeed exits, it is recommended to set the TRITON_CACHE_DIR environment variable to a non-NFS path. | |
| [2024-11-26 15:48:38,643] [INFO] [comm.py:652:init_distributed] cdb=None | |
| [2024-11-26 15:48:38,822] [INFO] [comm.py:652:init_distributed] cdb=None | |
| [2024-11-26 15:48:38,822] [INFO] [comm.py:683:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl | |
| [2024-11-26 15:48:38,869] [INFO] [comm.py:652:init_distributed] cdb=None | |
| [2024-11-26 15:48:38,873] [INFO] [comm.py:652:init_distributed] cdb=None | |
| [2024-11-26 15:48:40,682] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| [2024-11-26 15:48:40,683] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| [2024-11-26 15:48:40,697] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| [2024-11-26 15:48:40,739] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| [2024-11-26 15:48:41,129] [INFO] [partition_parameters.py:348:__exit__] finished initializing model - num_params = 291, num_elems = 6.74B | |
| Creating prompt dataset ['local/jsonfile'], reload=False | |
| Creating dataset jsonfile for train_phase=1 size=53606 | |
| Creating dataset jsonfile for train_phase=1 size=100 | |
| Finished creating prompt dataset | |
| ninja: no work to do. | |
| Time to load fused_adam op: 0.11464405059814453 seconds | |
| [2024-11-26 15:51:01,951] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| Finished creating prompt dataset | |
| Finished creating prompt dataset | |
| ninja: no work to do. | |
| Time to load fused_adam op: 0.11395597457885742 seconds | |
| [2024-11-26 15:51:02,451] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| Time to load fused_adam op: 0.10174870491027832 seconds | |
| [2024-11-26 15:51:02,506] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| Finished creating prompt dataset | |
| ninja: no work to do. | |
| Time to load fused_adam op: 0.11098146438598633 seconds | |
| [2024-11-26 15:51:03,632] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed info: version=0.15.4, git-hash=unknown, git-branch=unknown | |
| [2024-11-26 15:51:03,633] [INFO] [comm.py:677:init_distributed] Distributed backend already initialized | |
| [2024-11-26 15:51:03,633] [INFO] [config.py:733:__init__] Config mesh_device None world_size = 4 | |
| [2024-11-26 15:51:04,149] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False | |
| [2024-11-26 15:51:04,151] [INFO] [logging.py:128:log_dist] [Rank 0] Using client Optimizer as basic optimizer | |
| [2024-11-26 15:51:04,151] [INFO] [logging.py:128:log_dist] [Rank 0] Removing param_group that has no 'params' in the basic Optimizer | |
| [2024-11-26 15:51:04,192] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Basic Optimizer = FusedAdam | |
| [2024-11-26 15:51:04,193] [INFO] [utils.py:59:is_zero_supported_optimizer] Checking ZeRO support for optimizer=FusedAdam type=<class 'deepspeed.ops.adam.fused_adam.FusedAdam'> | |
| [2024-11-26 15:51:04,193] [INFO] [logging.py:128:log_dist] [Rank 0] Creating fp16 ZeRO stage 3 optimizer, MiCS is enabled False, Hierarchical params gather False | |
| [2024-11-26 15:51:04,193] [INFO] [logging.py:128:log_dist] [Rank 0] Creating torch.bfloat16 ZeRO stage 3 optimizer | |
| [2024-11-26 15:51:04,835] [INFO] [utils.py:781:see_memory_usage] Stage 3 initialize beginning | |
| [2024-11-26 15:51:04,836] [INFO] [utils.py:782:see_memory_usage] MA 3.91 GB Max_MA 4.62 GB CA 5.07 GB Max_CA 5 GB | |
| [2024-11-26 15:51:04,837] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:04,839] [INFO] [stage3.py:166:__init__] Reduce bucket size 500000000 | |
| [2024-11-26 15:51:04,839] [INFO] [stage3.py:167:__init__] Prefetch bucket size 30000000 | |
| [2024-11-26 15:51:05,425] [INFO] [utils.py:781:see_memory_usage] DeepSpeedZeRoOffload initialize [begin] | |
| [2024-11-26 15:51:05,426] [INFO] [utils.py:782:see_memory_usage] MA 3.91 GB Max_MA 3.91 GB CA 5.07 GB Max_CA 5 GB | |
| [2024-11-26 15:51:05,426] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| Parameter Offload: Total persistent parameters: 266240 in 65 params | |
| [2024-11-26 15:51:06,198] [INFO] [utils.py:781:see_memory_usage] DeepSpeedZeRoOffload initialize [end] | |
| [2024-11-26 15:51:06,199] [INFO] [utils.py:782:see_memory_usage] MA 3.43 GB Max_MA 3.97 GB CA 5.07 GB Max_CA 5 GB | |
| [2024-11-26 15:51:06,199] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:06,811] [INFO] [utils.py:781:see_memory_usage] Before creating fp16 partitions | |
| [2024-11-26 15:51:06,812] [INFO] [utils.py:782:see_memory_usage] MA 3.43 GB Max_MA 3.43 GB CA 5.07 GB Max_CA 5 GB | |
| [2024-11-26 15:51:06,813] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:08,361] [INFO] [utils.py:781:see_memory_usage] After creating fp16 partitions: 3 | |
| [2024-11-26 15:51:08,363] [INFO] [utils.py:782:see_memory_usage] MA 3.43 GB Max_MA 3.43 GB CA 4.09 GB Max_CA 5 GB | |
| [2024-11-26 15:51:08,363] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:08,969] [INFO] [utils.py:781:see_memory_usage] Before creating fp32 partitions | |
| [2024-11-26 15:51:08,970] [INFO] [utils.py:782:see_memory_usage] MA 3.43 GB Max_MA 3.43 GB CA 4.09 GB Max_CA 4 GB | |
| [2024-11-26 15:51:08,970] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:09,573] [INFO] [utils.py:781:see_memory_usage] After creating fp32 partitions | |
| [2024-11-26 15:51:09,574] [INFO] [utils.py:782:see_memory_usage] MA 3.75 GB Max_MA 3.8 GB CA 4.34 GB Max_CA 4 GB | |
| [2024-11-26 15:51:09,574] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:10,204] [INFO] [utils.py:781:see_memory_usage] Before initializing optimizer states | |
| [2024-11-26 15:51:10,205] [INFO] [utils.py:782:see_memory_usage] MA 3.75 GB Max_MA 3.75 GB CA 4.34 GB Max_CA 4 GB | |
| [2024-11-26 15:51:10,206] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:10,817] [INFO] [utils.py:781:see_memory_usage] After initializing optimizer states | |
| [2024-11-26 15:51:10,818] [INFO] [utils.py:782:see_memory_usage] MA 3.75 GB Max_MA 3.99 GB CA 4.58 GB Max_CA 5 GB | |
| [2024-11-26 15:51:10,819] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.74 GB, percent = 2.7% | |
| [2024-11-26 15:51:10,819] [INFO] [stage3.py:521:_setup_for_real_optimizer] optimizer state initialized | |
| [2024-11-26 15:51:11,655] [INFO] [utils.py:781:see_memory_usage] After initializing ZeRO optimizer | |
| [2024-11-26 15:51:11,656] [INFO] [utils.py:782:see_memory_usage] MA 4.84 GB Max_MA 5.33 GB CA 6.01 GB Max_CA 6 GB | |
| [2024-11-26 15:51:11,656] [INFO] [utils.py:789:see_memory_usage] CPU Virtual Memory: used = 13.89 GB, percent = 2.8% | |
| [2024-11-26 15:51:11,657] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed Final Optimizer = DeepSpeedZeroOptimizer_Stage3 | |
| [2024-11-26 15:51:11,657] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed using client LR scheduler | |
| [2024-11-26 15:51:11,657] [INFO] [logging.py:128:log_dist] [Rank 0] DeepSpeed LR Scheduler = <torch.optim.lr_scheduler.LambdaLR object at 0x7fdaf7ff4130> | |
| [2024-11-26 15:51:11,657] [INFO] [logging.py:128:log_dist] [Rank 0] step=0, skipped=0, lr=[5e-05, 0.0005, 5e-05], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 15:51:11,659] [INFO] [config.py:999:print] DeepSpeedEngine configuration: | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] activation_checkpointing_config { | |
| "partition_activations": false, | |
| "contiguous_memory_optimization": false, | |
| "cpu_checkpointing": false, | |
| "number_checkpoints": null, | |
| "synchronize_checkpoint_boundary": false, | |
| "profile": false | |
| } | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'thread_count': 1, 'single_submit': False, 'overlap_events': True, 'use_gds': False} | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] amp_enabled .................. False | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] amp_params ................... False | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] autotuning_config ............ { | |
| "enabled": false, | |
| "start_step": null, | |
| "end_step": null, | |
| "metric_path": null, | |
| "arg_mappings": null, | |
| "metric": "throughput", | |
| "model_info": null, | |
| "results_dir": "autotuning_results", | |
| "exps_dir": "autotuning_exps", | |
| "overwrite": true, | |
| "fast": true, | |
| "start_profile_step": 3, | |
| "end_profile_step": 5, | |
| "tuner_type": "gridsearch", | |
| "tuner_early_stopping": 5, | |
| "tuner_num_trials": 50, | |
| "model_info_path": null, | |
| "mp_size": 1, | |
| "max_train_batch_size": null, | |
| "min_train_batch_size": 1, | |
| "max_train_micro_batch_size_per_gpu": 1.024000e+03, | |
| "min_train_micro_batch_size_per_gpu": 1, | |
| "num_tuning_micro_batch_sizes": 3 | |
| } | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] bfloat16_enabled ............. True | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] bfloat16_immediate_grad_update False | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] checkpoint_parallel_write_pipeline False | |
| [2024-11-26 15:51:11,660] [INFO] [config.py:1003:print] checkpoint_tag_validation_enabled True | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] checkpoint_tag_validation_fail False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] comms_config ................. <deepspeed.comm.config.DeepSpeedCommsConfig object at 0x7fdaf7ff4370> | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] communication_data_type ...... None | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}} | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] curriculum_enabled_legacy .... False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] curriculum_params_legacy ..... False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] data_efficiency_config ....... {'enabled': False, 'seed': 1234, 'data_sampling': {'enabled': False, 'num_epochs': 1000, 'num_workers': 0, 'curriculum_learning': {'enabled': False}}, 'data_routing': {'enabled': False, 'random_ltd': {'enabled': False, 'layer_token_lr_schedule': {'enabled': False}}}} | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] data_efficiency_enabled ...... False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] dataloader_drop_last ......... False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] disable_allgather ............ False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] dump_state ................... False | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] dynamic_loss_scale_args ...... None | |
| [2024-11-26 15:51:11,661] [INFO] [config.py:1003:print] eigenvalue_enabled ........... False | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_gas_boundary_resolution 1 | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_layer_name ........ bert.encoder.layer | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_layer_num ......... 0 | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_max_iter .......... 100 | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_stability ......... 1e-06 | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_tol ............... 0.01 | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] eigenvalue_verbose ........... False | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] elasticity_enabled ........... False | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] flops_profiler_config ........ { | |
| "enabled": false, | |
| "recompute_fwd_factor": 0.0, | |
| "profile_step": 1, | |
| "module_depth": -1, | |
| "top_modules": 1, | |
| "detailed": true, | |
| "output_file": null | |
| } | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] fp16_auto_cast ............... None | |
| [2024-11-26 15:51:11,662] [INFO] [config.py:1003:print] fp16_enabled ................. False | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] fp16_master_weights_and_gradients False | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] global_rank .................. 0 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] grad_accum_dtype ............. None | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] gradient_accumulation_steps .. 32 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] gradient_clipping ............ 1.0 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] gradient_predivide_factor .... 1.0 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] graph_harvesting ............. False | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] hybrid_engine ................ enabled=False max_out_tokens=512 inference_tp_size=1 release_inference_cache=False pin_parameters=True tp_gather_partition_size=8 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] initial_dynamic_scale ........ 1 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] load_universal_checkpoint .... False | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] loss_scale ................... 1.0 | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] memory_breakdown ............. False | |
| [2024-11-26 15:51:11,663] [INFO] [config.py:1003:print] mics_hierarchial_params_gather False | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] mics_shard_size .............. -1 | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] monitor_config ............... tensorboard=TensorBoardConfig(enabled=False, output_path='step1_tensorboard/ds_tensorboard_logs/', job_name='step1_model_tensorboard') comet=CometConfig(enabled=False, samples_log_interval=100, project=None, workspace=None, api_key=None, experiment_name=None, experiment_key=None, online=None, mode=None) wandb=WandbConfig(enabled=True, group='huijae-an-university-of-california-berkeley', team='huijae-an-university-of-california-berkeley', project='ds_codellama_7b') csv_monitor=CSVConfig(enabled=False, output_path='', job_name='DeepSpeedJobName') | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] nebula_config ................ { | |
| "enabled": false, | |
| "persistent_storage_path": null, | |
| "persistent_time_interval": 100, | |
| "num_of_version_in_retention": 2, | |
| "enable_nebula_load": true, | |
| "load_path": null | |
| } | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] optimizer_legacy_fusion ...... False | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] optimizer_name ............... None | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] optimizer_params ............. None | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0, 'pipe_partitioned': True, 'grad_partitioned': True} | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] pld_enabled .................. False | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] pld_params ................... False | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] prescale_gradients ........... False | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] scheduler_name ............... None | |
| [2024-11-26 15:51:11,664] [INFO] [config.py:1003:print] scheduler_params ............. None | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] seq_parallel_communication_data_type torch.float32 | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] sparse_attention ............. None | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] sparse_gradients_enabled ..... False | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] steps_per_print .............. 10 | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] timers_config ................ enabled=True synchronized=True | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] train_batch_size ............. 1024 | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] train_micro_batch_size_per_gpu 8 | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] use_data_before_expert_parallel_ False | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] use_node_local_storage ....... False | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] wall_clock_breakdown ......... False | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] weight_quantization_config ... None | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] world_size ................... 4 | |
| [2024-11-26 15:51:11,665] [INFO] [config.py:1003:print] zero_allow_untested_optimizer False | |
| [2024-11-26 15:51:11,666] [INFO] [config.py:1003:print] zero_config .................. stage=3 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=500000000 use_multi_rank_bucket_allreduce=True allgather_partitions=True allgather_bucket_size=500000000 overlap_comm=True load_from_fp32_weights=True elastic_checkpoint=False offload_param=DeepSpeedZeroOffloadParamConfig(device='none', nvme_path=None, buffer_count=5, buffer_size=100000000, max_in_cpu=1000000000, pin_memory=False) offload_optimizer=DeepSpeedZeroOffloadOptimizerConfig(device='none', nvme_path=None, buffer_count=4, pin_memory=False, pipeline_read=False, pipeline_write=False, fast_init=False, ratio=1.0) sub_group_size=1000000000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=30000000 param_persistence_threshold=10000 model_persistence_threshold=9223372036854775807 max_live_parameters=30000000 max_reuse_distance=1000000000 gather_16bit_weights_on_model_save=False use_all_reduce_for_fetch_params=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False zero_hpz_partition_size=1 zero_quantized_weights=False zero_quantized_nontrainable_weights=False zero_quantized_gradients=False mics_shard_size=-1 mics_hierarchical_params_gather=False memory_efficient_linear=False pipeline_loading_checkpoint=False override_module_apply=True | |
| [2024-11-26 15:51:11,666] [INFO] [config.py:1003:print] zero_enabled ................. True | |
| [2024-11-26 15:51:11,666] [INFO] [config.py:1003:print] zero_force_ds_cpu_optimizer .. True | |
| [2024-11-26 15:51:11,666] [INFO] [config.py:1003:print] zero_optimization_stage ...... 3 | |
| [2024-11-26 15:51:11,666] [INFO] [config.py:989:print_user_config] json = { | |
| "train_batch_size": 1.024000e+03, | |
| "train_micro_batch_size_per_gpu": 8, | |
| "steps_per_print": 10, | |
| "zero_optimization": { | |
| "stage": 3, | |
| "overlap_comm": true, | |
| "offload_param": { | |
| "device": "none" | |
| }, | |
| "offload_optimizer": { | |
| "device": "none" | |
| }, | |
| "stage3_param_persistence_threshold": 1.000000e+04, | |
| "stage3_max_live_parameters": 3.000000e+07, | |
| "stage3_prefetch_bucket_size": 3.000000e+07, | |
| "memory_efficient_linear": false | |
| }, | |
| "bfloat16": { | |
| "enabled": true | |
| }, | |
| "gradient_clipping": 1.0, | |
| "prescale_gradients": false, | |
| "wall_clock_breakdown": false, | |
| "hybrid_engine": { | |
| "enabled": false, | |
| "max_out_tokens": 512, | |
| "inference_tp_size": 1, | |
| "release_inference_cache": false, | |
| "pin_parameters": true, | |
| "tp_gather_partition_size": 8 | |
| }, | |
| "tensorboard": { | |
| "enabled": false, | |
| "output_path": "step1_tensorboard/ds_tensorboard_logs/", | |
| "job_name": "step1_model_tensorboard" | |
| }, | |
| "wandb": { | |
| "enabled": true, | |
| "group": "huijae-an-university-of-california-berkeley", | |
| "team": "huijae-an-university-of-california-berkeley", | |
| "project": "ds_codellama_7b" | |
| } | |
| } | |
| ***** Running training ***** | |
| ***** Evaluating perplexity, Epoch 0/1 ***** | |
| ppl: 6.9873175621032715, loss: 1.9440966844558716 | |
| Beginning of Epoch 1/1, Total Micro Batches 1676 | |
| Invalidate trace cache @ step 677 and module 0: cache has only 677 modules | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.76s, TFLOPs: 10.97, Samples/sec: 2.13, Time/seq 0.47s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.69, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.68, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.68, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.65, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.64, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.69, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.64, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.53s, TFLOPs: 11.67, Samples/sec: 2.27, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.65, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.65, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.69s, TFLOPs: 11.17, Samples/sec: 2.17, Time/seq 0.46s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.89s, TFLOPs: 10.60, Samples/sec: 2.06, Time/seq 0.49s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.65, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.65, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.66, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.64, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.64, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.62, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.54s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.61, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.63, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.62, Samples/sec: 2.26, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.60, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.61, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.55s, TFLOPs: 11.61, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.56s, TFLOPs: 11.59, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.56s, TFLOPs: 11.58, Samples/sec: 2.25, Time/seq 0.44s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.59s, TFLOPs: 11.48, Samples/sec: 2.23, Time/seq 0.45s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.56s, TFLOPs: 11.57, Samples/sec: 2.25, Time/seq 0.45s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.58s, TFLOPs: 11.52, Samples/sec: 2.24, Time/seq 0.45s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.81s, TFLOPs: 10.82, Samples/sec: 2.10, Time/seq 0.48s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.60s, TFLOPs: 11.45, Samples/sec: 2.22, Time/seq 0.45s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.12s, TFLOPs: 10.00, Samples/sec: 1.94, Time/seq 0.52s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.68s, TFLOPs: 11.20, Samples/sec: 2.17, Time/seq 0.46s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.28s, TFLOPs: 9.62, Samples/sec: 1.87, Time/seq 0.54s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.05s, TFLOPs: 10.17, Samples/sec: 1.97, Time/seq 0.51s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 3.71s, TFLOPs: 11.11, Samples/sec: 2.16, Time/seq 0.46s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.76s, TFLOPs: 8.66, Samples/sec: 1.68, Time/seq 0.59s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.26s, TFLOPs: 9.67, Samples/sec: 1.88, Time/seq 0.53s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.56s, TFLOPs: 9.04, Samples/sec: 1.75, Time/seq 0.57s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.02s, TFLOPs: 8.22, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.53s, TFLOPs: 9.10, Samples/sec: 1.77, Time/seq 0.57s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.49s, TFLOPs: 9.17, Samples/sec: 1.78, Time/seq 0.56s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.36s, TFLOPs: 9.45, Samples/sec: 1.83, Time/seq 0.55s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.93s, TFLOPs: 8.36, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.68s, TFLOPs: 8.80, Samples/sec: 1.71, Time/seq 0.59s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.17, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.15s, TFLOPs: 8.01, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.92s, TFLOPs: 8.38, Samples/sec: 1.63, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.94s, TFLOPs: 8.35, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.86s, TFLOPs: 8.49, Samples/sec: 1.65, Time/seq 0.61s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.88, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.62s, TFLOPs: 8.93, Samples/sec: 1.73, Time/seq 0.58s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.16, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.92s, TFLOPs: 8.38, Samples/sec: 1.63, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.11s, TFLOPs: 8.06, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.08, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.29, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.91, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.03, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.97, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.96s, TFLOPs: 8.32, Samples/sec: 1.61, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.74, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.19, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.88, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.40s, TFLOPs: 6.44, Samples/sec: 1.25, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.23s, TFLOPs: 6.61, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.88, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.99, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.04s, TFLOPs: 8.18, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.06s, TFLOPs: 8.15, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.30s, TFLOPs: 6.55, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.29, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.16s, TFLOPs: 6.69, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.03, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.87s, TFLOPs: 8.46, Samples/sec: 1.64, Time/seq 0.61s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.10s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.24s, TFLOPs: 7.87, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.83, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.03s, TFLOPs: 8.20, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.19, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.45, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.57, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.19s, TFLOPs: 6.66, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.76, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.93s, TFLOPs: 8.37, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| [2024-11-26 16:18:55,408] [INFO] [logging.py:128:log_dist] [Rank 0] step=10, skipped=0, lr=[4.573514213625505e-05, 0.0004573514213625505, 4.573514213625505e-05], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 16:18:55,409] [INFO] [timer.py:264:stop] epoch=0/micro_step=320/global_step=10, RunningAvgSamplesPerSec=5.776142255239539, CurrSamplesPerSec=5.686046687719902, MemAllocated=5.98GB, MaxMemAllocated=10.83GB | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.54s, TFLOPs: 9.08, Samples/sec: 1.76, Time/seq 0.57s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.50s, TFLOPs: 6.35, Samples/sec: 1.23, Time/seq 0.81s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.99, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.14, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.33s, TFLOPs: 6.51, Samples/sec: 1.26, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.07s, TFLOPs: 8.13, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.91s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.03s, TFLOPs: 6.84, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.01s, TFLOPs: 8.23, Samples/sec: 1.60, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.31s, TFLOPs: 6.53, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.10s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.57, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.97s, TFLOPs: 8.30, Samples/sec: 1.61, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.30s, TFLOPs: 6.54, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.32s, TFLOPs: 6.53, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.37s, TFLOPs: 6.47, Samples/sec: 1.26, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.91s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.00s, TFLOPs: 8.25, Samples/sec: 1.60, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.97, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.42s, TFLOPs: 6.42, Samples/sec: 1.25, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.83, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.26s, TFLOPs: 6.58, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.19s, TFLOPs: 6.66, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.22s, TFLOPs: 6.62, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.34, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.24s, TFLOPs: 6.61, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.83, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.16, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.49s, TFLOPs: 6.35, Samples/sec: 1.23, Time/seq 0.81s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.79s, TFLOPs: 6.07, Samples/sec: 1.18, Time/seq 0.85s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.91, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.06, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.29s, TFLOPs: 6.55, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.10s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.29s, TFLOPs: 6.55, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.22s, TFLOPs: 6.63, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.18s, TFLOPs: 6.67, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.21s, TFLOPs: 6.64, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.56s, TFLOPs: 6.29, Samples/sec: 1.22, Time/seq 0.82s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.07s, TFLOPs: 6.79, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.83, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.57, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.07s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.24s, TFLOPs: 6.61, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.72, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.83, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.76, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| [2024-11-26 16:49:02,022] [INFO] [logging.py:128:log_dist] [Rank 0] step=20, skipped=0, lr=[3.4395689552855955e-05, 0.00034395689552855954, 3.4395689552855955e-05], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 16:49:02,023] [INFO] [timer.py:264:stop] epoch=0/micro_step=640/global_step=20, RunningAvgSamplesPerSec=5.718603525999416, CurrSamplesPerSec=5.669090005154639, MemAllocated=5.98GB, MaxMemAllocated=10.83GB | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.06s, TFLOPs: 8.15, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.72, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.94, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.25s, TFLOPs: 6.60, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.99s, TFLOPs: 8.26, Samples/sec: 1.60, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.30s, TFLOPs: 6.54, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.57, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.41s, TFLOPs: 6.43, Samples/sec: 1.25, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.11s, TFLOPs: 8.06, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.42s, TFLOPs: 6.42, Samples/sec: 1.25, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.20s, TFLOPs: 6.65, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.09s, TFLOPs: 8.10, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.16s, TFLOPs: 6.69, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.14, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.92s, TFLOPs: 8.37, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.74, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.08s, TFLOPs: 8.11, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.03s, TFLOPs: 6.84, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.15s, TFLOPs: 8.00, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.94s, TFLOPs: 8.35, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.60s, TFLOPs: 6.25, Samples/sec: 1.21, Time/seq 0.82s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.58, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.94, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.15s, TFLOPs: 8.01, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.08s, TFLOPs: 8.12, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.43s, TFLOPs: 6.41, Samples/sec: 1.24, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.55s, TFLOPs: 6.29, Samples/sec: 1.22, Time/seq 0.82s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.05, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.75s, TFLOPs: 8.68, Samples/sec: 1.68, Time/seq 0.59s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.35s, TFLOPs: 6.49, Samples/sec: 1.26, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.24s, TFLOPs: 7.86, Samples/sec: 1.53, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.57, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.07s, TFLOPs: 8.13, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.21s, TFLOPs: 6.64, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.91s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.37s, TFLOPs: 6.47, Samples/sec: 1.26, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.07s, TFLOPs: 8.12, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.19, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.25s, TFLOPs: 6.60, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.07s, TFLOPs: 8.13, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.34s, TFLOPs: 6.50, Samples/sec: 1.26, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.02s, TFLOPs: 8.22, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.74, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.76, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.72, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| [2024-11-26 17:19:05,714] [INFO] [logging.py:128:log_dist] [Rank 0] step=30, skipped=0, lr=[1.9850534531472546e-05, 0.00019850534531472543, 1.9850534531472546e-05], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 17:19:05,715] [INFO] [timer.py:264:stop] epoch=0/micro_step=960/global_step=30, RunningAvgSamplesPerSec=5.705639602280608, CurrSamplesPerSec=5.655968914880804, MemAllocated=5.98GB, MaxMemAllocated=10.83GB | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.38s, TFLOPs: 6.47, Samples/sec: 1.25, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.05, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.75, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.18s, TFLOPs: 6.67, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.14s, TFLOPs: 6.72, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.34s, TFLOPs: 6.51, Samples/sec: 1.26, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.06s, TFLOPs: 8.15, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.96, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.01s, TFLOPs: 8.22, Samples/sec: 1.60, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.23s, TFLOPs: 6.62, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.12s, TFLOPs: 6.74, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.99, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.23s, TFLOPs: 6.62, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.96, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.18s, TFLOPs: 6.67, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.05, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.18s, TFLOPs: 6.67, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.17s, TFLOPs: 6.68, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.97, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.90, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.07s, TFLOPs: 6.79, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.72, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.25s, TFLOPs: 6.60, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.76, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.04s, TFLOPs: 8.17, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.75, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.51s, TFLOPs: 9.14, Samples/sec: 1.77, Time/seq 0.56s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.65, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.20s, TFLOPs: 6.64, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.18s, TFLOPs: 6.67, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.03s, TFLOPs: 8.20, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.82, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.73, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.87, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.99, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.91, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.17s, TFLOPs: 6.68, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.24s, TFLOPs: 7.87, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.24s, TFLOPs: 7.87, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.15s, TFLOPs: 6.71, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.29s, TFLOPs: 6.55, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.91s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.14, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.99s, TFLOPs: 8.26, Samples/sec: 1.60, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.08, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.01s, TFLOPs: 8.24, Samples/sec: 1.60, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.76, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.39s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.87, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.68, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.10s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.17s, TFLOPs: 6.68, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.08s, TFLOPs: 6.78, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 8.00, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.37s, TFLOPs: 7.67, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.04s, TFLOPs: 6.83, Samples/sec: 1.32, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.32, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.03s, TFLOPs: 6.84, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| [2024-11-26 17:49:07,694] [INFO] [logging.py:128:log_dist] [Rank 0] step=40, skipped=0, lr=[7.062318573891716e-06, 7.062318573891716e-05, 7.062318573891716e-06], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 17:49:07,695] [INFO] [timer.py:264:stop] epoch=0/micro_step=1280/global_step=40, RunningAvgSamplesPerSec=5.700940403428854, CurrSamplesPerSec=5.713141151276828, MemAllocated=5.98GB, MaxMemAllocated=10.83GB | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.33s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.29, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.00s, TFLOPs: 8.25, Samples/sec: 1.60, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.14, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.24, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.60, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.24s, TFLOPs: 7.86, Samples/sec: 1.53, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.17s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.87, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.16, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.07s, TFLOPs: 6.79, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.20, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.94, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.89, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.14, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.03, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.75, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.85, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.08, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.99s, TFLOPs: 8.27, Samples/sec: 1.60, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.91s, TFLOPs: 6.98, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.77s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.03, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.17, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.97, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.86, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.19s, TFLOPs: 6.66, Samples/sec: 1.29, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.25s, TFLOPs: 7.86, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.50s, TFLOPs: 6.34, Samples/sec: 1.23, Time/seq 0.81s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.00s, TFLOPs: 6.87, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.82s, TFLOPs: 7.09, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.39, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.45, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.96s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.03, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.16s, TFLOPs: 7.98, Samples/sec: 1.55, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.10s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.98s, TFLOPs: 6.89, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.68s, TFLOPs: 7.26, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.46, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.93, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.15s, TFLOPs: 8.00, Samples/sec: 1.55, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.74, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.02s, TFLOPs: 8.21, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.28s, TFLOPs: 6.56, Samples/sec: 1.27, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.51, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.14s, TFLOPs: 8.02, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.88, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.64, Samples/sec: 1.48, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.21s, TFLOPs: 6.64, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 12.03s, TFLOPs: 3.43, Samples/sec: 0.66, Time/seq 1.50s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.53s, TFLOPs: 7.45, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.78s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.43, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.92, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.58s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.01s, TFLOPs: 6.86, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.52, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.17, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.63s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.20s, TFLOPs: 6.65, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.20s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.55s, TFLOPs: 7.42, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.11s, TFLOPs: 8.07, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.45s, TFLOPs: 6.39, Samples/sec: 1.24, Time/seq 0.81s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.05, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.73s, TFLOPs: 7.19, Samples/sec: 1.40, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.51s, TFLOPs: 7.48, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.17s, TFLOPs: 6.68, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.34s, TFLOPs: 7.72, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.95, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.22s, TFLOPs: 6.62, Samples/sec: 1.29, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.83s, TFLOPs: 7.07, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.45, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.17, Samples/sec: 1.59, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.01, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.97s, TFLOPs: 6.91, Samples/sec: 1.34, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.01s, TFLOPs: 8.23, Samples/sec: 1.60, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.36s, TFLOPs: 6.48, Samples/sec: 1.26, Time/seq 0.80s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.29s, TFLOPs: 7.79, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.32s, TFLOPs: 7.75, Samples/sec: 1.50, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.25, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.25s, TFLOPs: 6.59, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.80, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.07s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.64s, TFLOPs: 7.31, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.34, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.18s, TFLOPs: 7.96, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.09s, TFLOPs: 8.10, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.52s, TFLOPs: 7.47, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.67s, TFLOPs: 7.27, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.88s, TFLOPs: 8.44, Samples/sec: 1.64, Time/seq 0.61s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.84, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.95s, TFLOPs: 8.34, Samples/sec: 1.62, Time/seq 0.62s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.32s, TFLOPs: 6.52, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.57, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.95s, TFLOPs: 6.93, Samples/sec: 1.34, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.60s, TFLOPs: 7.36, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.38s, TFLOPs: 7.66, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.03s, TFLOPs: 6.84, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.84s, TFLOPs: 7.06, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.60, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.27s, TFLOPs: 7.82, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.13, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.10, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.49s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.19s, TFLOPs: 7.94, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.12s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.75, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.28s, TFLOPs: 7.81, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.02s, TFLOPs: 6.85, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.08s, TFLOPs: 6.78, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.23s, TFLOPs: 7.88, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.40, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.43s, TFLOPs: 7.59, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.15, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.42s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.03, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.76, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.61, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.36s, TFLOPs: 7.69, Samples/sec: 1.49, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.75s, TFLOPs: 7.17, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.30s, TFLOPs: 7.78, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.45s, TFLOPs: 6.39, Samples/sec: 1.24, Time/seq 0.81s, Batch Size: 8, Sequence Length: 512 | |
| [2024-11-26 18:19:07,609] [INFO] [logging.py:128:log_dist] [Rank 0] step=50, skipped=0, lr=[3.9423555131007925e-07, 3.942355513100792e-06, 3.9423555131007925e-07], mom=[(0.9, 0.95), (0.9, 0.95), (0.9, 0.95)] | |
| [2024-11-26 18:19:07,609] [INFO] [timer.py:264:stop] epoch=0/micro_step=1600/global_step=50, RunningAvgSamplesPerSec=5.6995668835956, CurrSamplesPerSec=5.726010559952307, MemAllocated=5.98GB, MaxMemAllocated=10.83GB | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.92, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.49, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.22s, TFLOPs: 7.90, Samples/sec: 1.53, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.03s, TFLOPs: 6.83, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.54s, TFLOPs: 7.44, Samples/sec: 1.44, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.30, Samples/sec: 1.42, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.45s, TFLOPs: 7.56, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.45, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.27s, TFLOPs: 6.58, Samples/sec: 1.28, Time/seq 0.78s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.70s, TFLOPs: 7.23, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.70, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.09s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.19, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.71s, TFLOPs: 7.22, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.69s, TFLOPs: 7.24, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.16s, TFLOPs: 6.69, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.56s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.01s, TFLOPs: 8.22, Samples/sec: 1.60, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.37, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.40s, TFLOPs: 7.63, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.05s, TFLOPs: 6.81, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.86s, TFLOPs: 7.04, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 4.59s, TFLOPs: 8.98, Samples/sec: 1.74, Time/seq 0.57s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.32s, TFLOPs: 6.53, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.48s, TFLOPs: 7.53, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.35s, TFLOPs: 7.71, Samples/sec: 1.50, Time/seq 0.67s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.59s, TFLOPs: 7.38, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.11s, TFLOPs: 6.75, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.46s, TFLOPs: 7.55, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.95, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.47s, TFLOPs: 7.54, Samples/sec: 1.46, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.88s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.91, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.09s, TFLOPs: 6.77, Samples/sec: 1.31, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.57s, TFLOPs: 7.41, Samples/sec: 1.44, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.50s, TFLOPs: 7.50, Samples/sec: 1.46, Time/seq 0.69s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.89s, TFLOPs: 7.00, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.80s, TFLOPs: 7.11, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.94s, TFLOPs: 6.94, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.41s, TFLOPs: 7.62, Samples/sec: 1.48, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.99s, TFLOPs: 6.88, Samples/sec: 1.33, Time/seq 0.75s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.44s, TFLOPs: 7.58, Samples/sec: 1.47, Time/seq 0.68s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.90s, TFLOPs: 6.99, Samples/sec: 1.36, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.10s, TFLOPs: 8.09, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.06s, TFLOPs: 6.80, Samples/sec: 1.32, Time/seq 0.76s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.74s, TFLOPs: 7.18, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.62s, TFLOPs: 7.33, Samples/sec: 1.42, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.87s, TFLOPs: 7.02, Samples/sec: 1.36, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.31s, TFLOPs: 7.77, Samples/sec: 1.51, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.05s, TFLOPs: 8.16, Samples/sec: 1.58, Time/seq 0.63s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.13s, TFLOPs: 6.73, Samples/sec: 1.31, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.76s, TFLOPs: 7.16, Samples/sec: 1.39, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.61s, TFLOPs: 7.35, Samples/sec: 1.43, Time/seq 0.70s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.92s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.26s, TFLOPs: 7.84, Samples/sec: 1.52, Time/seq 0.66s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.16s, TFLOPs: 6.70, Samples/sec: 1.30, Time/seq 0.77s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.65s, TFLOPs: 7.29, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.72s, TFLOPs: 7.21, Samples/sec: 1.40, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.79s, TFLOPs: 7.12, Samples/sec: 1.38, Time/seq 0.72s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.13s, TFLOPs: 8.04, Samples/sec: 1.56, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.21s, TFLOPs: 7.91, Samples/sec: 1.54, Time/seq 0.65s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.81s, TFLOPs: 7.09, Samples/sec: 1.38, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.85s, TFLOPs: 7.05, Samples/sec: 1.37, Time/seq 0.73s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.93s, TFLOPs: 6.96, Samples/sec: 1.35, Time/seq 0.74s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.09s, TFLOPs: 8.11, Samples/sec: 1.57, Time/seq 0.64s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 6.30s, TFLOPs: 6.54, Samples/sec: 1.27, Time/seq 0.79s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 5.66s, TFLOPs: 7.28, Samples/sec: 1.41, Time/seq 0.71s, Batch Size: 8, Sequence Length: 512 | |
| Model Parameters: 6.687 B, Latency: 2.93s, TFLOPs: 14.05, Samples/sec: 2.73, Time/seq 0.37s, Batch Size: 8, Sequence Length: 512 | |
| ***** Evaluating perplexity, Epoch 1/1 ***** | |
| ppl: 4.6358642578125, loss: 1.5338225364685059 | |
| saving the final model ... | |
| [2024-11-26 18:26:42,515] [INFO] [launch.py:351:main] Process 2980795 exits successfully. | |
| [2024-11-26 18:26:42,516] [INFO] [launch.py:351:main] Process 2980794 exits successfully. | |
| [2024-11-26 18:26:43,517] [INFO] [launch.py:351:main] Process 2980793 exits successfully. | |
| [1;34mwandb[0m: 🚀 View run [33mswift-frog-3[0m at: [34mhttps://wandb.ai/huijae-an-university-of-california-berkeley/ds_codellama_7b/runs/zrgh6czh[0m[1;34mwandb[0m: Find logs at: [1;35mwandb/run-20241126_155103-zrgh6czh/logs[0m[2024-11-26 18:27:07,544] [INFO] [launch.py:351:main] Process 2980792 exits successfully. | |