auto: global_step_90
d583631 verified - huggingface auto: global_step_90
extra_state_world_size_8_rank_0.pt Detected Pickle imports (7)
- "numpy.dtype",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "collections.OrderedDict"
How to fix it?
15.3 kB auto: global_step_90 extra_state_world_size_8_rank_1.pt Detected Pickle imports (7)
- "numpy.dtype",
- "numpy.ndarray",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "numpy.core.multiarray._reconstruct",
- "torch.ByteStorage"
How to fix it?
15.1 kB auto: global_step_90 extra_state_world_size_8_rank_2.pt Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.ndarray",
- "numpy.core.multiarray._reconstruct",
- "numpy.dtype",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage"
How to fix it?
15.2 kB auto: global_step_90 extra_state_world_size_8_rank_3.pt Detected Pickle imports (7)
- "_codecs.encode",
- "numpy.ndarray",
- "numpy.core.multiarray._reconstruct",
- "numpy.dtype",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.ByteStorage"
How to fix it?
15.1 kB auto: global_step_90 extra_state_world_size_8_rank_4.pt Detected Pickle imports (7)
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "_codecs.encode",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.ByteStorage"
How to fix it?
15.1 kB auto: global_step_90 extra_state_world_size_8_rank_5.pt Detected Pickle imports (7)
- "torch.ByteStorage",
- "numpy.dtype",
- "torch._utils._rebuild_tensor_v2",
- "numpy.core.multiarray._reconstruct",
- "collections.OrderedDict",
- "_codecs.encode",
- "numpy.ndarray"
How to fix it?
15.1 kB auto: global_step_90 extra_state_world_size_8_rank_6.pt Detected Pickle imports (7)
- "numpy.dtype",
- "numpy.core.multiarray._reconstruct",
- "numpy.ndarray",
- "torch._utils._rebuild_tensor_v2",
- "_codecs.encode",
- "torch.ByteStorage",
- "collections.OrderedDict"
How to fix it?
15.1 kB auto: global_step_90 extra_state_world_size_8_rank_7.pt Detected Pickle imports (7)
- "numpy.dtype",
- "numpy.core.multiarray._reconstruct",
- "_codecs.encode",
- "torch.ByteStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "numpy.ndarray"
How to fix it?
15.2 kB auto: global_step_90 model_world_size_8_rank_0.pt Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.IntStorage",
- "torch.Size",
- "torch.device",
- "torch.float32",
- "torch.FloatStorage",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.placement_types.Shard",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed._mesh_layout._MeshLayout"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_1.pt Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.IntStorage",
- "torch.Size",
- "torch.device",
- "torch.float32",
- "torch.FloatStorage",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.placement_types.Shard",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed._mesh_layout._MeshLayout"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_2.pt Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch.serialization._get_layout",
- "torch.float32",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch._utils._rebuild_wrapper_subclass",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.IntStorage",
- "torch.distributed.tensor.DTensor",
- "torch.device",
- "torch.Size",
- "torch.FloatStorage",
- "torch.distributed.tensor.placement_types.Shard",
- "collections.OrderedDict",
- "torch.distributed._mesh_layout._MeshLayout"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_3.pt Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.IntStorage",
- "torch.Size",
- "torch.device",
- "torch.float32",
- "torch.FloatStorage",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.placement_types.Shard",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed._mesh_layout._MeshLayout"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_4.pt Detected Pickle imports (17)
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.Size",
- "torch._tensor._rebuild_from_type_v2",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.device",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed._mesh_layout._MeshLayout",
- "torch.float32"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_5.pt Detected Pickle imports (17)
- "torch.device",
- "torch.IntStorage",
- "torch.distributed.tensor.DTensor",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.Size",
- "torch.distributed.device_mesh.DeviceMesh",
- "collections.OrderedDict",
- "torch.float32",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch._tensor._rebuild_from_type_v2",
- "torch.distributed._mesh_layout._MeshLayout",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_6.pt Detected Pickle imports (17)
- "torch._tensor._rebuild_from_type_v2",
- "collections.OrderedDict",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.IntStorage",
- "torch.Size",
- "torch.device",
- "torch.float32",
- "torch.FloatStorage",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed.tensor.placement_types.Shard",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed._mesh_layout._MeshLayout"
How to fix it?
4.48 GB auto: global_step_90 model_world_size_8_rank_7.pt Detected Pickle imports (17)
- "torch.serialization._get_layout",
- "torch.distributed.tensor.DTensor",
- "torch.distributed.device_mesh.DeviceMesh",
- "torch.Size",
- "torch._tensor._rebuild_from_type_v2",
- "torch.IntStorage",
- "collections.OrderedDict",
- "torch.device",
- "torch.distributed.tensor._dtensor_spec.DTensorSpec",
- "torch.distributed.tensor.placement_types.Shard",
- "torch.distributed.tensor._dtensor_spec.ShardOrderEntry",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.distributed.tensor._dtensor_spec.TensorMeta",
- "torch.distributed._mesh_layout._MeshLayout",
- "torch.float32"
How to fix it?
4.48 GB auto: global_step_90 - 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90
- 8.95 GB auto: global_step_90