Row 30994

Row ID: 30994 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 30994 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch.

FieldValue
text I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch.
label r/machinelearning
dataType comment
communityName r/MachineLearning
datetime 2024-05-21
username_encoded Z0FBQUFBQm5Lak1HWGpUU0F1cE1DWVhCOFNyNTQzRklWVExYR21pbHZwQmZtQ2YxdDB5MGF1MnNyNGhKMENpcjVVVXZGVlVQZ3V5Z3ItZ1o4blFWWDcySXJUMk1RX0RJdWJhQVJMWUF4ZkhIN0o1cU9YcmcwN2s9
url_encoded Z0FBQUFBQm5Lak9WSkpGYnZlbUlhZHVlUjZYSXFXNGxSN2haeWJVbGptbEVWdnZmbDNuVU0yTXFGTWhfQkxPWXAzUEJCaVVSamRKbThNQ2V0dlVHZVpfNXJDUHhiV0I2dHpNU2pDdUxLR0Q4TXVjaU4tVjlFNG9oNmNrUVVvR3dsZ3EyQV9WbkpkaVppMEFaRFU5NXdEZk5JTkdSQjB1NDdBMVBrMWU4Zm9BUHFQU1ZycVhJb2FuSjhPQy1fVXY1dW83T2lpOVhmNTFRSkI3a0xMUF96N0dMOXUyQ3NRZDN1azJIWFBVaXR4REwwQnZRVkt0MjNLZz0=

Raw Record

{
  "text": "I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch.",
  "label": "r/machinelearning",
  "dataType": "comment",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-21",
  "username_encoded": "Z0FBQUFBQm5Lak1HWGpUU0F1cE1DWVhCOFNyNTQzRklWVExYR21pbHZwQmZtQ2YxdDB5MGF1MnNyNGhKMENpcjVVVXZGVlVQZ3V5Z3ItZ1o4blFWWDcySXJUMk1RX0RJdWJhQVJMWUF4ZkhIN0o1cU9YcmcwN2s9",
  "url_encoded": "Z0FBQUFBQm5Lak9WSkpGYnZlbUlhZHVlUjZYSXFXNGxSN2haeWJVbGptbEVWdnZmbDNuVU0yTXFGTWhfQkxPWXAzUEJCaVVSamRKbThNQ2V0dlVHZVpfNXJDUHhiV0I2dHpNU2pDdUxLR0Q4TXVjaU4tVjlFNG9oNmNrUVVvR3dsZ3EyQV9WbkpkaVppMEFaRFU5NXdEZk5JTkdSQjB1NDdBMVBrMWU4Zm9BUHFQU1ZycVhJb2FuSjhPQy1fVXY1dW83T2lpOVhmNTFRSkI3a0xMUF96N0dMOXUyQ3NRZDN1azJIWFBVaXR4REwwQnZRVkt0MjNLZz0="
}

Entry Information