Row 30994
Content Data
This page contains data entry 30994 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.
I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch.
| Field | Value |
|---|---|
| text | I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch. |
| label | r/machinelearning |
| dataType | comment |
| communityName | r/MachineLearning |
| datetime | 2024-05-21 |
| username_encoded | Z0FBQUFBQm5Lak1HWGpUU0F1cE1DWVhCOFNyNTQzRklWVExYR21pbHZwQmZtQ2YxdDB5MGF1MnNyNGhKMENpcjVVVXZGVlVQZ3V5Z3ItZ1o4blFWWDcySXJUMk1RX0RJdWJhQVJMWUF4ZkhIN0o1cU9YcmcwN2s9 |
| url_encoded | Z0FBQUFBQm5Lak9WSkpGYnZlbUlhZHVlUjZYSXFXNGxSN2haeWJVbGptbEVWdnZmbDNuVU0yTXFGTWhfQkxPWXAzUEJCaVVSamRKbThNQ2V0dlVHZVpfNXJDUHhiV0I2dHpNU2pDdUxLR0Q4TXVjaU4tVjlFNG9oNmNrUVVvR3dsZ3EyQV9WbkpkaVppMEFaRFU5NXdEZk5JTkdSQjB1NDdBMVBrMWU4Zm9BUHFQU1ZycVhJb2FuSjhPQy1fVXY1dW83T2lpOVhmNTFRSkI3a0xMUF96N0dMOXUyQ3NRZDN1azJIWFBVaXR4REwwQnZRVkt0MjNLZz0= |
Raw Record
{
"text": "I haven't gotten the chance to use DeepSpeed that much, but from what I know FSDP should be roughly similar to ZeRO stage 3 in DeepSpeed. I like using FSDP since it saves a lot of memory and it's nicely integrated with PyTorch.",
"label": "r/machinelearning",
"dataType": "comment",
"communityName": "r/MachineLearning",
"datetime": "2024-05-21",
"username_encoded": "Z0FBQUFBQm5Lak1HWGpUU0F1cE1DWVhCOFNyNTQzRklWVExYR21pbHZwQmZtQ2YxdDB5MGF1MnNyNGhKMENpcjVVVXZGVlVQZ3V5Z3ItZ1o4blFWWDcySXJUMk1RX0RJdWJhQVJMWUF4ZkhIN0o1cU9YcmcwN2s9",
"url_encoded": "Z0FBQUFBQm5Lak9WSkpGYnZlbUlhZHVlUjZYSXFXNGxSN2haeWJVbGptbEVWdnZmbDNuVU0yTXFGTWhfQkxPWXAzUEJCaVVSamRKbThNQ2V0dlVHZVpfNXJDUHhiV0I2dHpNU2pDdUxLR0Q4TXVjaU4tVjlFNG9oNmNrUVVvR3dsZ3EyQV9WbkpkaVppMEFaRFU5NXdEZk5JTkdSQjB1NDdBMVBrMWU4Zm9BUHFQU1ZycVhJb2FuSjhPQy1fVXY1dW83T2lpOVhmNTFRSkI3a0xMUF96N0dMOXUyQ3NRZDN1azJIWFBVaXR4REwwQnZRVkt0MjNLZz0="
}
Entry Information
- Entry ID: 30994
- Repository: Axioma AXP
- Dataset: arrmlet/reddit_dataset_36
- Total Entries: 100,000