Row 2213

Row ID: 2213 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 2213 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hello all,

I'm new to Tensorflow and use it to train LORA models for Stable Diffusion image generation. When monitoring the training process via Tensorboard I saw two **"strange" occurences** \- see picture.

https://preview.redd.it/oydivyjmpqcb1.png?width=417&format=png&auto=webp&s=6b1860759246dba93503f00439b933d647844d9b

Can someone please help me out...

1. Why the blue graph shows increasing average loss after \~1400 steps? 2. Why the gray graph shows NaN loss after \~1200 steps?

So, not why, because the "why" is most likely a mistake I made (which I hope to rule out) but more **"what" it means** that the either the loss increases after \~1400 steps or that I get NaN loss after \~1200 steps...

FieldValue
text Hello all, I'm new to Tensorflow and use it to train LORA models for Stable Diffusion image generation. When monitoring the training process via Tensorboard I saw two **"strange" occurences** \- see picture. https://preview.redd.it/oydivyjmpqcb1.png?width=417&format=png&auto=webp&s=6b1860759246dba93503f00439b933d647844d9b Can someone please help me out... 1. Why the blue graph shows increasing average loss after \~1400 steps? 2. Why the gray graph shows NaN loss after \~1200 steps? S…
label r/tensorflow
dataType post
communityName r/tensorflow
datetime 2023-07-18
username_encoded Z0FBQUFBQm5LakwweFRrRmpOM1MxMTJWdmEwbDJNNmtZOERBdVY1QVVPYVl4NkIzMGtjSzBUUTRSMjAtZXRtOG13cXFPVjBJdzUtY2pYNG96SGRkcHV2a0p2TXFiYk9UQkRabDgzS0V6dGVSZGJDUDhmVDM1X3c9
url_encoded Z0FBQUFBQm5Lak9FRVBLOEU2OHFlR3hNS1FhczlQdU9UYUNUaUpXSUgtZTN4MlFVcUNuUzRyeFl1WmxoZWVFWURyV1JwYW1XUkdFYjZwZkE3RXJXZ2hnZDVlbkdkaUtfYnlXRlhsRGYxeXpYRmFVRHRQc3M4UUMtSUp6ZHhGNzJSOFBpZ2o2RnllSC14SmNoWm4yM3FNdUxwUDRSSm5JR293VHBXUWhmRWU0MGZVX3NWTVFVT09fQjlrSVNnUDFvUlZkUEEzLVJaS1h4TXo3dmoxb0pfbFY3dWdEQzEyQ3VKdz09

Raw Record

{
  "text": "Hello all,  \n\n\nI'm new to Tensorflow and use it to train LORA models for Stable Diffusion image generation. When monitoring the training process via Tensorboard I saw two **\"strange\" occurences** \\- see picture.\n\nhttps://preview.redd.it/oydivyjmpqcb1.png?width=417&format=png&auto=webp&s=6b1860759246dba93503f00439b933d647844d9b\n\nCan someone please help me out...  \n\n\n1. Why the blue graph shows increasing average loss after \\~1400 steps? \n2. Why the gray graph shows NaN loss after \\~1200 steps?\n\nSo, not why, because the \"why\" is most likely a mistake I made (which I hope to rule out) but more **\"what\" it means** that the either the loss increases after \\~1400 steps or that I get NaN loss after \\~1200 steps... ",
  "label": "r/tensorflow",
  "dataType": "post",
  "communityName": "r/tensorflow",
  "datetime": "2023-07-18",
  "username_encoded": "Z0FBQUFBQm5LakwweFRrRmpOM1MxMTJWdmEwbDJNNmtZOERBdVY1QVVPYVl4NkIzMGtjSzBUUTRSMjAtZXRtOG13cXFPVjBJdzUtY2pYNG96SGRkcHV2a0p2TXFiYk9UQkRabDgzS0V6dGVSZGJDUDhmVDM1X3c9",
  "url_encoded": "Z0FBQUFBQm5Lak9FRVBLOEU2OHFlR3hNS1FhczlQdU9UYUNUaUpXSUgtZTN4MlFVcUNuUzRyeFl1WmxoZWVFWURyV1JwYW1XUkdFYjZwZkE3RXJXZ2hnZDVlbkdkaUtfYnlXRlhsRGYxeXpYRmFVRHRQc3M4UUMtSUp6ZHhGNzJSOFBpZ2o2RnllSC14SmNoWm4yM3FNdUxwUDRSSm5JR293VHBXUWhmRWU0MGZVX3NWTVFVT09fQjlrSVNnUDFvUlZkUEEzLVJaS1h4TXo3dmoxb0pfbFY3dWdEQzEyQ3VKdz09"
}

Entry Information