{
  "id": 410540,
  "title": "False Color Image",
  "url": "/competitions/google-research-identify-contrails-reduce-global-warming/discussion/410540",
  "author_name": "Kenni",
  "post_date": "2023-05-15T17:47:29.059000",
  "votes": 6,
  "comment_count": 7,
  "views": 0,
  "content": "<p>I was going through a couple of notebooks to understand the dataset and to find any hint. I was intrigued by the false color image generated using bands 11 -14. But I keep coming back to bands from 8-16. </p>\n<p>Is building a model using false color image viable or do we need to use all frames ? Any tips will be really helpful.</p>",
  "messages": [
    {
      "id": 2260531,
      "postDate": "2023-05-15T17:47:29.060Z",
      "content": "<p>I was going through a couple of notebooks to understand the dataset and to find any hint. I was intrigued by the false color image generated using bands 11 -14. But I keep coming back to bands from 8-16. </p>\n<p>Is building a model using false color image viable or do we need to use all frames ? Any tips will be really helpful.</p>",
      "rawMarkdown": "I was going through a couple of notebooks to understand the dataset and to find any hint. I was intrigued by the false color image generated using bands 11 -14. But I keep coming back to bands from 8-16. \n\nIs building a model using false color image viable or do we need to use all frames ? Any tips will be really helpful.",
      "votes": 5
    },
    {
      "id": 2260585,
      "postDate": "2023-05-15T18:31:14.347Z",
      "content": "<p>Hi Kenni,<br>\nI'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go…<br>\nI'm not very helpful here, just letting you know I'm in the same problematic.</p>",
      "rawMarkdown": "Hi Kenni,\nI'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go...\nI'm not very helpful here, just letting you know I'm in the same problematic.",
      "votes": 1,
      "replies": [
        {
          "id": 2260668,
          "postDate": "2023-05-15T19:39:19.767Z",
          "content": "<blockquote>\n  <p>Hi Kenni,<br>\n  I'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go…<br>\n  I'm not very helpful here, just letting you know I'm in the same problematic.</p>\n</blockquote>\n<p>Hey, i was checking out <code>human_pixel_masks.npy</code> file and found that it follows the shape (256, 256, 1). May its w.r.t a particular time stamp. Any thoughts on this ?</p>",
          "rawMarkdown": "> Hi Kenni,\n> I'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go...\n> I'm not very helpful here, just letting you know I'm in the same problematic.\n\nHey, i was checking out ```human_pixel_masks.npy``` file and found that it follows the shape (256, 256, 1). May its w.r.t a particular time stamp. Any thoughts on this ?",
          "replies": [
            {
              "id": 2260725,
              "postDate": "2023-05-15T20:21:43.807Z",
              "content": "<p>As mentioned in the data section: </p>\n<p>\"human_pixel_masks.npy: array with size of H x W x 1 x R. Each example is labeled by R individual human labelers. R is not the same for all samples. The labeled masks have value either 0 or 1 and correspond to the (n_times_before+1)-th image in band_{08-16}.npy. They are available only in the training set.\"</p>\n<p>It corresponds to the time stamp (n_times_before+1)</p>",
              "rawMarkdown": "As mentioned in the data section: \n\n\"human_pixel_masks.npy: array with size of H x W x 1 x R. Each example is labeled by R individual human labelers. R is not the same for all samples. The labeled masks have value either 0 or 1 and correspond to the (n_times_before+1)-th image in band_{08-16}.npy. They are available only in the training set.\"\n\nIt corresponds to the time stamp (n_times_before+1)",
              "votes": 1
            },
            {
              "id": 2260728,
              "postDate": "2023-05-15T20:23:23.170Z",
              "content": "<p>Just realized it when reading the data section again. Thank you so much !!</p>",
              "rawMarkdown": "Just realized it when reading the data section again. Thank you so much !!"
            },
            {
              "id": 2260729,
              "postDate": "2023-05-15T20:23:46.110Z",
              "content": "<p>I would say it's an artifact, cause I don't see the difference between (256,256) and (256,256,1) but I might be wrong.<br>\nConcerning the bands, I read the preprint (quite informative, actually) and they say that some bands are the difference between two other bands. My next move concerning this is to read the .json metadata file, to see if there's something to get from it. (dropping some bands might actually boost the training time)</p>",
              "rawMarkdown": "I would say it's an artifact, cause I don't see the difference between (256,256) and (256,256,1) but I might be wrong.\nConcerning the bands, I read the preprint (quite informative, actually) and they say that some bands are the difference between two other bands. My next move concerning this is to read the .json metadata file, to see if there's something to get from it. (dropping some bands might actually boost the training time)"
            },
            {
              "id": 2260733,
              "postDate": "2023-05-15T20:27:44.040Z",
              "content": "<p>So, Patchef, this just says that the mask, for all instances, corresponds to the 5th timeframe, am I correct ? (and I think you were mentioning the 'human_individual_mask.npy' file)</p>",
              "rawMarkdown": "So, Patchef, this just says that the mask, for all instances, corresponds to the 5th timeframe, am I correct ? (and I think you were mentioning the 'human_individual_mask.npy' file)"
            },
            {
              "id": 2260736,
              "postDate": "2023-05-15T20:32:42.630Z",
              "content": "<p>He is correct. Its the 5th frame a.k.a 4 since counting starts from 0. In <code>n_times_before+1</code> n_times_before is actually 4. Also, i found this ppt very helpful, do look into it. </p>\n<p><a href=\"https://storage.googleapis.com/goes_contrails_dataset/20230419/Contrail_Detection_Dataset_Instruction.pdf\" target=\"_blank\">https://storage.googleapis.com/goes_contrails_dataset/20230419/Contrail_Detection_Dataset_Instruction.pdf</a></p>",
              "rawMarkdown": "He is correct. Its the 5th frame a.k.a 4 since counting starts from 0. In ```n_times_before+1``` n_times_before is actually 4. Also, i found this ppt very helpful, do look into it. \n\nhttps://storage.googleapis.com/goes_contrails_dataset/20230419/Contrail_Detection_Dataset_Instruction.pdf",
              "votes": 1
            }
          ]
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 2260585,
      "author_name": "iceman273k",
      "author_url": "",
      "post_date": "2023-05-15T18:31:14.347000",
      "content": "<p>Hi Kenni,<br>\nI'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go…<br>\nI'm not very helpful here, just letting you know I'm in the same problematic.</p>",
      "votes": 1,
      "replies": [
        {
          "id": 2260668,
          "author_name": "Kenni",
          "author_url": "",
          "post_date": "2023-05-15T19:39:19.767000",
          "content": "<blockquote>\n  <p>Hi Kenni,<br>\n  I'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go…<br>\n  I'm not very helpful here, just letting you know I'm in the same problematic.</p>\n</blockquote>\n<p>Hey, i was checking out <code>human_pixel_masks.npy</code> file and found that it follows the shape (256, 256, 1). May its w.r.t a particular time stamp. Any thoughts on this ?</p>",
          "votes": 0,
          "replies": [
            {
              "id": 2260725,
              "author_name": "Patchef",
              "author_url": "",
              "post_date": "2023-05-15T20:21:43.807000",
              "content": "<p>As mentioned in the data section: </p>\n<p>\"human_pixel_masks.npy: array with size of H x W x 1 x R. Each example is labeled by R individual human labelers. R is not the same for all samples. The labeled masks have value either 0 or 1 and correspond to the (n_times_before+1)-th image in band_{08-16}.npy. They are available only in the training set.\"</p>\n<p>It corresponds to the time stamp (n_times_before+1)</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 2260728,
              "author_name": "Kenni",
              "author_url": "",
              "post_date": "2023-05-15T20:23:23.170000",
              "content": "<p>Just realized it when reading the data section again. Thank you so much !!</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2260729,
              "author_name": "iceman273k",
              "author_url": "",
              "post_date": "2023-05-15T20:23:46.110000",
              "content": "<p>I would say it's an artifact, cause I don't see the difference between (256,256) and (256,256,1) but I might be wrong.<br>\nConcerning the bands, I read the preprint (quite informative, actually) and they say that some bands are the difference between two other bands. My next move concerning this is to read the .json metadata file, to see if there's something to get from it. (dropping some bands might actually boost the training time)</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2260733,
              "author_name": "iceman273k",
              "author_url": "",
              "post_date": "2023-05-15T20:27:44.040000",
              "content": "<p>So, Patchef, this just says that the mask, for all instances, corresponds to the 5th timeframe, am I correct ? (and I think you were mentioning the 'human_individual_mask.npy' file)</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 2260736,
              "author_name": "Kenni",
              "author_url": "",
              "post_date": "2023-05-15T20:32:42.630000",
              "content": "<p>He is correct. Its the 5th frame a.k.a 4 since counting starts from 0. In <code>n_times_before+1</code> n_times_before is actually 4. Also, i found this ppt very helpful, do look into it. </p>\n<p><a href=\"https://storage.googleapis.com/goes_contrails_dataset/20230419/Contrail_Detection_Dataset_Instruction.pdf\" target=\"_blank\">https://storage.googleapis.com/goes_contrails_dataset/20230419/Contrail_Detection_Dataset_Instruction.pdf</a></p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2260531": "I was going through a couple of notebooks to understand the dataset and to find any hint. I was intrigued by the false color image generated using bands 11 -14. But I keep coming back to bands from 8-16. \n\nIs building a model using false color image viable or do we need to use all frames ? Any tips will be really helpful.",
    "2260585": "Hi Kenni,\nI'm actually asking myself the same question. In doubt, I'm going to go with all the bands (and the network will do its job), but as time is a (big) issue, maybe discarding some bands is the way to go...\nI'm not very helpful here, just letting you know I'm in the same problematic."
  }
}