{
  "id": 368366,
  "title": "Reverse engineering 20% of test samples with external data",
  "url": "/competitions/g2net-detecting-continuous-gravitational-waves/discussion/368366",
  "author_name": "Vladimir Slaykovskiy",
  "post_date": "2022-11-24T21:23:07.407000",
  "votes": 19,
  "comment_count": 0,
  "views": 0,
  "content": "<p><a href=\"https://www.kaggle.com/vslaykovsky/g2net-winning-strategy-with-external-data\" target=\"_blank\">In this notebook</a> I'm giving away a strategy that will likely give you an edge if implemented correctly. In short, it might be possible to reverse engineer the injected CW signal by using raw Ligo&amp;Virgo data.</p>\n<p><strong>TL;DR</strong></p>\n<ol>\n<li>Get raw detector data at <a href=\"https://www.gw-openscience.org/archive/O3a_4KHZ_R1/\" target=\"_blank\">https://www.gw-openscience.org/archive/O3a_4KHZ_R1/</a></li>\n<li>Generate SFTs using instructions at <a href=\"https://youtu.be/A9iWRcmG0Rs?t=2199\" target=\"_blank\">https://youtu.be/A9iWRcmG0Rs?t=2199</a> (you'll likely need to google for more details on this step). Use GPS timestamps from test set to produce SFTs.</li>\n<li>Read generated SFTs using pyfstat.utils.sft.get_sft_as_arrays</li>\n<li>Match generated SFTs with real samples from test set.</li>\n<li>Find the difference between SFTs and real samples. difference &gt; EPS -&gt; label==1; difference &lt;= EPS -&gt; label==0.</li>\n</ol>\n<p>This is clearly not the solution organizers had in mind, but it's completely legitimate according to the rules: <a href=\"https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules\" target=\"_blank\">https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules</a> </p>",
  "messages": [
    {
      "id": 2042667,
      "postDate": "2022-11-24T21:23:07.407Z",
      "content": "<p><a href=\"https://www.kaggle.com/vslaykovsky/g2net-winning-strategy-with-external-data\" target=\"_blank\">In this notebook</a> I'm giving away a strategy that will likely give you an edge if implemented correctly. In short, it might be possible to reverse engineer the injected CW signal by using raw Ligo&amp;Virgo data.</p>\n<p><strong>TL;DR</strong></p>\n<ol>\n<li>Get raw detector data at <a href=\"https://www.gw-openscience.org/archive/O3a_4KHZ_R1/\" target=\"_blank\">https://www.gw-openscience.org/archive/O3a_4KHZ_R1/</a></li>\n<li>Generate SFTs using instructions at <a href=\"https://youtu.be/A9iWRcmG0Rs?t=2199\" target=\"_blank\">https://youtu.be/A9iWRcmG0Rs?t=2199</a> (you'll likely need to google for more details on this step). Use GPS timestamps from test set to produce SFTs.</li>\n<li>Read generated SFTs using pyfstat.utils.sft.get_sft_as_arrays</li>\n<li>Match generated SFTs with real samples from test set.</li>\n<li>Find the difference between SFTs and real samples. difference &gt; EPS -&gt; label==1; difference &lt;= EPS -&gt; label==0.</li>\n</ol>\n<p>This is clearly not the solution organizers had in mind, but it's completely legitimate according to the rules: <a href=\"https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules\" target=\"_blank\">https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules</a> </p>",
      "rawMarkdown": "[In this notebook](https://www.kaggle.com/vslaykovsky/g2net-winning-strategy-with-external-data) I'm giving away a strategy that will likely give you an edge if implemented correctly. In short, it might be possible to reverse engineer the injected CW signal by using raw Ligo&Virgo data.\n\n**TL;DR**\n\n1. Get raw detector data at https://www.gw-openscience.org/archive/O3a_4KHZ_R1/\n2. Generate SFTs using instructions at https://youtu.be/A9iWRcmG0Rs?t=2199 (you'll likely need to google for more details on this step). Use GPS timestamps from test set to produce SFTs.\n3. Read generated SFTs using pyfstat.utils.sft.get_sft_as_arrays\n4. Match generated SFTs with real samples from test set.\n5. Find the difference between SFTs and real samples. difference > EPS -> label==1; difference <= EPS -> label==0.\n\nThis is clearly not the solution organizers had in mind, but it's completely legitimate according to the rules: https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules \n\n",
      "votes": 18
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2042667": "[In this notebook](https://www.kaggle.com/vslaykovsky/g2net-winning-strategy-with-external-data) I'm giving away a strategy that will likely give you an edge if implemented correctly. In short, it might be possible to reverse engineer the injected CW signal by using raw Ligo&Virgo data.\n\n**TL;DR**\n\n1. Get raw detector data at https://www.gw-openscience.org/archive/O3a_4KHZ_R1/\n2. Generate SFTs using instructions at https://youtu.be/A9iWRcmG0Rs?t=2199 (you'll likely need to google for more details on this step). Use GPS timestamps from test set to produce SFTs.\n3. Read generated SFTs using pyfstat.utils.sft.get_sft_as_arrays\n4. Match generated SFTs with real samples from test set.\n5. Find the difference between SFTs and real samples. difference > EPS -> label==1; difference <= EPS -> label==0.\n\nThis is clearly not the solution organizers had in mind, but it's completely legitimate according to the rules: https://www.kaggle.com/competitions/g2net-detecting-continuous-gravitational-waves/rules \n\n"
  }
}