Row 7722

Row ID: 7722 | Dataset Entry | Axioma AXP Content Repository

Content Data

This page contains data entry 7722 from the Axioma AXP content repository. The structured data below represents the complete record for this entry.

Hello everyone,

I am currently researching the topic of using ML algorithms for Rate Adaptation (RAA) in wireless networks, specifically 802.11ax. My research objective is to demonstrate the capability and effectiveness of ML algorithms (in this case DQN) and how they are able to surpass conventional algorithms like Minstrel or Ideal in throughput.

To do this research, I am using Network Simulator 3 (NS3) as the main training and testing environment for the DQN algorithm. Then, to solve the problem of communicating between Python and NS3 (written in C++), I am using the [ns3-ai](https://github.com/hust-diangroup/ns3-ai/tree/main) module, which utilizes a shared memory pool approach to this situation.

The main problem I am encountering is the lack of implementation code anywhere on the internet on this specific topic. I have gone through a few research papers like "[ns3-ai: Rate Control for Wireless LAN by Deep Q-Network](https://www.ieice.org/publications/proceedings/bin/pdf_link.php?fname=06_SS1-6_(16).pdf&iconf=SISA&year=2022&vol=69&number=SS1-6&lang=E)", "[NS3-AI: Enable Applying Artificial Intelligence to Network Simulation in ns-3](https://www.researchgate.net/publication/341989036_ns3-ai_Fostering_Artificial_Intelligence_Algorithms_for_Networking_Research)", and "[Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks](https://www.researchgate.net/publication/348620562_Rate_Adaptation_with_Q-Learning_in_CSMACA_Wireless_Networks)". While they did give me valuable insights, they never go in depth about how exactly the code was written.

So, my questions is, how would I go upon using DQN in NS3 and ns3-ai? How would I observe the states and perform actions in NS3? Given that it is not the typical gymnasium environment where the environment kind of "accepts" actions.

Here is what I have tried.

* I have tried to understand/reverse-engineer the sample code provided * I have read through their tutorial, but it only describes a simple scenario of sending data back and forth between Python and C++, disregarding the NS3 simulation environment. * The creator says that there is skeleton code but I can't find it.

I would highly appreciate any help I get!

FieldValue
text Hello everyone, I am currently researching the topic of using ML algorithms for Rate Adaptation (RAA) in wireless networks, specifically 802.11ax. My research objective is to demonstrate the capability and effectiveness of ML algorithms (in this case DQN) and how they are able to surpass conventional algorithms like Minstrel or Ideal in throughput. To do this research, I am using Network Simulator 3 (NS3) as the main training and testing environment for the DQN algorithm. Then, to solve the pr…
label r/machinelearning
dataType post
communityName r/MachineLearning
datetime 2024-05-17
username_encoded Z0FBQUFBQm5LakwzUTl0clEyNWw0OU1lUzluU1o5RHN6cVdDWWJxY3ZzbFJ1S1c0cm9jeTJ3dXVqYW1FM0FmaGlsdmRpbTFJZy1kaFp5YmxIUVFTQjAxSjlOcjFyVzBjQ0E9PQ==
url_encoded Z0FBQUFBQm5Lak9IdVdRNkt3WFdWMTVBMldSWlA0dnRVUTEtOURBcTgzZUtBQ3p3QkE4dUc0U0E4clhuUG80R1FVWl9fS3ExQUhmel9SWkV6ZXBVem5XR0ltc19mcXB3VmhsWXNJcGpGYjhhSG4zZ045Q1VkMDN4RmNoUDZNNUMyWXVsSERUdmNBWjNQN0JfcHFjeHNCS2JtRXNjMlFseUR0UVNiaE5pVFhySVp1QjBfcmZhX2FlMXVnRjR0RERkSnhRSEVONzlkVFpaUmJxNkpsX01lZThLbzdCOEJjWEUwdz09

Raw Record

{
  "text": "Hello everyone,\n\nI am currently researching the topic of using ML algorithms for Rate Adaptation (RAA) in wireless networks, specifically 802.11ax. My research objective is to demonstrate the capability and effectiveness of ML algorithms (in this case DQN) and how they are able to surpass conventional algorithms like Minstrel or Ideal in throughput.\n\nTo do this research, I am using Network Simulator 3 (NS3) as the main training and testing environment for the DQN algorithm. Then, to solve the problem of communicating between Python and NS3 (written in C++), I am using the [ns3-ai](https://github.com/hust-diangroup/ns3-ai/tree/main) module, which utilizes a shared memory pool approach to this situation.\n\nThe main problem I am encountering is the lack of implementation code anywhere on the internet on this specific topic. I have gone through a few research papers like \"[ns3-ai: Rate Control for Wireless LAN by Deep Q-Network](https://www.ieice.org/publications/proceedings/bin/pdf_link.php?fname=06_SS1-6_(16).pdf&iconf=SISA&year=2022&vol=69&number=SS1-6&lang=E)\", \"[NS3-AI: Enable Applying Artificial Intelligence to Network Simulation in ns-3](https://www.researchgate.net/publication/341989036_ns3-ai_Fostering_Artificial_Intelligence_Algorithms_for_Networking_Research)\", and \"[Rate Adaptation with Q-Learning in CSMA/CA Wireless Networks](https://www.researchgate.net/publication/348620562_Rate_Adaptation_with_Q-Learning_in_CSMACA_Wireless_Networks)\". While they did give me valuable insights, they never go in depth about how exactly the code was written.\n\nSo, my questions is, how would I go upon using DQN in NS3 and ns3-ai? How would I observe the states and perform actions in NS3? Given that it is not the typical gymnasium environment where the environment kind of \"accepts\" actions.\n\nHere is what I have tried.\n\n* I have tried to understand/reverse-engineer the sample code provided\n* I have read through their tutorial, but it only describes a simple scenario of sending data back and forth between Python and C++, disregarding the NS3 simulation environment.\n* The creator says that there is skeleton code but I can't find it.\n\nI would highly appreciate any help I get!",
  "label": "r/machinelearning",
  "dataType": "post",
  "communityName": "r/MachineLearning",
  "datetime": "2024-05-17",
  "username_encoded": "Z0FBQUFBQm5LakwzUTl0clEyNWw0OU1lUzluU1o5RHN6cVdDWWJxY3ZzbFJ1S1c0cm9jeTJ3dXVqYW1FM0FmaGlsdmRpbTFJZy1kaFp5YmxIUVFTQjAxSjlOcjFyVzBjQ0E9PQ==",
  "url_encoded": "Z0FBQUFBQm5Lak9IdVdRNkt3WFdWMTVBMldSWlA0dnRVUTEtOURBcTgzZUtBQ3p3QkE4dUc0U0E4clhuUG80R1FVWl9fS3ExQUhmel9SWkV6ZXBVem5XR0ltc19mcXB3VmhsWXNJcGpGYjhhSG4zZ045Q1VkMDN4RmNoUDZNNUMyWXVsSERUdmNBWjNQN0JfcHFjeHNCS2JtRXNjMlFseUR0UVNiaE5pVFhySVp1QjBfcmZhX2FlMXVnRjR0RERkSnhRSEVONzlkVFpaUmJxNkpsX01lZThLbzdCOEJjWEUwdz09"
}

Entry Information