oxbrbtx/PrimAITE
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

893 - updated the docs to reflect changes made to action space

Browse Source
This commit is contained in:
SunilSamra
2023-06-06 11:57:04 +01:00
parent 17d036302f
commit 8558ca1020
1 changed files with 23 additions and 12 deletions
Download Patch File Download Diff File Expand all files Collapse all files

15
docs/source/about.rst
View File

@@ -334,6 +334,8 @@ The full observation space would have 15 node-related elements and 3 link-relate
gym.spaces.MultiDiscrete([4,5,6,4,4,4,5,6,4,4,4,5,6,4,4,5,5,5]) gym.spaces.MultiDiscrete([4,5,6,4,4,4,5,6,4,4,4,5,6,4,4,5,5,5])
* Dictionary item {... ,1: [x1, x2, x3, x4, x5, x6] ...}
The placeholders inside the list under the key '1' mean the following:
Action Spaces Action Spaces
************** **************
@@ -342,12 +344,16 @@ The action space available to the blue agent comes in two types:
1. Node-based 1. Node-based
2. Access Control List 2. Access Control List
3. Any
The choice of action space used during a training session is determined in the config_[name].yaml file. The choice of action space used during a training session is determined in the config_[name].yaml file.
**Node-Based** **Node-Based**
The agent is able to influence the status of nodes by switching them off, resetting, or patching operating systems and services. In this instance, the action space is an OpenAI Gym multidiscrete type, as follows: The agent is able to influence the status of nodes by switching them off, resetting, or patching operating systems and services. In this instance, the action space is an OpenAI Gym spaces.Discrete type, as follows:
* Dictionary item {... ,1: [x1, x2, x3,x4] ...}
The placeholders inside the list under the key '1' mean the following:
* [0, num nodes] - Node ID (0 = nothing, node ID) * [0, num nodes] - Node ID (0 = nothing, node ID)
* [0, 4] - What property it's acting on (0 = nothing, 1 = state, 2 = SoftwareState, 3 = service state, 4 = file system state) * [0, 4] - What property it's acting on (0 = nothing, 1 = state, 2 = SoftwareState, 3 = service state, 4 = file system state)
@@ -356,7 +362,7 @@ The agent is able to influence the status of nodes by switching them off, resett
**Access Control List** **Access Control List**
The blue agent is able to influence the configuration of the Access Control List rule set (which implements a system-wide firewall). In this instance, the action space is an OpenAI multidiscrete type, as follows: The blue agent is able to influence the configuration of the Access Control List rule set (which implements a system-wide firewall). In this instance, the action space is an OpenAI spaces.Discrete type, as follows:
* [0, 2] - Action (0 = do nothing, 1 = create rule, 2 = delete rule) * [0, 2] - Action (0 = do nothing, 1 = create rule, 2 = delete rule)
@@ -366,6 +372,11 @@ The blue agent is able to influence the configuration of the Access Control List
* [0, num services] - Protocol (0 = any, then 1 -> x resolving to protocol) * [0, num services] - Protocol (0 = any, then 1 -> x resolving to protocol)
* [0, num ports] - Port (0 = any, then 1 -> x resolving to port) * [0, num ports] - Port (0 = any, then 1 -> x resolving to port)
**ANY**
The agent is able to carry out both **Node-Based** and **Access Control List** operations.
This means the dictionary will contain key-value pairs in the format of BOTH Node-Based and Access Control List as seen above.
Rewards Rewards
******* *******