42 lines
1.9 KiB
ReStructuredText
42 lines
1.9 KiB
ReStructuredText
.. _results:
|
|
|
|
Results, Output and Logging from PrimAITE
|
|
=========================================
|
|
|
|
PrimAITE produces four types of data:
|
|
|
|
* Outputs - Results
|
|
* Outputs - Diagrams
|
|
* Outputs - Saved agents
|
|
* Logging
|
|
|
|
Outputs can be found in the *[Install Directory]\\PRIMAITE\\PRIMAITE\\outputs* directory
|
|
|
|
Logging can be found in the *[Install Directory]\\PRIMAITE\\PRIMAITE\\logs* directory
|
|
|
|
**Outputs - Results**
|
|
|
|
PrimAITE automatically creates two sets of results from each training session, and stores them in the *Results* folder:
|
|
|
|
* Average reward per episode - a csv file listing the average reward for each episode of the training session. This provides an indication of the change, over a training session, of the reward value
|
|
* All transactions - a csv file listing the following values for every step of every episode:
|
|
|
|
* Timestamp
|
|
* Episode number
|
|
* Step number
|
|
* Initial observation space (before red and blue agent actions have been taken). Individual elements of the observation space are presented in the format OSI_X_Y
|
|
* Resulting observation space (after the red and blue agent actions have been taken) Individual elements of the observation space are presented in the format OSN_X_Y
|
|
* Reward value
|
|
* Action space (as presented by the blue agent on this step). Individual elements of the action space are presented in the format AS_X
|
|
|
|
**Outputs - Diagrams**
|
|
|
|
For each training run, PrimAITE automatically creates a visual of the system / network laydown configuration, and stores it in the *Diagrams* folder.
|
|
|
|
**Outputs - Saved agents**
|
|
|
|
For each training run, assuming the agent being trained implements the *save()* function and this function is called by the code, PrimAITE automatically saves the agent state and stores it in the *agents* folder.
|
|
|
|
**Logging**
|
|
|
|
PrimAITE also provides output logs (for diagnosis) using the Python Logging package. These can be found in the *[Install Directory]\\PRIMAITE\\PRIMAITE\\logs* directory |