Marek Wolan
d33c80d0d6
Minor fixes
2024-03-14 14:33:04 +00:00
Marek Wolan
c3f1cfb33d
Add shared reward
2024-03-11 22:53:39 +00:00
Marek Wolan
7599655879
Add agent action history
2024-03-11 20:10:08 +00:00
Marek Wolan
0447a05084
Add call validation
2024-03-08 15:57:43 +00:00
Marek Wolan
8589ce449a
Merged PR 295: Agent action logging
...
## Summary
Added a new optional capability to create a JSON log each episode with a list of action each agent took each step (including scripted, RL, and red agents).
Also I had to slightly refactor the IO system to not rely on PrimaiteSession, as it's gonna be deprecated soon. Therefore the IO module is now linked to the gym environment. Each time you init a gym environment, it creates a session directory.
## Test process
Tried the SB3, Ray SARL and Ray MARL notebooks to see that the outputs get generated.
## Checklist
- [x] PR is linked to a **work item**
- [x] **acceptance criteria** of linked ticket are met
- [x] performed **self-review** of the code
- [ ] written **tests** for any new functionality added with this PR
- [x] updated the **documentation** if this PR changes or adds functionality
- [ ] written/updated **design docs** if this PR implements new functionality
- [x] updated the **change log**
- [x] ran **pre-commit** checks for code style
- [x] attended to any **TO-DOs** left in the code
Move IO to environments from session and add agent logging
Related work items: #2278
2024-03-05 16:39:44 +00:00
Marek Wolan
a7bfc56b98
Apply documentation changes based on PR review.
2024-03-05 11:21:49 +00:00
Marek Wolan
758f892b74
Make notebook for varying red agent behaviour in uc2
2024-03-04 21:04:27 +00:00
Marek Wolan
2f456e7ae0
Move IO to environments from session and add agent logging
2024-03-04 18:47:50 +00:00
Marek Wolan
10a4053887
Fix tests
2024-03-01 15:14:00 +00:00
Marek Wolan
2f3e40fb6b
Fix issue around reset
2024-02-29 13:22:05 +00:00
Marek Wolan
a5043a8fbe
Modify tests based on refactoring
2024-02-26 12:15:53 +00:00
Marek Wolan
e5982c4599
Change agents list in game object to dictionary
2024-02-26 10:26:28 +00:00
Marek Wolan
994dbc3501
Finalise the refactor. It works well now.
2024-02-25 17:44:41 +00:00
Marek Wolan
64b9ba3ecf
Make environment reset reinstantiate the game
2024-02-20 16:21:03 +00:00
Marek Wolan
28acb5dcae
Populate step info in environment, and finish notebook
2024-01-25 12:04:09 +00:00
Marek Wolan
1505d08721
Fix backup issues and align with Yak
2024-01-10 18:04:48 +00:00
Marek Wolan
f75c10aafb
Make flattening observation spaces optional.
2024-01-05 13:10:49 +00:00
Marek Wolan
4266618ba5
Make pcap logs and sys logs optional
2024-01-05 11:25:57 +00:00
Marek Wolan
01b9e661ce
Clean up print statements.
2023-12-04 10:45:33 +00:00
Marek Wolan
a5c4f7797d
Make saving step metadata optional
2023-12-04 10:42:20 +00:00
Marek Wolan
8ea9db2d34
Merge remote-tracking branch 'origin/dev' into feature/2085-dump_describe_state
2023-12-04 10:38:41 +00:00
Marek Wolan
ba3d37316b
Apply suggestions from review
2023-12-04 09:21:47 +00:00
Chris McCarthy
cc04efb31d
#2085 - Added step metadata json file dumps to the environments. Fixed serialization issues in the Switch and ACLRule classes.
2023-12-01 16:37:58 +00:00
Chris McCarthy
32c13e06f6
Merge remote-tracking branch 'devops/bugfix/episode-length-and-rewards' into feature/2085-dump_describe_state
2023-12-01 15:58:32 +00:00
Chris McCarthy
008efa1e9d
Merge remote-tracking branch 'devops/bugfix/episode-length-and-rewards' into feature/2085-dump_describe_state
2023-12-01 15:55:22 +00:00
Marek Wolan
3e3fd89618
Minor string fix
2023-12-01 15:41:10 +00:00
Marek Wolan
eeedea2eff
Make more friendly user outputs when training SB3
2023-12-01 15:36:07 +00:00
Marek Wolan
321d1f7219
Fix rllib marl problems
2023-12-01 14:58:34 +00:00
Marek Wolan
3642e87eda
Remove distracting debug print statements
2023-12-01 11:07:57 +00:00
Nick Todd
a073038ec0
#2085 : Get enum value data
2023-12-01 09:52:31 +00:00
Nick Todd
5cd69f343f
#2085 : generate time based log files
2023-11-30 16:11:44 +00:00
Nick Todd
957702fa5d
#2085 : Remove JSON file handling
2023-11-29 10:10:23 +00:00
Chris McCarthy
c3bb78c5a3
Merge remote-tracking branch 'devops/feature/1859-red-agent-marek' into feature/1859-red-agent-marek
2023-11-27 13:50:41 +00:00
Chris McCarthy
4d4a578555
#1859 - Integrated the runtime execution for web client. Added in the webclient application execution action. Now fixing http status code issues.
2023-11-27 13:47:59 +00:00
Marek Wolan
43fee23600
Fix incorrect order in session from config
2023-11-27 11:55:58 +00:00
Marek Wolan
ece9b14d63
Resolve merge conflicts
2023-11-26 23:29:14 +00:00
