Marek Wolan
a5c4f7797d
Make saving step metadata optional
2023-12-04 10:42:20 +00:00
Marek Wolan
eeedea2eff
Make more friendly user outputs when training SB3
2023-12-01 15:36:07 +00:00
Marek Wolan
321d1f7219
Fix rllib marl problems
2023-12-01 14:58:34 +00:00
Chris McCarthy
4d4a578555
#1859 - Integrated the runtime execution for web client. Added in the webclient application execution action. Now fixing http status code issues.
2023-11-27 13:47:59 +00:00
Marek Wolan
84bd9b1bff
Merge remote-tracking branch 'origin/dev' into feature/1859-red-agent-marek
2023-11-26 23:45:10 +00:00
Marek Wolan
ece9b14d63
Resolve merge conflicts
2023-11-26 23:29:14 +00:00
Marek Wolan
e609f8eb50
Fix misconfiguration in uc2 config and session
2023-11-24 14:56:17 +00:00
Jake Walker
ff8b773c10
Database Manipulation Bot bug fixes
2023-11-24 11:10:34 +00:00
Jake Walker
4e104a4d99
Update data manipulation bot
2023-11-24 10:33:19 +00:00
Jake Walker
b13a9d3daf
Add application execution action for data manipulation bot
2023-11-24 09:25:55 +00:00
Jake Walker
5f1a5af1b4
Add data manipulation bot action manager
2023-11-23 16:06:19 +00:00
Jake Walker
c93705867f
Move configuration from agent to data manipulation bot
2023-11-23 15:53:47 +00:00
Marek Wolan
1fd5298fc5
Fix multi agent system
2023-11-22 20:22:34 +00:00
Marek Wolan
1138644a4b
Update to make things work with new layout
2023-11-22 12:59:33 +00:00
Marek Wolan
afd64e4674
Separate game, environment, and session
2023-11-22 11:59:25 +00:00
Jake Walker
7e0e8a4768
Pass agent settings from config to agent
2023-11-20 10:38:01 +00:00
Marek Wolan
66d5612e92
Merge remote-tracking branch 'origin/feature/1972-remove-sqlite' into feature/1971-ray-agents-2
2023-11-18 04:54:17 +00:00
Marek Wolan
7d800cbbc9
Merge remote-tracking branch 'origin/dev' into feature/1972-remove-sqlite
2023-11-18 03:41:22 +00:00
Marek Wolan
77f3806ba7
Remove real database in favour of simulated
2023-11-18 03:40:08 +00:00
Marek Wolan
3fb7bce3ce
Get RLLib to stop crashing.
2023-11-17 17:57:57 +00:00
Marek Wolan
829500a60f
Get sb3 checkpoints saving during training
2023-11-16 14:37:37 +00:00
Jake Walker
1c5ff66d26
Pass execution definition from config to agent
2023-11-16 13:26:30 +00:00
Marek Wolan
6182b53bfd
Fix incorrect number of steps per episode
2023-11-15 14:49:44 +00:00
Marek Wolan
c8f2f193bd
Implement agent training with sb3
2023-11-15 12:52:18 +00:00
Marek Wolan
e6ead6e532
Update agent interface to work better with envs
2023-11-14 15:10:07 +00:00
Marek Wolan
1cb54da2dd
Remove more GATE stuff
2023-11-13 17:12:50 +00:00
Marek Wolan
b81c1739f8
Fix CLI and Session to work with new classes
2023-10-27 14:26:52 +01:00
Marek Wolan
d4eb499729
Start fixing up cli and setup
2023-10-27 12:20:23 +01:00
Marek Wolan
f861b1897a
Remove deprecated code from v2
2023-10-25 13:36:55 +01:00
Marek Wolan
954026d3e0
Comment out RLLib support
2023-07-31 12:13:52 +01:00
Chris McCarthy
0fb9268f44
#1711 - Fully Integrated the legacy training config and lay down config options into the CLI, run PrimaiteSession, and Agent classes. Made the ese test in test_full_legacy_config_session.py use this new integrated option to read the legacy file.
2023-07-28 13:49:26 +01:00
Chris McCarthy
7c843d3caa
#1711 - Added the ability to load legacy lay down config files. Added extensive unit testing and end-to-end testing. Also added the ability to set exactly how many num_train_steps, num_eval_steps, num_train_episodes, and num_eval_episode and used when converting a legacy training config.
2023-07-28 12:53:49 +01:00
Chris McCarthy
1dc23e11f2
#1648 - Updated file header from 'Crown Owned Copyright (C) Dstl 2023. DEFCON 703. Shared in confidence.' to '© Crown-owned copyright 2023, Defence Science and Technology Laboratory UK'
2023-07-21 14:54:09 +01:00
Chris McCarthy
534c066170
#1647 - Added _PrimaitePaths class that manages all the primaite locations using PlayformDirs. This class now creates new primaite locations for each version of primaite.
...
- Rolled the _PrimaitePaths class out throughout the code base.
- Updated the docs to reference the new version paths.
- Updated the author from qinetiq to dstl
- Bumped version number to 2.0.0rc2
2023-07-21 14:00:50 +01:00
Chris McCarthy
aaf1066d29
#1632 - Added full benchmarking script that included plots and a LaTeX report. Ran the v2.0.0rc1 benchmark. Tidied a few other things up.
2023-07-20 08:48:18 +01:00
Marek Wolan
652c9f1b90
Merge remote-tracking branch 'origin/dev' into feature/901-change-functionality-acl-rules
2023-07-18 10:55:31 +01:00
Marek Wolan
0d521bc96b
Remove redundant 'if TYPE_CHECKING' statements
2023-07-18 10:21:06 +01:00
Marek Wolan
471826e5ce
Merge branch 'dev' into feature/1623-typehints
2023-07-18 10:03:48 +01:00
Chris McCarthy
f4683f3b66
#1631 - Updated the copyright statement to comply with DEFCON 703 Edition 08/13
2023-07-17 19:57:34 +01:00
Chris McCarthy
678f953ced
#1631 - Added the DEFCON 703 header to all possible files
2023-07-17 19:28:43 +01:00
SunilSamra
00d01157da
#901 - Changed num_eval_steps back to 1 in ppo_seeded_training_config.yaml
2023-07-17 15:54:15 +01:00
SunilSamra
cb4089a0ba
#901
...
- Removed bool apply_implicit_rule
- Set default implicit_rule to EXPLICIT DENY
- Added position to ACLs in laydown configs
- Removed apply_implicit_rule from training configs
2023-07-17 13:00:58 +01:00
SunilSamra
3e7f6cc98d
#901
...
- Added check in access_control_list.py which sets implicit permission to NA if boolean is False
- Changed the defaults in training_config.py so that each scenario has an EXPLICIT ALLOW rule as default implicit rule
- Updated the test_seeding_and_deterministic_session.py because of change no2 adds an extra rule to that scenario
2023-07-17 10:27:56 +01:00
SunilSamra
ab45c7e3f9
#901 - added to config.rst and added new ACL main config options
2023-07-17 10:08:12 +01:00
Marek Wolan
98ac228f90
Fix types according to mypy
2023-07-14 16:38:55 +01:00
SunilSamra
b4f8514206
#901 - amended comment in training_config_main.yaml
2023-07-14 15:49:18 +01:00
Marek Wolan
e522e56ff1
Add typehints
2023-07-14 14:43:47 +01:00
Chris McCarthy
8c0ca8cfbc
#901 - Dropped temp_primaite_sessiion_2 from conftest.py.
...
- Re-added the hard-coded mean rewards per episode values from a rpe-trained agent to the deterministic test in test_seeding_and_deterministic_session.py
- Partially tidies up some tests in test_observation_space.py; Still some work to be done on this at a later date.
2023-07-14 14:13:11 +01:00
SunilSamra
4a0d688ae6
901 - fixed test_observation_space.py, added test fixture for test_seeding_and_deterministic_session.py and increased default max number of acls
2023-07-14 12:29:50 +01:00
SunilSamra
0bcaf0696d
901 - removed print statements and merged with dev
2023-07-13 17:14:59 +01:00