Marek Wolan
954026d3e0
Comment out RLLib support
2023-07-31 12:13:52 +01:00
Chris McCarthy
0fb9268f44
#1711 - Fully Integrated the legacy training config and lay down config options into the CLI, run PrimaiteSession, and Agent classes. Made the ese test in test_full_legacy_config_session.py use this new integrated option to read the legacy file.
2023-07-28 13:49:26 +01:00
Chris McCarthy
7c843d3caa
#1711 - Added the ability to load legacy lay down config files. Added extensive unit testing and end-to-end testing. Also added the ability to set exactly how many num_train_steps, num_eval_steps, num_train_episodes, and num_eval_episode and used when converting a legacy training config.
2023-07-28 12:53:49 +01:00
Chris McCarthy
1dc23e11f2
#1648 - Updated file header from 'Crown Owned Copyright (C) Dstl 2023. DEFCON 703. Shared in confidence.' to '© Crown-owned copyright 2023, Defence Science and Technology Laboratory UK'
2023-07-21 14:54:09 +01:00
Chris McCarthy
534c066170
#1647 - Added _PrimaitePaths class that manages all the primaite locations using PlayformDirs. This class now creates new primaite locations for each version of primaite.
...
- Rolled the _PrimaitePaths class out throughout the code base.
- Updated the docs to reference the new version paths.
- Updated the author from qinetiq to dstl
- Bumped version number to 2.0.0rc2
2023-07-21 14:00:50 +01:00
Chris McCarthy
aaf1066d29
#1632 - Added full benchmarking script that included plots and a LaTeX report. Ran the v2.0.0rc1 benchmark. Tidied a few other things up.
2023-07-20 08:48:18 +01:00
Marek Wolan
652c9f1b90
Merge remote-tracking branch 'origin/dev' into feature/901-change-functionality-acl-rules
2023-07-18 10:55:31 +01:00
Marek Wolan
0d521bc96b
Remove redundant 'if TYPE_CHECKING' statements
2023-07-18 10:21:06 +01:00
Marek Wolan
471826e5ce
Merge branch 'dev' into feature/1623-typehints
2023-07-18 10:03:48 +01:00
Chris McCarthy
f4683f3b66
#1631 - Updated the copyright statement to comply with DEFCON 703 Edition 08/13
2023-07-17 19:57:34 +01:00
SunilSamra
cb4089a0ba
#901
...
- Removed bool apply_implicit_rule
- Set default implicit_rule to EXPLICIT DENY
- Added position to ACLs in laydown configs
- Removed apply_implicit_rule from training configs
2023-07-17 13:00:58 +01:00
SunilSamra
3e7f6cc98d
#901
...
- Added check in access_control_list.py which sets implicit permission to NA if boolean is False
- Changed the defaults in training_config.py so that each scenario has an EXPLICIT ALLOW rule as default implicit rule
- Updated the test_seeding_and_deterministic_session.py because of change no2 adds an extra rule to that scenario
2023-07-17 10:27:56 +01:00
Marek Wolan
98ac228f90
Fix types according to mypy
2023-07-14 16:38:55 +01:00
Marek Wolan
e522e56ff1
Add typehints
2023-07-14 14:43:47 +01:00
SunilSamra
4a0d688ae6
901 - fixed test_observation_space.py, added test fixture for test_seeding_and_deterministic_session.py and increased default max number of acls
2023-07-14 12:29:50 +01:00
SunilSamra
79d77c85c4
Merge remote-tracking branch 'origin/dev' into feature/901-change-functionality-acl-rules
2023-07-13 16:48:02 +01:00
Marek Wolan
4e4166d4d4
Continue Adding Typehints
2023-07-13 12:25:54 +01:00
SunilSamra
771061a218
901 - fixed test_single_action_space.py test
2023-07-13 11:45:23 +01:00
SunilSamra
ad4198da13
901 - changed acl current obs from list to numpy.array, changed default ACL list in training_config.py to FALSE, and tried to make test_seeding_and_deterministic_session.py test without fixed reward results
2023-07-13 11:04:11 +01:00
SunilSamra
e192d24800
Merge remote-tracking branch 'origin/dev' into feature/901-change-functionality-acl-rules
...
# Conflicts:
# src/primaite/acl/access_control_list.py
2023-07-12 10:45:03 +01:00
SunilSamra
6547789d5d
901 - changed implicit_acl_rule from str to enum name
2023-07-11 12:36:22 +01:00
SunilSamra
728ff01076
1566 - fixed the test_training_config.py test file by removing num_steps from init
2023-07-10 13:24:34 +01:00
Chris McCarthy
1ddfca6459
#1566 - Refactored the test_train_eval_episode_steps.py to sue TempPrimaiteSession.
...
- Fixed all errors that were caused b fixing the above.
- Some tests still fail, these are for SS to fix.
- Dropped the old run_generic stuff from conftest.py
2023-07-07 15:50:14 +01:00
SunilSamra
4902ccd2b4
Merge remote-tracking branch 'origin/dev' into feature/901-change-functionality-acl-rules
2023-07-07 15:14:05 +01:00
Chris McCarthy
8edb26a65c
Merge remote-tracking branch 'origin/dev' into 1566-configure-episode-steps-learn-eval
...
# Conflicts:
# src/primaite/agents/rllib.py
2023-07-07 14:34:20 +01:00
SunilSamra
79d98e977b
1566 - added test file and edited configs to include types of num steps and modifed agents to use correct step and episode counts
2023-07-07 14:13:47 +01:00
Marek Wolan
1d1f3f2403
Merge remote-tracking branch 'origin/dev' into feature/1572-fix-docs-formatting
2023-07-07 10:30:11 +01:00
Marek Wolan
5618283cc5
Standardise docstring summary line placement.
2023-07-07 10:28:00 +01:00
Czar Echavez
76997f403e
Merge branch 'dev' into feature/1386-enable-a-repeatable-or-deterministic-baseline-test
2023-07-06 22:22:37 +01:00
Marek Wolan
653d76ec62
Added docstrings to class intialisers
2023-07-06 16:08:51 +01:00
Marek Wolan
dd8593e489
Change reward to float and divide by 10000
2023-07-06 12:52:14 +01:00
Czar Echavez
0068092d8b
#1386 : remove unneeded configs + setting the seed globally + temp test
2023-07-05 15:02:41 +01:00
SunilSamra
35045f4842
901 - merged with dev
2023-07-05 11:34:15 +01:00
Marek Wolan
9244c160b1
Format docstrings
2023-07-04 11:11:52 +01:00
Czar Echavez
c7de7bf21b
Merge branch 'dev' into feature/1386-enable-a-repeatable-or-deterministic-baseline-test
2023-07-04 09:41:07 +01:00
Czar Echavez
409743dee9
Merge branch 'dev' into feature/1386-enable-a-repeatable-or-deterministic-baseline-test
2023-07-03 16:56:44 +01:00
Chris McCarthy
d55225dd41
Merge remote-tracking branch 'origin/dev' into feature/917_Integrate_with_RLLib
...
# Conflicts:
# src/primaite/config/_package_data/training/training_config_main.yaml
# src/primaite/environment/primaite_env.py
2023-07-03 15:07:09 +01:00
Czar Echavez
befd183b2c
#1522 : refactor red_agent_identifier -> random_red_agent so that it is a boolean + documentation
2023-07-03 12:18:58 +01:00
Chris McCarthy
06d5004695
#917 - Dropped VerboseLevel in enums.py and changed OutputVerboseLevel to SB3OutputVerboseLevel
2023-06-30 17:09:50 +01:00
Chris McCarthy
e11fd2ced4
#917 - Fixed the RLlib integration
...
- Dropped support for overriding the num_episodes and num_steps at the agent level. It's just not needed and will add complexity when overriding and writing output files.
2023-06-30 16:52:57 +01:00
Chris McCarthy
7b1f889415
#917 - Integrated the PrimaiteSession into all tests.
...
- Ran a full pre-commit hook and thus encountered tons of fixes required
2023-06-30 09:08:13 +01:00
Chris McCarthy
a9ebfd7917
#917 - Synced with dev and added better logging
2023-06-28 12:01:01 +01:00
Chris McCarthy
edab1a393d
Merge remote-tracking branch 'origin/dev' into feature/917_Integrate_with_RLLib
...
# Conflicts:
# src/primaite/config/training_config.py
# src/primaite/main.py
2023-06-28 10:11:03 +01:00
Marek Wolan
beae1e5c4f
Cosmetic changes to satisfy pre-commit
2023-06-27 13:06:10 +01:00
Czar Echavez
2e2b098a3c
#1386 : Apply suggestions from code review - make seed an optional variable
2023-06-23 07:57:31 +00:00
Brian Kanyora
57315a6789
feature\1522:
...
Create random red agent behaviour.
2023-06-22 15:34:13 +01:00
Chris McCarthy
7b0f47d6f8
#917 -Finished integrating all agents to either train (policy agents) or evaluate (hard-coded agents). Still some fixing up to do, tidying up, loading etc. also docs. But this is all now working.
2023-06-20 16:06:55 +01:00
SunilSamra
9c17b54073
901 - changed ACL instantiation and changed acl t private _acl (list not dict) attribute, added laydown_ACL.yaml for testing, fixed encoding of acl rules to integers for obs space, added ACL position to node action space and added generic test where agents adds two ACL rules.
2023-06-20 11:47:20 +01:00
Czar Echavez
99399cbda6
#1386 : added documentation + dealing with pre-commit checks
2023-06-20 11:19:05 +01:00
Czar Echavez
9fb30ffe1b
#1386 : added the ability to set deterministic and seeding RNG when training and evaluating + the fix provided in #1535
2023-06-20 10:41:30 +01:00