RL Toolbox: Combine Discrete and Continuous Observations
5 views (last 30 days)
Show older comments
Hi,
For my project, I am looking at combining discrete observations that one would create through "rlFiniteSetSpec" and continuous observations through "rlNumericSpec". Is there a way that I could make this work by combining them into one observation variable?
0 Comments
Answers (1)
Emmanouil Tzorakoleftherakis
on 18 Feb 2020
Does the environments output continuous and discrete observations? If yes, couldn't you use 'rlNumericSpec' for both? The discrete observations will already take values in a finite set as dictated by the environment. If not, I would probably do something along the lines of
ObservationInfo(1) = rlNumericSpec(...);
ObservationInfo(1).Name = 'continuous observations';
ObservationInfo(2) = rlFiniteSetSpec(...);
ObservationInfo(2).Name = 'discrete observations';
3 Comments
Maha Mosalam
on 31 Oct 2021
If any solutions found ?? I had the same problem , I want to combine both discrete and action spaces
See Also
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!