This is merely a historical archive of years 2008-2021, before the migration to mailman3.
A maintained and still updated list archive can be found at https://lists.osmocom.org/hyperkitty/list/gerrit-log@lists.osmocom.org/.
pespin gerrit-no-reply at lists.osmocom.orgpespin has submitted this change. ( https://gerrit.osmocom.org/c/osmo-gsm-tester/+/17500 )
Change subject: doc/manuals: Introduce chapter explaining config data mangling
......................................................................
doc/manuals: Introduce chapter explaining config data mangling
Explains how configurations bits are arranged and mangled to provide a
last config set.
Change-Id: I5c8f136e743b6beb02956b3436aa3d1010205141
---
A doc/manuals/chapters/config_mangling.adoc
M doc/manuals/chapters/resource_pool.adoc
2 files changed, 338 insertions(+), 0 deletions(-)
Approvals:
Jenkins Builder: Verified
pespin: Looks good to me, approved
diff --git a/doc/manuals/chapters/config_mangling.adoc b/doc/manuals/chapters/config_mangling.adoc
new file mode 100644
index 0000000..310b15f
--- /dev/null
+++ b/doc/manuals/chapters/config_mangling.adoc
@@ -0,0 +1,334 @@
+
+* Data processing can be understood as operations on sets (link:https://duckduckgo.com/?q=Venn+diagram[Venn diagram])
+
+----
+$ src/osmo-gsm-tester.py "$TRIAL_JOB_DIR" -s 4g:srsenb-rftype at zmq+srsue-rftype@zmq+mod-enb-nprb at 6 -t ping.py
+----
+
+
+
+* First Suite and scenarios dictionaries ('resources', 'modifiers', 'config') are combined (set union operation):
+
+[cols="1,5a,5a,10a,10a"]
+.Manual replica of 'suite.py resource_requirements()' and 'resource_modifiers()' methods
+|===
+|File|original|after 'times' replication|python syntax|combined
+
+|4g
+|
+----
+run_node:
+- times: 1
+enb:
+- times: 1
+ type: srsenb
+modem:
+- times: 2
+ type: srsue
+----
+|
+----
+run_node:
+- {}
+enb:
+- type: srsenb
+modem:
+- type: srsue
+- type: srsue
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb'}],
+ 'modem': [{'type: 'srsue'},
+ {'type: 'srsue'}]
+}
+'modifiers': {}
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb'}],
+ 'modem': [{'type': 'srsue'},
+ {'type': 'srsue'}]
+
+}
+'modifiers': {}
+----
+|srsenb-rftype at zmq
+|
+----
+resources:
+ enb:
+ - type: srsenb
+ rf_dev_type: zmq
+----
+|
+----
+resources:
+ enb:
+ - type: srsenb
+ rf_dev_type: zmq
+----
+|
+----
+'resources': {
+ 'enb': [{'type': 'srsenb',
+ 'rf_dev_type': 'zmq'}]
+}
+'modifiers': {}
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb',
+ 'rf_dev_type': 'zmq'}],
+ 'modem': [{'type': 'srsue'},
+ {'type': 'srsue'}]
+}
+'modifiers': {}
+----
+|srsue-rftype at zmq
+|
+----
+resources:
+ modem:
+ - type: srsue
+ rf_dev_type: zmq
+ times: 1
+----
+|
+----
+resources:
+ modem:
+ - type: srsue
+ rf_dev_type: zmq
+----
+|
+----
+'resources': {
+ 'modem': [{'type': 'srsue',
+ 'rf_dev_type': 'zmq'}]
+}
+'modifiers': {}
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb',
+ 'rf_dev_type': 'zmq'}],
+ 'modem': [{'type': 'srsue',
+ 'rf_dev_type': 'zmq'},
+ {'type': 'srsue'}]
+}
+'modifiers': {}
+----
+|mod-enb-nprb at 6
+|
+----
+modifiers:
+ enb:
+ - num_prb: 6
+ times: 1
+----
+|
+----
+modifiers:
+ enb:
+ - num_prb: 6
+----
+|
+----
+'resources': {}
+'modifiers': {
+ 'enb': [{'num_prb': 6}]
+}
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb',
+ 'rf_dev_type': 'zmq'}],
+ 'modem': [{'type': 'srsue',
+ 'rf_dev_type': 'zmq'},
+ {'type': 'srsue'}]
+}
+'modifiers': {
+ 'enb': [{'num_prb': 6}]
+}
+----
+|===
+
+* Second, the resulting 'resources' set is used to match a set of resources from 'resources.list' in order to allocate them (intersection of sets):
+
+[cols="5a,5a,10a"]
+.Manual replica of 'resource.py reserve()' method
+|===
+|resources.conf|'resources' filters|matched
+
+|
+----
+run_node:
+- run_type: ssh
+ run_addr: 10.12.1.195
+ ssh_user: jenkins
+ ssh_addr: 10.12.1.195
+
+enb:
+- label: srsENB-zmq
+ type: srsenb
+ rf_dev_type: zmq
+ remote_user: jenkins
+ addr: 10.12.1.206
+
+- label: srsENB-B200
+ type: srsenb
+ rf_dev_type: UHD
+ rf_dev_args: "type=b200,serial=317B9FE"
+ remote_user: jenkins
+ addr: 10.12.1.206
+
+modem:
+- label: srsUE-zmq_1
+ type: srsue
+ rf_dev_type: zmq
+ remote_user: jenkins
+ addr: 10.12.1.195
+ imsi: '001010123456789'
+ ki: '001123'
+
+- label: srsUE-zq_2
+ type: srsue
+ rf_dev_type: zmq
+ remote_user: jenkins
+ addr: 10.12.1.180
+ imsi: '001010123456781'
+ ki: '001124'
+----
+|
+----
+'resources': {
+ 'run_node': [{}],
+ 'enb': [{'type': 'srsenb',
+ 'rf_dev_type': 'zmq'}],
+ 'modem': [
+ {'type': 'srsue',
+ 'rf_dev_type': 'zmq'},
+ {'type': 'srsue'}
+ ]
+}
+----
+|
+----
+'resources': {
+ 'run_node': [{'run_type': 'ssh',
+ 'run_addr': '10.12.1.195',
+ 'ssh_user': 'jenkins',
+ 'ssh_addr': '10.12.1.195'}],
+ 'enb': [{'label': 'srsENB-zmq',
+ 'type': 'srsenb',
+ 'rf_dev_type': 'zmq',
+ 'remote_user': 'jenkins',
+ 'addr': 10.12.1.206}],
+ 'modem': [
+ {'label': 'srsUE-zmq_1',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': '10.12.1.195',
+ 'imsi': '001010123456789'
+ 'ki': '001123',
+ 'rf_dev_type': 'zmq'},
+ {'label': 'srsUE-zmq_2',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': '10.12.1.180',
+ 'imsi': '001010123456781'
+ 'ki': '001124'}
+ ]
+}
+----
+|===
+
+* Finally, modifiers are applied on top of the combined configuration before
+ being passed to the python class managing it:
+
+[cols="5a,5a,10a"]
+.Also done by 'resource.py reserve()' method after matching resources
+|===
+|Matched resources|modifiers|Result
+
+|
+----
+'resources': {
+ 'run_node': [{'run_type': 'ssh',
+ 'run_addr': '10.12.1.195',
+ 'ssh_user': 'jenkins',
+ 'ssh_addr': '10.12.1.195'}],
+ 'enb': [{'label': 'srsENB-zmq',
+ 'type': 'srsenb',
+ 'rf_dev_type': 'zmq',
+ 'remote_user': 'jenkins',
+ 'addr': 10.12.1.206}],
+ 'modem': [
+ {'label': 'srsUE-zmq_1',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': '10.12.1.195',
+ 'imsi': '001010123456789'
+ 'ki': '001123',
+ 'rf_dev_type': 'zmq'},
+ {'label': 'srsUE-zmq_2',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': '10.12.1.180',
+ 'imsi': '001010123456781'
+ 'ki': '001124'}
+ ]
+}
+----
+|
+----
+'modifiers': {
+ 'enb': [{'num_prb': 6}]
+}
+----
+|
+----
+'resources': {
+ 'run_node': [{'run_type': 'ssh',
+ 'run_addr': '10.12.1.195',
+ 'ssh_user': 'jenkins',
+ 'ssh_addr': '10.12.1.195'}],
+ 'enb': [{'label': 'srsENB-zmq',
+ 'type': 'srsenb',
+ 'rf_dev_type': 'zmq',
+ 'remote_user': 'jenkins',
+ 'addr': '10.12.1.206',
+ 'num_prb': 6}],
+ 'modem': [
+ {'label': 'srsUE-zmq_1',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': 10.12.1.195,
+ 'imsi': '001010123456789'
+ 'ki': '001123',
+ 'rf_dev_type': 'zmq'},
+ {'label': 'srsUE-zmq_2',
+ 'type': 'srsue',
+ 'remote_user': jenkins,
+ 'addr': 10.12.1.180,
+ 'imsi': '001010123456781'
+ 'ki': '001124'}
+ ]
+}
+----
+|===
+
+WARNING: Right now algorithms based on lists of scalar/simple types being
+unordered vs complex types (dictionaries, list) being ordered. Other ways can be
+supported by explicitly using 'set' type from yaml in lists of scalars.
diff --git a/doc/manuals/chapters/resource_pool.adoc b/doc/manuals/chapters/resource_pool.adoc
index 4a56767..072f42d 100644
--- a/doc/manuals/chapters/resource_pool.adoc
+++ b/doc/manuals/chapters/resource_pool.adoc
@@ -105,3 +105,7 @@
If required resources are unavailable, the test trial fails. For consecutive
test trials, a test run needs to either wait for resources to become available,
or test suites need to be scheduled to make sense. (*<- TODO*)
+
+=== Understanding config parsing process
+
+include::{srcdir}/chapters/config_mangling.adoc[]
--
To view, visit https://gerrit.osmocom.org/c/osmo-gsm-tester/+/17500
To unsubscribe, or for help writing mail filters, visit https://gerrit.osmocom.org/settings
Gerrit-Project: osmo-gsm-tester
Gerrit-Branch: master
Gerrit-Change-Id: I5c8f136e743b6beb02956b3436aa3d1010205141
Gerrit-Change-Number: 17500
Gerrit-PatchSet: 1
Gerrit-Owner: pespin <pespin at sysmocom.de>
Gerrit-Reviewer: Jenkins Builder
Gerrit-Reviewer: pespin <pespin at sysmocom.de>
Gerrit-MessageType: merged
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osmocom.org/pipermail/gerrit-log/attachments/20200317/2d568382/attachment.htm>