16338876bSHarrison MutaiRuntime Instrumentation Testing - N1SDP 26338876bSHarrison Mutai======================================= 36338876bSHarrison Mutai 46338876bSHarrison MutaiFor this test we used the N1 System Development Platform (`N1SDP`_), which 56338876bSHarrison Mutaicontains an SoC consisting of two dual-core Arm N1 clusters. 66338876bSHarrison Mutai 79b65ffefSBoyan KaratotevThe following source trees were used: 86338876bSHarrison Mutai 9*08e6f24bSBoyan Karatotev- `TF-A v2.13-rc0`_ 10*08e6f24bSBoyan Karatotev- `TFTF v2.13-rc0`_ 116338876bSHarrison Mutai 125fdf198cSThaddeus SernaPlease see the Runtime Instrumentation :ref:`Testing Methodology 139b65ffefSBoyan Karatotev<Runtime Instrumentation Methodology>` page for more details. The tests were ran 149b65ffefSBoyan Karatotevusing the 159b65ffefSBoyan Karatotev`tf-psci-lava-instr/n1sdp-runtime-instrumentation,n1sdp-runtime-instrumentation:n1sdp-fip.tftf-firmware` 169b65ffefSBoyan Karatotevconfiguration in CI. 176338876bSHarrison Mutai 186338876bSHarrison MutaiResults 196338876bSHarrison Mutai------- 206338876bSHarrison Mutai 216338876bSHarrison Mutai``CPU_SUSPEND`` to deepest power level 226338876bSHarrison Mutai~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 236338876bSHarrison Mutai 24*08e6f24bSBoyan Karatotev.. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.13) 25*08e6f24bSBoyan Karatotev 26*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 27*08e6f24bSBoyan Karatotev | Cluster | Core | Powerdown | Wakeup | Cache Flush | 28*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 29*08e6f24bSBoyan Karatotev | 0 | 0 | 3.32 | 13.42 (-45.40%) | 0.28 (-69.57%) | 30*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 31*08e6f24bSBoyan Karatotev | 0 | 0 | 4.02 (-35.78%) | 18.14 (-52.88%) | 0.28 | 32*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 33*08e6f24bSBoyan Karatotev | 1 | 0 | 2.7 (-27.42%) | 17.38 (-49.36%) | 0.26 | 34*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 35*08e6f24bSBoyan Karatotev | 1 | 0 | 2.96 | 10.86 (-73.64%) | 0.26 | 36*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 37*08e6f24bSBoyan Karatotev 38012cc2cbSZachary Leaf.. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in parallel (v2.12) 39012cc2cbSZachary Leaf 40012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 41012cc2cbSZachary Leaf | Cluster | Core | Powerdown | Wakeup | Cache Flush | 42012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 43012cc2cbSZachary Leaf | 0 | 0 | 2.58 | 24.14 | 0.28 (-69.57%) | 44012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 45012cc2cbSZachary Leaf | 0 | 0 | 4.24 (-32.27%) | 40.1 | 0.3 | 46012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 47012cc2cbSZachary Leaf | 1 | 0 | 3.58 | 35.54 | 0.28 | 48012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 49012cc2cbSZachary Leaf | 1 | 0 | 3.28 | 42.36 | 0.3 | 50012cc2cbSZachary Leaf +---------+------+----------------+--------+----------------+ 51012cc2cbSZachary Leaf 52*08e6f24bSBoyan Karatotev.. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.13) 536338876bSHarrison Mutai 54*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 55fe7d06a6SHarrison Mutai | Cluster | Core | Powerdown | Wakeup | Cache Flush | 56*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 57*08e6f24bSBoyan Karatotev | 0 | 0 | 1.62 | 10.14 (-58.10%) | 0.3 | 58*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 59*08e6f24bSBoyan Karatotev | 0 | 0 | 1.86 | 10.62 (-56.44%) | 0.28 (-26.32%) | 60*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 61*08e6f24bSBoyan Karatotev | 1 | 0 | 1.8 | 10.16 (-57.84%) | 0.32 | 62*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 63*08e6f24bSBoyan Karatotev | 1 | 0 | 2.16 | 10.6 (-56.84%) | 0.5 (+56.25%) | 64*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+----------------+ 656338876bSHarrison Mutai 66012cc2cbSZachary Leaf.. table:: ``CPU_SUSPEND`` latencies (µs) to deepest power level in serial (v2.12) 676338876bSHarrison Mutai 68012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 69fe7d06a6SHarrison Mutai | Cluster | Core | Powerdown | Wakeup | Cache Flush | 70012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 71012cc2cbSZachary Leaf | 0 | 0 | 1.9 | 23.8 | 0.36 | 72012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 73012cc2cbSZachary Leaf | 0 | 0 | 2.26 | 23.86 | 0.34 | 74012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 75012cc2cbSZachary Leaf | 1 | 0 | 2.02 | 23.4 | 0.36 | 76012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 77012cc2cbSZachary Leaf | 1 | 0 | 2.24 | 23.84 | 0.36 | 78012cc2cbSZachary Leaf +---------+------+-----------+--------+-------------+ 79fe7d06a6SHarrison Mutai 806338876bSHarrison Mutai``CPU_SUSPEND`` to power level 0 816338876bSHarrison Mutai~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 826338876bSHarrison Mutai 83*08e6f24bSBoyan Karatotev.. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.13) 84*08e6f24bSBoyan Karatotev 85*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 86*08e6f24bSBoyan Karatotev | Cluster | Core | Powerdown | Wakeup | Cache Flush | 87*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 88*08e6f24bSBoyan Karatotev | 0 | 0 | 0.8 (-57.45%) | 11.98 (-61.75%) | 0.26 | 89*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 90*08e6f24bSBoyan Karatotev | 0 | 0 | 1.54 (-30.63%) | 16.44 (-53.74%) | 0.26 | 91*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 92*08e6f24bSBoyan Karatotev | 1 | 0 | 1.62 (-30.77%) | 16.1 (-53.92%) | 0.3 | 93*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 94*08e6f24bSBoyan Karatotev | 1 | 0 | 1.8 | 10.54 (-55.30%) | 0.2 (-33.33%) | 95*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+---------------+ 96*08e6f24bSBoyan Karatotev 97012cc2cbSZachary Leaf.. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in parallel (v2.12) 98012cc2cbSZachary Leaf 99012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 100012cc2cbSZachary Leaf | Cluster | Core | Powerdown | Wakeup | Cache Flush | 101012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 102012cc2cbSZachary Leaf | 0 | 0 | 1.46 | 31.7 | 0.32 | 103012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 104012cc2cbSZachary Leaf | 0 | 0 | 2.06 | 35.5 | 0.48 (+60.00%) | 105012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 106012cc2cbSZachary Leaf | 1 | 0 | 1.96 | 35.7 | 0.32 | 107012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 108012cc2cbSZachary Leaf | 1 | 0 | 2.08 | 23.38 | 0.28 | 109012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 110012cc2cbSZachary Leaf 111*08e6f24bSBoyan Karatotev.. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.13) 1126338876bSHarrison Mutai 113*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 114fe7d06a6SHarrison Mutai | Cluster | Core | Powerdown | Wakeup | Cache Flush | 115*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 116*08e6f24bSBoyan Karatotev | 0 | 0 | 1.44 | 9.9 (-58.05%) | 0.3 | 117*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 118*08e6f24bSBoyan Karatotev | 0 | 0 | 1.74 (-25.64%) | 10.4 (-56.23%) | 0.28 (-33.33%) | 119*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 120*08e6f24bSBoyan Karatotev | 1 | 0 | 1.8 | 10.04 (-57.71%) | 0.34 | 121*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 122*08e6f24bSBoyan Karatotev | 1 | 0 | 1.96 | 10.46 (-56.23%) | 0.44 | 123*08e6f24bSBoyan Karatotev +---------+------+----------------+-----------------+----------------+ 1246338876bSHarrison Mutai 125012cc2cbSZachary Leaf.. table:: ``CPU_SUSPEND`` latencies (µs) to power level 0 in serial (v2.12) 1266338876bSHarrison Mutai 127012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 128fe7d06a6SHarrison Mutai | Cluster | Core | Powerdown | Wakeup | Cache Flush | 129012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 130012cc2cbSZachary Leaf | 0 | 0 | 1.66 | 23.22 | 0.36 | 131012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 132012cc2cbSZachary Leaf | 0 | 0 | 2.58 | 23.72 | 0.78 (+85.71%) | 133012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 134012cc2cbSZachary Leaf | 1 | 0 | 2.02 | 23.84 | 0.38 | 135012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 136012cc2cbSZachary Leaf | 1 | 0 | 2.16 | 23.92 | 0.34 | 137012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 138fe7d06a6SHarrison Mutai 1396338876bSHarrison Mutai``CPU_OFF`` on all non-lead CPUs 1406338876bSHarrison Mutai~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 1416338876bSHarrison Mutai 1426338876bSHarrison Mutai``CPU_OFF`` on all non-lead CPUs in sequence then, ``CPU_SUSPEND`` on the lead 1436338876bSHarrison Mutaicore to the deepest power level. 1446338876bSHarrison Mutai 145*08e6f24bSBoyan Karatotev.. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.13) 146*08e6f24bSBoyan Karatotev 147*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 148*08e6f24bSBoyan Karatotev | Cluster | Core | Powerdown | Wakeup | Cache Flush | 149*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 150*08e6f24bSBoyan Karatotev | 0 | 0 | 1.64 | 10.24 (-57.72%) | 0.3 | 151*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 152*08e6f24bSBoyan Karatotev | 0 | 0 | 13.92 | 17.7 (-43.74%) | 0.3 | 153*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 154*08e6f24bSBoyan Karatotev | 1 | 0 | 13.54 | 16.74 (-44.90%) | 0.3 (-37.50%) | 155*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 156*08e6f24bSBoyan Karatotev | 1 | 0 | 14.12 | 18.28 (-41.93%) | 0.3 (-44.44%) | 157*08e6f24bSBoyan Karatotev +---------+------+-----------+-----------------+---------------+ 158*08e6f24bSBoyan Karatotev 159012cc2cbSZachary Leaf.. table:: ``CPU_OFF`` latencies (µs) on all non-lead CPUs (v2.12) 160012cc2cbSZachary Leaf 161012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 162012cc2cbSZachary Leaf | Cluster | Core | Powerdown | Wakeup | Cache Flush | 163012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 164012cc2cbSZachary Leaf | 0 | 0 | 1.84 | 23.82 | 0.36 | 165012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 166012cc2cbSZachary Leaf | 0 | 0 | 14.18 | 31.78 | 0.56 (+86.67%) | 167012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 168012cc2cbSZachary Leaf | 1 | 0 | 13.64 | 30.54 | 0.36 | 169012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 170012cc2cbSZachary Leaf | 1 | 0 | 14.18 | 31.82 | 0.68 | 171012cc2cbSZachary Leaf +---------+------+-----------+--------+----------------+ 172012cc2cbSZachary Leaf 1736338876bSHarrison Mutai``CPU_VERSION`` in parallel 1746338876bSHarrison Mutai~~~~~~~~~~~~~~~~~~~~~~~~~~~ 175*08e6f24bSBoyan Karatotev.. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.13) 176*08e6f24bSBoyan Karatotev 177*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 178*08e6f24bSBoyan Karatotev | Cluster | Core | Latency | 179*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 180*08e6f24bSBoyan Karatotev | 0 | 0 | 0.12 | 181*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 182*08e6f24bSBoyan Karatotev | 0 | 0 | 0.2 (-28.57%) | 183*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 184*08e6f24bSBoyan Karatotev | 1 | 0 | 0.2 | 185*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 186*08e6f24bSBoyan Karatotev | 1 | 0 | 0.24 (-25.00%) | 187*08e6f24bSBoyan Karatotev +----------+------+-------------------+ 1886338876bSHarrison Mutai 189012cc2cbSZachary Leaf.. table:: ``CPU_VERSION`` latency (µs) in parallel on all cores (v2.12) 190012cc2cbSZachary Leaf 191012cc2cbSZachary Leaf +----------+------+-------------------+ 192012cc2cbSZachary Leaf | Cluster | Core | Latency | 193012cc2cbSZachary Leaf +----------+------+-------------------+ 194012cc2cbSZachary Leaf | 0 | 0 | 0.14 | 195012cc2cbSZachary Leaf +----------+------+-------------------+ 196012cc2cbSZachary Leaf | 0 | 0 | 0.2 (-28.57%) | 197012cc2cbSZachary Leaf +----------+------+-------------------+ 198012cc2cbSZachary Leaf | 1 | 0 | 0.2 | 199012cc2cbSZachary Leaf +----------+------+-------------------+ 200012cc2cbSZachary Leaf | 1 | 0 | 0.26 | 201012cc2cbSZachary Leaf +----------+------+-------------------+ 202012cc2cbSZachary Leaf 2036338876bSHarrison Mutai-------------- 2046338876bSHarrison Mutai 2059b65ffefSBoyan Karatotev*Copyright (c) 2023-2025, Arm Limited. All rights reserved.* 2066338876bSHarrison Mutai 207*08e6f24bSBoyan Karatotev.. _TF-A v2.13-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/trusted-firmware-a/+/refs/tags/v2.13-rc0 208*08e6f24bSBoyan Karatotev.. _TFTF v2.13-rc0: https://review.trustedfirmware.org/plugins/gitiles/TF-A/tf-a-tests/+/refs/tags/v2.13-rc0 2096338876bSHarrison Mutai.. _user guide: https://gitlab.arm.com/arm-reference-solutions/arm-reference-solutions-docs/-/blob/master/docs/n1sdp/user-guide.rst 2106338876bSHarrison Mutai.. _N1SDP: https://developer.arm.com/documentation/101489/latest 211