Kpi Overview 171g67

NSN KPIs, overview

Soc Classification level 1 © Nokia Siemens Networks

/

Outline

• NSN counter-based KPIs • NSN field test KPIs

Soc Classification level 2 © Nokia Siemens Networks

Presentation / Author / Date

RL40/RL35 counters and KPIs • •

RL40/RL35 counters and KPIs attached Latest counter and KPI info available in JUMP:

http://nop-i.nokiasiemensnetworks.com/pl_.php • NPO KPI documentation folder https://sharenet-ims.inside.nokiasiemensnetworks.com/Open/383538045

• Official benchmark KPIs are in CuDo: ”Specifications of LTE RAN Key Performance Indicators” – This is a link to latest (Product Finder Search)

LTE RAN Key Performance Indicators RL40

Soc Classification level 3 © Nokia Siemens Networks

worksheet worksheet 09_KPI_Overview FDD_RL40.xls 09_KPI_Overview TDD_RL35.xls

Worksheet in 09_KPI_overview_RL40.xls

/

RL40/RL35 measurements •

RL40/RL35 measurements summarized http://nop-i.nokiasiemensnetworks.com/pl_.php

Soc Classification level 4 © Nokia Siemens Networks

Presentation / Author / Date

Accessibility E-UTRAN E-RAB Setup Success Ratio The KPI describes the setup success ratio of the elementary E-RAB setup procedure used to setup the E-RAB between MME and UE. It indicates the E-UTRAN contribution to network accessibility for the end, not the whole end-to-end service accessibility.

Logical formula E-RAB SSR=(E-RAB setup successes / ERAB setup attempts)*100%

Soc Classification level 5 © Nokia Siemens Networks

Summarisation formula (PI ID)

Summarisation formula (Abbreviation)

100*sum([M8006C1]) / sum([M8006C0])

100*sum([EPS_BEARER_SETUP_COMPLETIONS]) / sum([EPS_BEARER_SETUP_ATTEMPTS])

/

Retainability E-RAB Normal Release Ratio, perspective This KPI describes the ratio of normally released E-RABs from perspective. This KPI is corresponding to a Connection Completion Ratio.

Logical formula

Summarisation formula (PI ID)

E-RAB NRR UP=(normal E-RAB releases perspective / all E-RAB releases)*100%

Soc Classification level 6 © Nokia Siemens Networks

Summarisation formula (Abbreviation) 100*sum([EPC_EPS_BEARER_REL_REQ_NORM]+ EPC_EPS_BEARER_REL_REQ_DETACH]+ [ENB_EPSBEAR_REL_REQ_RNL_REDIR]+ [ENB_EPS_BEARER_REL_REQ_RNL_INA]) / sum([EPC_EPS_BEARER_REL_REQ_NORM]+ [EPC_EPS_BEARER_REL_REQ_DETACH]+ [EPC_EPS_BEARER_REL_REQ_RNL]+ [EPC_EPS_BEARER_REL_REQ_OTH] + [ENB_EPSBEAR_REL_REQ_RNL_REDIR]+ [ENB_EPS_BEARER_REL_REQ_RNL_INA] + [ENB_EPS_BEARER_REL_REQ_RNL_RLF]+ [ENB_EPS_BEARER_REL_REQ_TNL]+ [ENB_EPS_BEARER_REL_REQ_OTH])

/

Mobility E-UTRAN HO Success Ratio, intra eNB This KPI describes the success ratio for the handover execution phase, when the source eNB receives information that the UE successfully is connected to the target cell within own eNB.

Summarisation formula (PI ID)

Logical formula Intra HO SR =(number of successful intra eNB HOs) / (number of intra eNB HO attempts)*100%

Soc Classification level 7 © Nokia Siemens Networks

/

Summarisation formula (Abbreviation) 100*sum([SUCC_INTRA_ENB_HO]) / sum([ATT_INTRA_ENB_HO])

Mobility E-UTRAN HO Success Ratio, inter eNB X2 based This KPI describes the success ratio for the inter eNB X2 based handover execution phase, when the source eNB receives information that the UE successfully is connected to the target cell within target eNB.

Summarisation formula (PI ID)

Logical formula Inter X2 based HO SR =(number of successful inter eNB X2 based HOs) / (number of inter eNB X2 based HO attempts)*100%

Soc Classification level 8 © Nokia Siemens Networks

/

Summarisation formula (Abbreviation) 100*sum([SUCC_INTER_ENB_HO]) / sum ([ATT_INTER_ENB_HO])

KPIs followed and reported from live LTE networks (by Technical ) NW KPI Cell Availability excl. BLU [%] (LTE_5239a)

RRC Setup Success Rate [%] (LTE_5218c) eRAB Setup Success Ratio [%] (LTE_5017a) eRAB Drop Ratio [%] (LTE_5025b)

eRAB Drops per PD Vol. [#/GB]

current week– 2

current week– 1

current week

trend

NSN Benchmark

Comments

99,5

99,53

94,16

↘

>99,5%

NA05096336 – 250 eNBs down after Plan Operation failure

99,05

98,79

99,42

→

98,099,5%

→

99,099,5%

EXA MPL 99,80 99,78 99,92 E 6,1

5,86

2,60

→

1,05,0%

4,51

4,87

2,73

→

tbd

99,63

99,75

99,48

→

99,099,5%

(LTE_5812a)

Intra LTE Handover Success Rate [%] Avg(LTE_5035a;LTE_5048b)

Soc Classification level 9 © Nokia Siemens Networks

/

Improved after completion of the SW RL20 5.0.2 on 29.02.2012. inactivityTimer has also been changed from 30 to 20 seconds.

And so on… counters and network KPIs • Once again the main links: • Please see JUMP for latest counter-based KPIs http://nop-i.nokiasiemensnetworks.com/pl_.php • NPO KPI documentation folder https://sharenet-ims.inside.nokiasiemensnetworks.com/Open/3835 38045 • Official customer counter-based KPIs are in CuDo: ”Specifications of LTE RAN Key Performance Indicators” This is a link to latest customer KPI CuDo (Product Finder Search)

Soc Classification level 10 © Nokia Siemens Networks

/

Outline

• NSN counter-based KPIs • NSN field test KPIs

Soc Classification level 11 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs – important links • Definitions and performance targets https://sharenet-ims.inside.nokiasiemensnetworks.com/Open/437652090

Field KPI References: • • • • •

LTE E2E Field Network Performance - KPI Targets for RL30, Internal Version LTE E2E Field Network Performance - KPI Targets for RL25TD, Internal Version NPO project/trial reports NPO KPI material (FDD) TD-LTE KPI Optimization Guidelines for RL15TD

• In the following slides some examples to follow • No NSN customer specific field KPI templates/workbooks available for Actix or Nemo Analyze yet. • If your project needs these, please collect example drive test logs and [email protected] Soc Classification level 12 © Nokia Siemens Networks

/

Field KPI Attach Time With Attach, the mobile terminal s at the LTE network. At the end of the procedure the UE is authenticated, and a default (nGBR) bearer is established. The Attach Time is the interval between the connection request and the acknowledgement of the positive response by the UE. Mean value and 95% from all measured samples Formula : Attach Time [ms] = tAttach Complete – tAttach Request Related E-UTRAN Counters & KPIs • None Target KPI values (ms)

Min Unload Mean 95%-ile ed Load A Load A 241 110 271

  Initial Attach Re-Attach (w/o Authentication ) 125

Soc Classification level 13 © Nokia Siemens Networks

Presentation / Author / Date

362

145

Field KPIs Detach Time With an explicit Detach request the UE informs the LTE network that it does not want to access the EPS any longer. At the end of the procedure all EPS bearers of the UE are released. The Detach Time is the interval between the Detach Request and the reception of a Detach Accept message by the UE. No Detach Accept is sent by the network if the cause for Detach is switching the UE off. Formula : Detach Time [ms] = tDetachRequest – tDetachAccept Related E-UTRAN Counters & KPIs • None Target KPI values (ms)   Detach Time Soc Classification level 14 © Nokia Siemens Networks

Presentation / Author / Date

Min Unload Mean 95%-ile ed Load A Load A 46 66 88

Field KPIs Attach Success Rate The Attach Success Rate is defined as the ratio between the number of successful registrations and the number of all requests. This is the probability that a can attach to the LTE network at any moment of time. The calculated success ratio figure excludes attach requests, which are rejected by authentication failures. On the other hand, network attach requests which are terminated by timer expiry (due to the unavailability of some LTE resource) are considered as unsuccessful registrations. If the success rate is calculated on the eNB by counting incoming RRC requests, RRC CONNECTION REQUEST retries are to be excluded, since they would increase the overall number of establishment attempts, and thus reduce the success ratio. number _ of _ successfull _ attachments Formula: LTENwAttSR  100% number _ of _ attempts

Target KPI values: 95% Related E-UTRAN Counters & KPIs • PM counters: LTE EPS Bearer - M8006; • KPIs: Initial E-RAB Setup Success Ratio (ISSR) - LTE_5112a Soc Classification level 15 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Request Time: UE Initiated It is the time taken by the LTE network to setup an EPS bearer on request by the UE. The EPS bearer can be new (dedicated), or an existing one (e.g. the default EPS bearer). The latter is needed to reassign Uu radio and S1 bearer resources to the existing EPS bearer of a previously Idle UE. The EPS bearer has to be created or activated before IP packets can be exchanged, i.e. the Service Request creates the IP link dynamically over the mobile access (LTE) network. The UE Initiated EPS Bearer Setup Time is the interval between the submission of the message RRC CONNECTION REQUEST (see References 26. [3GPP36.331]) carrying a NAS: Service Request message in its body, and the reception of the RRC CONNECTION RECONFIGURATION response by the UE. The Bearer Setup procedure is based on the Service Request procedure, see References 3. [3GPP23.401] and 20. [3GPP36.300].

Soc Classification level 16 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Request Time: UE Initiated Continued Mean value and 95% from all measured samples Formula: Service Request Time [ms] = tRRC_Reconfig – tRRC_Request TargetMinKPI values (ms): Unload Mean 95%-ile   ed Load A Load A UE initiated 95 122 110

Related E-UTRAN Counters • Mean EPS Setup Time: SAEB.EstabTimeMean.QCI • Max EPS Setup Time: SAEB.EstabTimeMax.QCI

Soc Classification level 17 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Request Time: Network Initiated • It is the time taken by the LTE network to set up an EPS bearer on request by the P-GW. The EPS bearer has to be created before IP packets can be sent (DL) to the UE if the UE has no proper EPS bearer for the given IP packet flow. The network initiated Service Request • Time includes a Paging Time (ref. to Paging Time) if the UE is idle. The EPS Bearer Setup procedure is based on the Paging and Service Request procedures according to References 26. [3GPP36.331] and 3. [3GPP23.401]. Mean value and 95% from all measured samples Formula: Service Request Time [s] = tRRC_Reconfig – tRRC_Request Min Unload Mean 95%-ile ed Load A Load A

Target KPI values (ms):   NW initiated (w/o Paging)

172

145

212

Related E-UTRAN Counters (same as UE Initiated) • Mean EPS Setup Time: SAEB.EstabTimeMean.QCI • Max EPS Setup Time: SAEB.EstabTimeMax.QCI

Soc Classification level 18 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Request Success Rate • This KPI is defined as the ratio between successfully established EPS bearers compared to the overall number of EPS bearer establishment attempts. It corresponds to the probability that a or the LTE network can establish an EPS bearer at any moment in time. • Requests that are terminated by timer expiry (due to the nonaccessibility of some LTE resource) are considered as unsuccessful attempts. Authentication errors (requests rejected by the MME) are included in the total number of failures.

• Only the first RRC CONNECTION REQUEST is to be considered, since counting retries of the same message would increase the overall number of bearer establishment attempts, and thus reduce the success ratio.

Soc Classification level 19 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Request Success Rate Continued Formula: EPSSR 

number_of (RRC_CONN_RECONFIGURATION_COMP LETE)  100% number_of (RRC_CONNECTION_REQUEST)

Target KPI values: 98% Related E-UTRAN Counters & KPIs • Group of related PM counters: LTE EPS Bearer - M8006 • KPI: Additional E-RAB Setup Success Ratio (ASSR) LTE_5113a

Soc Classification level 20 © Nokia Siemens Networks

Presentation / Author / Date

Field KPIs Service Drop Rate It is the ratio between abnormally released bearers and the overall number of established EPS bearers. An abnormal release is defined as any EPS bearer termination that was not triggered by the mobile (from UE side). Thus, it reflects the probability that an established bearer is aborted due to insufficient network resources. Dropping the bearer becomes visible to the end- if an application service is actively using it. If the application automatically re-establishes the bearer, it remains unnoticed by the . Formula: number_of (dropped_calls) EPSBearerD R 

number_of (successfu ll_calls)

Target KPI values: < 2%

Soc Classification level 21 © Nokia Siemens Networks

Presentation / Author / Date

 100%