Berita

Contact: tsbevents@itu.int

Introduction
The question of whether customers may or may not test the performance of the specific technology, equipment/system and application announced by vendors/operators becomes very important in the era of digital development. 

According to the term defined in Recommendation ITU-T E.800, benchmark is “evaluation of performance value/s of a parameter or set of parameters for the purpose of establishing value/s as the norm against which future performance achievements may be compared or assessed”. Moreover, describing the process, Recommendation ITU-T Q.3930 defines benchmarking as “performance tests of a system based on a suite of standardized performance tests. The main purpose of a performance benchmark is to produce a metric that can be rated and compared with the metric values produced by other systems using the same benchmark”.

In principal, the benchmarking approach can be used for performance assessment of parameters of different systems, networks, services and applications. For instance, among these parameters could be call drops, call set-up delay, CPU load, latency, jitter, download transmission speed, upload transmission speed to name but a few.

In general, there is a need for standards, which define performance test suites, for rating each of the above mentioned parameters for every particular system, network, service and/or application. The existence of such standards can allow the availability in the market of applications that can be used by the customers to produce comparable results.

Following the results of WTSA-16, some of the current ITU-T SG11 activities focus on service and networks benchmark testing and remote testing including Internet related performance measurements (Q9/11). As of now, ITU-T SG11 developed a number of Recommendations on benchmarking of IMS and IMS/NGN platforms, including:

• ITU-T Q.3930: Performance testing of distributed systems - Concepts and terminology;
• ITU-T Q.3931.1-Q.3931.4: Performance benchmark for the PSTN/ISDN emulation subsystem of an IP multimedia system;
• ITU-T Q.3932.1-Q.3932.4: IMS/NGN performance benchmark;
• ITU-T Q.3933: Reference benchmarking, background traffic profiles and KPIs for VoIP and FoIP in fixed networks.

The Workshop will take place during the ITU-T Study Group 11 meeting from  6-15 March 2019 at the same venue. 

Target Audience
ITU members and non-members are invited. Participation is free of charge.