What do we mean by “top percentile” or TP based latency?
tp90 is a maximum time under which 90% of requests have been served. Imagine you have times: 10s 1000s 100s 2s Calculating TP is very simple: sort all times in ascending order: [2s, 10s, 100s, 1000s] find latest item in portion you need to calculate. For TP50 it will ceil(4*.5)=2 requests. You need 2nd request. … Read more