Implement percentile metrics for treelite

[jfomhover]

Current inferencing report only provides percentile metrics for LightGBM C API, that's because this is the only variant implementing latency measurement at the request level. The general issue here is that predictions at request level for python API will measure a lot of overhead (which might be a good thing to surface).