Promxy implementation

[nemobis]

Thank you for your interesting paper!

I wonder, do you think it would be possible to implement your ideas in Promxy? We use it as query frontend for a mix of Prometheus and VictoriaMetrics sources. It would be interesting to offer an alternative like promsketch, without having to patch the timeseries storage in the backend. (One advantage is that people can easily switch datasources in Grafana if some problem arises.)

(I admit I've not yet read everything in the paper, forgive me if this is implicitly answered e.g. in section 4.)

[zzylol]

Thank you for your interest!

It's possible to provide PromSketch with Promxy by running a standalone PromSketch service leveraging this library. For example, the service can use remote read to fetch data from Prometheus as Promxy, and insert the data to PromSketch. We can expose HTTP APIs for PromQL queries as well and connect the data source to Grafana via Kafka. We will open-source one version of this soon.

I hope this answers your questions. If Promxy already has ingestion and query APIs, it's also possible to integrate PromSketch within Promxy.
For ingestion, we define SketchInsert() function to use:

• https://github.com/Froot-NetSys/promsketch/blob/main/promsketches.go#L738
• AddRow() for VictoriaMetrics: https://github.com/Froot-NetSys/promsketch/blob/main/vmsketches.go#L320

For querying PromSketch, we define an Eval() function to query a statistic over a given time range:

• https://github.com/Froot-NetSys/promsketch/blob/main/promsketches.go#L582
• https://github.com/Froot-NetSys/promsketch/blob/main/vmsketches.go#L352

If you have further questions, please let me know!

[zzylol]

We have open-sourced a standalone PromSketch service that may be useful:
https://github.com/Froot-NetSys/PromSketch-Standalone.