Carlos Aguni

Highly motivated self-taught IT analyst. Always learning and ready to explore new skills. An eternal apprentice.


Prometheus data to AIOPS Study

16 Jun 2022 »

Analyzing Prometheus data with external tools

https://valyala.medium.com/analyzing-prometheus-data-with-external-tools-5f3e5e147639

exporting raw dara via /query API

{__name__!=""}[1h]

exporting raw data via tsdb command-line tool

promtool tsdb dump

exporting raw data via remote

[prometheus] -[remote storage]-> [VictoriaMetrics] <-[/export API] JSON streaming format

https://github.com/VictoriaMetrics/VictoriaMetrics/wiki/Single-server-VictoriaMetrics#how-to-export-time-series

{"metric":{"__name__":"up","job":"node_exporter","instance":"localhost:9100"},"values":[0,0,0],"timestamps":[1549891472010,1549891487724,1549891503438]}
{"metric":{"__name__":"up","job":"prometheus","instance":"localhost:9090"},"values":[1,1,1],"timestamps":[1549891461511,1549891476511,1549891491511]}

promtool tsdb dump

https://github.com/prometheus/prometheus/issues/8281

Extend “promtool tsdb dump”

https://docs.google.com/document/d/13_wMfTKEWsbIbMChOinKcYR6PW1AyPeCxG-XCLbiV7w/edit#heading=h.cmqufn5ktjuv

Workflow for data science use cases

v3io tsdb

https://github.com/v3io/v3io-tsdb