CRISP: Critical Path Analysis of Microservice Traces

This repo contains code to compute and present critical path summary from Jaeger microservice traces. To use first collect the microservice traces of a specific endpoint in a directory (say traces). Let the traces be for OP operation and SVC service (these are Jaeger termonologies). python3 process.py --operationName OP --serviceName SVC -t <path to trace> -o . --parallelism 8 will produce the critical path summary using 8 concurrent processes. The summary will be output in the current directory as an HTML file with a heatmap, flamegraph, and summary text in criticalPaths.html. It will also produce three flamegraphs flame-graph-*.svg for three different percentile values.

The script accepts the following options:

python3 process.py --help
usage: process.py [-h] -a OPERATIONNAME -s SERVICENAME [-t TRACEDIR] [--file FILE] -o OUTPUTDIR
                  [--parallelism PARALLELISM] [--topN TOPN] [--numTrace NUMTRACE] [--numOperation NUMOPERATION]

optional arguments:
  -h, --help            show this help message and exit
  -a OPERATIONNAME, --operationName OPERATIONNAME
                        operation name
  -s SERVICENAME, --serviceName SERVICENAME
                        name of the service
  -t TRACEDIR, --traceDir TRACEDIR
                        path of the trace directory (mutually exclusive with --file)
  --file FILE           input path of the trace file (mutually exclusivbe with --traceDir)
  -o OUTPUTDIR, --outputDir OUTPUTDIR
                        directory where output will be produced
  --parallelism PARALLELISM
                        number of concurrent python processes.
  --topN TOPN           number of services to show in the summary
  --numTrace NUMTRACE   number of traces to show in the heatmap
  --numOperation NUMOPERATION
                        number of operations to show in the heatmap

CRISP: Critical Path Analysis of Microservice Traces

Related tags

Overview

CRISP: Critical Path Analysis of Microservice Traces

Owner

Uber Research

Data Intelligence Applications - Online Product Advertising and Pricing with Context Generation

Tools for the analysis, simulation, and presentation of Lorentz TEM data.

Validation and inference over LinkML instance data using souffle

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

PyTorch implementation for NCL (Neighborhood-enrighed Contrastive Learning)

fds is a tool for Data Scientists made by DAGsHub to version control data and code at once.

An ETL Pipeline of a large data set from a fictitious music streaming service named Sparkify.

apricot implements submodular optimization for the purpose of selecting subsets of massive data sets to train machine learning models quickly.

First and foremost, we want dbt documentation to retain a DRY principle. Every time we repeat ourselves, we waste our time. Second, we want to understand column level lineage and automate impact analysis.

My solution to the book A Collection of Data Science Take-Home Challenges

ETL pipeline on movie data using Python and postgreSQL

A library to create multi-page Streamlit applications with ease.

Data analysis and visualisation projects from a range of individual projects and applications

Utilize data analytics skills to solve real-world business problems using Humana’s big data

Python scripts aim to use a Random Forest machine learning algorithm to predict the water affinity of Metal-Organic Frameworks

Snakemake workflow for converting FASTQ files to self-contained CRAM files with maximum lossless compression.

Analyse the limit order book in seconds. Zoom to tick level or get yourself an overview of the trading day.

Demonstrate the breadth and depth of your data science skills by earning all of the Databricks Data Scientist credentials

Python reader for Linked Data in HDF5 files

Validated, scalable, community developed variant calling, RNA-seq and small RNA analysis