HiPlot is a lightweight interactive visualization tool to help AI researchers discover correlations and patterns in high-dimensional data using parallel plots and other graphical ways to represent information.

HiPlot demonstration

Given about 7000 experimental datapoints, we want to understand which parameters influence the metric we want to optimize: valid ppl. How can HiPlot help?

  • On the parallel plot, each line represents one datapoint. Slicing on the valid ppl axis reveals that higher values for lr lead to better models.

  • We will focus on higher values for the lr then. Un-slice the valid ppl axis by clicking on the axis, but outside of the current slice. Slice on the lr axis values above 1e-2, then click the Keep button.

  • Let’s see now how the training goes by adding a line plot. Right click the epoch axis title and select Set as X axis. Similary, set valid ppl as the Y axis. Once you have done both, an XY line plot should appear below the parallel plot.

  • Slicing through the dropout, embedding_size and lr axis reveals how they can affect the training dynamics: convergence speed and maximum performance.

Indices and tables