All eleven activations

Overview across datasets for the selected target, five seeds. Cell shading ranks each column on its own scale. Click a cell to select its activation and dataset for the comparison and trajectory below.  Frozen FAct outlined in blue.

Table view

Target test accuracy by activation

Point = mean, whisker = mean ± 1 sample s.d. (n = 5), open dots = the five individual seeds. The selected activation is highlighted; click any row to select it. Hover for the seed values.  Frozen FAct  GELU  other conventional activations.

Table view

Target training trajectories

Mean validation accuracy across five seeds; shaded regions represent ±1 sample standard deviation. The selected activation is drawn with a heavier line. Select activation functions below to compare their training trajectories.