911 lines
197 KiB
Plaintext
911 lines
197 KiB
Plaintext
{
|
|
"cells": [
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "807ba781",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.034485,
|
|
"end_time": "2023-06-06T00:09:17.035990",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:17.001505",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"*The data, concept, and initial implementation of this notebook was done in Colab by Ross Wightman, the creator of timm. I (Jeremy Howard) did some refactoring, curating, and expanding of the analysis, and added prose.*"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "cb51ad49",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.03021,
|
|
"end_time": "2023-06-06T00:09:17.097808",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:17.067598",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"## timm\n",
|
|
"\n",
|
|
"[PyTorch Image Models](https://timm.fast.ai/) (timm) is a wonderful library by Ross Wightman which provides state-of-the-art pre-trained computer vision models. It's like Huggingface Transformers, but for computer vision instead of NLP (and it's not restricted to transformers-based models)!\n",
|
|
"\n",
|
|
"Ross has been kind enough to help me understand how to best take advantage of this library by identifying the top models. I'm going to share here so of what I've learned from him, plus some additional ideas."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "248460f0",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.030863,
|
|
"end_time": "2023-06-06T00:09:17.159071",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:17.128208",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"## The data\n",
|
|
"\n",
|
|
"Ross regularly benchmarks new models as they are added to timm, and puts the results in a CSV in the project's GitHub repo. To analyse the data, we'll first clone the repo:"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 1,
|
|
"id": "cf208740",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 2.565717,
|
|
"end_time": "2023-06-06T00:09:19.755674",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:17.189957",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"name": "stdout",
|
|
"output_type": "stream",
|
|
"text": [
|
|
"/usr/bin/sh: 1: git: not found\n",
|
|
"[Errno 2] No such file or directory: 'pytorch-image-models/results'\n",
|
|
"/workspace/Education\n"
|
|
]
|
|
},
|
|
{
|
|
"name": "stderr",
|
|
"output_type": "stream",
|
|
"text": [
|
|
"/opt/conda/lib/python3.10/site-packages/IPython/core/magics/osm.py:393: UserWarning: using bookmarks requires you to install the `pickleshare` library.\n",
|
|
" bkms = self.shell.db.get('bookmarks', {})\n"
|
|
]
|
|
}
|
|
],
|
|
"source": [
|
|
"! git clone --depth 1 https://github.com/rwightman/pytorch-image-models.git\n",
|
|
"%cd pytorch-image-models/results"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "68fcf101",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.037981,
|
|
"end_time": "2023-06-06T00:09:19.832345",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:19.794364",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"Using Pandas, we can read the two CSV files we need, and merge them together."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 2,
|
|
"id": "df355a97",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:19.907795Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:19.907457Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:19.926381Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:19.925291Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.058692,
|
|
"end_time": "2023-06-06T00:09:19.929054",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:19.870362",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"import pandas as pd\n",
|
|
"df_results = pd.read_csv('results-imagenet.csv')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 3,
|
|
"id": "4e25867e",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:20.006128Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:20.005747Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:20.022803Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:20.021657Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.059181,
|
|
"end_time": "2023-06-06T00:09:20.025310",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:19.966129",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"df_results['model_org'] = df_results['model'] \n",
|
|
"df_results['model'] = df_results['model'].str.split('.').str[0]"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "b45c1928",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.035119,
|
|
"end_time": "2023-06-06T00:09:20.097374",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.062255",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"We'll also add a \"family\" column that will allow us to group architectures into categories with similar characteristics:\n",
|
|
"\n",
|
|
"Ross has told me which models he's found the most usable in practice, so I'll limit the charts to just look at these. (I also include VGG, not because it's good, but as a comparison to show how far things have come in the last few years.)"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 4,
|
|
"id": "baa099eb",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:20.172024Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:20.171675Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:20.181011Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:20.180119Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.049639,
|
|
"end_time": "2023-06-06T00:09:20.183317",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.133678",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"def get_data(part, col):\n",
|
|
" df = pd.read_csv(f'benchmark-{part}-amp-nhwc-pt111-cu113-rtx3090.csv').merge(df_results, on='model')\n",
|
|
" df['secs'] = 1. / df[col]\n",
|
|
" df['family'] = df.model.str.extract('^([a-z]+?(?:v2)?)(?:\\d|_|$)')\n",
|
|
" df = df[~df.model.str.endswith('gn')]\n",
|
|
" df.loc[df.model.str.contains('in22'),'family'] = df.loc[df.model.str.contains('in22'),'family'] + '_in22'\n",
|
|
" df.loc[df.model.str.contains('resnet.*d'),'family'] = df.loc[df.model.str.contains('resnet.*d'),'family'] + 'd'\n",
|
|
" return df[df.family.str.contains('^re[sg]netd?|beit|convnext|levit|efficient|vit|vgg|swin')]"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 5,
|
|
"id": "71215c1e",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:20.258526Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:20.257452Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:20.299124Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:20.298113Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.082408,
|
|
"end_time": "2023-06-06T00:09:20.301660",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.219252",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"df = get_data('infer', 'infer_samples_per_sec')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "16c47388",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.03543,
|
|
"end_time": "2023-06-06T00:09:20.372280",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.336850",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"## Inference results"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "8d097dee",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.035859,
|
|
"end_time": "2023-06-06T00:09:20.444242",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.408383",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"Here's the results for inference performance (see the last section for training performance). In this chart:\n",
|
|
"\n",
|
|
"- the x axis shows how many seconds it takes to process one image (**note**: it's a log scale)\n",
|
|
"- the y axis is the accuracy on Imagenet\n",
|
|
"- the size of each bubble is proportional to the size of images used in testing\n",
|
|
"- the color shows what \"family\" the architecture is from.\n",
|
|
"\n",
|
|
"Hover your mouse over a marker to see details about the model. Double-click in the legend to display just one family. Single-click in the legend to show or hide a family.\n",
|
|
"\n",
|
|
"**Note**: on my screen, Kaggle cuts off the family selector and some plotly functionality -- to see the whole thing, collapse the table of contents on the right by clicking the little arrow to the right of \"*Contents*\"."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 6,
|
|
"id": "4c2a97d1",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:20.518520Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:20.518198Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:22.319635Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:22.318516Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 1.841847,
|
|
"end_time": "2023-06-06T00:09:22.322215",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:20.480368",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"import plotly.express as px\n",
|
|
"w,h = 1000,800\n",
|
|
"\n",
|
|
"def show_all(df, title, size):\n",
|
|
" return px.scatter(df, width=w, height=h, size=df[size]**2, title=title,\n",
|
|
" x='secs', y='top1', log_x=True, color='family', hover_name='model_org', hover_data=[size])"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 7,
|
|
"id": "26c23a28",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:22.397315Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:22.397009Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:23.870864Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:23.869937Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 1.515062,
|
|
"end_time": "2023-06-06T00:09:23.873393",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:22.358331",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
" <script type=\"text/javascript\">\n",
|
|
" window.PlotlyConfig = {MathJaxConfig: 'local'};\n",
|
|
" if (window.MathJax) {MathJax.Hub.Config({SVG: {font: \"STIX-Web\"}});}\n",
|
|
" if (typeof require !== 'undefined') {\n",
|
|
" require.undef(\"plotly\");\n",
|
|
" requirejs.config({\n",
|
|
" paths: {\n",
|
|
" 'plotly': ['https://cdn.plot.ly/plotly-2.11.1.min']\n",
|
|
" }\n",
|
|
" });\n",
|
|
" require(['plotly'], function(Plotly) {\n",
|
|
" window._Plotly = Plotly;\n",
|
|
" });\n",
|
|
" }\n",
|
|
" </script>\n",
|
|
" "
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
},
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
"<div> <div id=\"9a27303f-f4a0-4473-a5aa-129d200584d7\" class=\"plotly-graph-div\" style=\"height:800px; width:1000px;\"></div> <script type=\"text/javascript\"> require([\"plotly\"], function(Plotly) { window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById(\"9a27303f-f4a0-4473-a5aa-129d200584d7\")) { Plotly.newPlot( \"9a27303f-f4a0-4473-a5aa-129d200584d7\", [{\"customdata\":[[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=levit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"levit_128s.fb_dist_in1k\",\"levit_128.fb_dist_in1k\",\"levit_192.fb_dist_in1k\",\"levit_256.fb_dist_in1k\",\"levit_384.fb_dist_in1k\"],\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"levit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00004654236751715086,0.00006822292249261998,0.00007756230968148262,0.00010599687945186893,0.00017720128293728847],\"xaxis\":\"x\",\"y\":[76.526,78.49,79.838,81.514,82.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetx<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetx_002.pycls_in1k\",\"regnetx_004.pycls_in1k\",\"regnetx_008.tv2_in1k\",\"regnetx_008.pycls_in1k\",\"regnetx_006.pycls_in1k\",\"regnetx_016.tv2_in1k\",\"regnetx_016.pycls_in1k\",\"regnetx_032.tv2_in1k\",\"regnetx_032.pycls_in1k\",\"regnetx_040.pycls_in1k\",\"regnetx_080.tv2_in1k\",\"regnetx_080.pycls_in1k\",\"regnetx_064.pycls_in1k\",\"regnetx_120.pycls_in1k\",\"regnetx_160.tv2_in1k\",\"regnetx_160.pycls_in1k\",\"regnetx_320.tv2_in1k\",\"regnetx_320.pycls_in1k\"],\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetx\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00005611048828469115,0.00006925193368711838,0.00011822399190402103,0.00011822399190402103,0.0001259786970023369,0.00026479614668647344,0.00026479614668647344,0.0006228278877415016,0.0006228278877415016,0.0006304057291272663,0.0007938902208602596,0.0007938902208602596,0.0008572212316554657,0.0012854296548621376,0.001604157977477622,0.001604157977477622,0.0038134462113411888,0.0038134462113411888],\"xaxis\":\"x\",\"y\":[68.746,72.398,77.304,75.03,73.868,79.436,76.924,80.926,78.168,78.492,81.538,79.202,79.066,79.588,82.566,79.866,82.81,80.246],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[288],[288],[288],[288],[288],[224],[224],[288],[288],[288],[288],[224],[224],[224],[224],[224],[288],[288],[288],[288],[288],[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnety<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnety_002.pycls_in1k\",\"regnety_006.pycls_in1k\",\"regnety_004.tv2_in1k\",\"regnety_004.pycls_in1k\",\"regnety_008.pycls_in1k\",\"regnety_016.tv2_in1k\",\"regnety_016.pycls_in1k\",\"regnety_032.ra_in1k\",\"regnety_032.tv2_in1k\",\"regnety_032.pycls_in1k\",\"regnety_040.ra3_in1k\",\"regnety_040.pycls_in1k\",\"regnety_120.sw_in12k_ft_in1k\",\"regnety_120.pycls_in1k\",\"regnety_080.ra3_in1k\",\"regnety_080.pycls_in1k\",\"regnety_064.ra3_in1k\",\"regnety_064.pycls_in1k\",\"regnety_320.swag_ft_in1k\",\"regnety_320.swag_lc_in1k\",\"regnety_320.seer_ft_in1k\",\"regnety_320.tv2_in1k\",\"regnety_320.pycls_in1k\",\"regnety_160.swag_ft_in1k\",\"regnety_160.lion_in12k_ft_in1k\",\"regnety_160.sw_in12k_ft_in1k\",\"regnety_160.swag_lc_in1k\",\"regnety_160.deit_in1k\",\"regnety_160.tv2_in1k\",\"regnety_160.pycls_in1k\"],\"legendgroup\":\"regnety\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176,50176,50176,50176,50176,50176,82944,82944,82944,82944,82944,50176,50176,82944,82944,82944,82944,50176,50176,50176,50176,50176,82944,82944,82944,82944,82944,82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnety\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.000059976920880845045,0.00010017450398594352,0.00010468376082691796,0.00010468376082691796,0.00012704688411164372,0.00029335406368716726,0.00029335406368716726,0.0007311277645768598,0.0007311277645768598,0.0007311277645768598,0.0011773986554107355,0.0011773986554107355,0.0013256445946841651,0.0013256445946841651,0.0018643499011894553,0.0018643499011894553,0.0021192726656211586,0.0021192726656211586,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875],\"xaxis\":\"x\",\"y\":[70.278,75.27,75.598,74.028,76.302,80.668,77.862,82.728,81.756,78.876,83.044,79.232,85.4,80.386,83.926,79.868,83.72,79.714,86.836,84.546,83.334,83.162,80.808,86.01,85.986,85.986,83.782,83.69,82.642,80.298],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[384],[224],[224],[384],[224],[384],[384],[384],[224],[224],[224],[224],[224],[224],[224],[384],[384],[384],[384],[224],[384],[384],[384],[384],[224],[224],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vit_small_patch32_224.augreg_in21k_ft_in1k\",\"vit_tiny_r_s16_p8_224.augreg_in21k_ft_in1k\",\"vit_tiny_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_224.augreg_in1k\",\"vit_base_patch32_224.sam_in1k\",\"vit_small_patch32_384.augreg_in21k_ft_in1k\",\"vit_small_patch16_224.augreg_in21k_ft_in1k\",\"vit_small_patch16_224.augreg_in1k\",\"vit_tiny_r_s16_p8_384.augreg_in21k_ft_in1k\",\"vit_small_r26_s32_224.augreg_in21k_ft_in1k\",\"vit_tiny_patch16_384.augreg_in21k_ft_in1k\",\"vit_base_patch32_384.augreg_in21k_ft_in1k\",\"vit_base_patch32_384.augreg_in1k\",\"vit_base_patch16_224_miil.in21k_ft_in1k\",\"vit_base_patch16_224.augreg2_in21k_ft_in1k\",\"vit_base_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch16_224.orig_in21k_ft_in1k\",\"vit_base_patch16_224.sam_in1k\",\"vit_base_patch16_224.augreg_in1k\",\"vit_large_r50_s32_224.augreg_in21k_ft_in1k\",\"vit_small_patch16_384.augreg_in21k_ft_in1k\",\"vit_small_patch16_384.augreg_in1k\",\"vit_small_r26_s32_384.augreg_in21k_ft_in1k\",\"vit_large_patch32_384.orig_in21k_ft_in1k\",\"vit_large_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch16_384.augreg_in21k_ft_in1k\",\"vit_base_patch16_384.orig_in21k_ft_in1k\",\"vit_base_patch16_384.augreg_in1k\",\"vit_large_r50_s32_384.augreg_in21k_ft_in1k\",\"vit_base_patch8_224.augreg2_in21k_ft_in1k\",\"vit_base_patch8_224.augreg_in21k_ft_in1k\",\"vit_base_r50_s16_384.orig_in21k_ft_in1k\",\"vit_large_patch16_384.augreg_in21k_ft_in1k\"],\"legendgroup\":\"vit\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,50176,50176,50176,50176,50176,147456,50176,50176,147456,50176,147456,147456,147456,50176,50176,50176,50176,50176,50176,50176,147456,147456,147456,147456,50176,147456,147456,147456,147456,50176,50176,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0000826542597112556,0.00010105327831992861,0.0001606500543800434,0.00023169601482854495,0.00023169601482854495,0.00023169601482854495,0.0002629917946560067,0.0003523347461956656,0.0003523347461956656,0.0003702675182819587,0.0005623284898106078,0.0006846126461648,0.0007257578726585237,0.0007257578726585237,0.0009018027036045053,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.0013855980934170233,0.0014628865677755345,0.0014628865677755345,0.0017152952880838436,0.002085723224528105,0.0028202380280895707,0.0036026948157221604,0.0036026948157221604,0.0036026948157221604,0.004231729507849859,0.005465078150617554,0.005465078150617554,0.005822416302765648,0.010594342621040365],\"xaxis\":\"x\",\"y\":[75.994,71.798,75.454,80.716,74.894,73.694,80.486,81.384,78.846,75.962,81.864,78.424,83.35,78.752,84.266,85.096,84.532,81.786,80.244,79.154,84.422,83.802,81.116,84.048,81.51,85.834,85.996,84.2,81.102,86.182,86.218,85.798,84.976,87.084],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[256],[224],[224],[224],[224],[224],[224],[224],[288],[288],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18.fb_swsl_ig1b_ft_in1k\",\"resnet18.a1_in1k\",\"resnet18.fb_ssl_yfcc100m_ft_in1k\",\"resnet18.a2_in1k\",\"resnet18.gluon_in1k\",\"resnet18.tv_in1k\",\"resnet18.a3_in1k\",\"resnet34.a1_in1k\",\"resnet34.a2_in1k\",\"resnet34.bt_in1k\",\"resnet34.gluon_in1k\",\"resnet34.a3_in1k\",\"resnet26.bt_in1k\",\"resnet26t.ra2_in1k\",\"resnet50.a1_in1k\",\"resnet50.fb_swsl_ig1b_ft_in1k\",\"resnet50.d_in1k\",\"resnet50.c1_in1k\",\"resnet50.c2_in1k\",\"resnet50.tv2_in1k\",\"resnet50.a2_in1k\",\"resnet50.b1k_in1k\",\"resnet50.a1h_in1k\",\"resnet50.b2k_in1k\",\"resnet50.ram_in1k\",\"resnet50.ra_in1k\",\"resnet50.bt_in1k\",\"resnet50.fb_ssl_yfcc100m_ft_in1k\",\"resnet50.am_in1k\",\"resnet50.a3_in1k\",\"resnet50.gluon_in1k\",\"resnet50.tv_in1k\",\"resnet32ts.ra2_in1k\",\"resnet33ts.ra2_in1k\",\"resnet101.a1h_in1k\",\"resnet101.a1_in1k\",\"resnet101.a2_in1k\",\"resnet101.tv2_in1k\",\"resnet101.a3_in1k\",\"resnet101.gluon_in1k\",\"resnet101.tv_in1k\",\"resnet51q.ra2_in1k\",\"resnet61q.ra2_in1k\",\"resnet152.a1h_in1k\",\"resnet152.a1_in1k\",\"resnet152.a2_in1k\",\"resnet152.tv2_in1k\",\"resnet152.a3_in1k\",\"resnet152.gluon_in1k\",\"resnet152.tv_in1k\"],\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,65536,50176,50176,50176,50176,50176,50176,50176,82944,82944,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00017561482751111642,0.0002638710409448694,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00029286350217890445,0.00029674294938752255,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.000534896657965681,0.0005959830740806961,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052],\"xaxis\":\"x\",\"y\":[73.282,73.158,72.594,72.372,70.838,69.76,68.254,77.918,77.158,76.48,74.578,72.97,76.366,78.332,81.214,81.182,80.972,80.912,80.87,80.85,80.772,80.706,80.676,80.454,79.976,79.836,79.64,79.234,78.998,78.048,77.58,76.13,79.392,79.726,82.778,82.322,82.236,81.89,79.814,79.31,77.376,82.36,82.524,83.45,82.732,82.608,82.288,80.546,79.694,78.322],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[240],[224],[224],[256],[260],[240],[288],[300],[320],[300],[300],[384],[456]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnet_lite0.ra_in1k\",\"efficientnet_b0.ra_in1k\",\"efficientnet_b1_pruned.in1k\",\"efficientnet_es.ra_in1k\",\"efficientnet_es_pruned.in1k\",\"efficientnet_b1.ft_in1k\",\"efficientnet_b2_pruned.in1k\",\"efficientnet_em.ra2_in1k\",\"efficientnet_b2.ra_in1k\",\"efficientnet_b3_pruned.in1k\",\"efficientnet_b3.ra2_in1k\",\"efficientnet_el.ra_in1k\",\"efficientnet_el_pruned.in1k\",\"efficientnet_b4.ra2_in1k\",\"efficientnet_b5.sw_in12k_ft_in1k\"],\"legendgroup\":\"efficientnet\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[50176,50176,57600,50176,50176,65536,67600,57600,82944,90000,102400,90000,90000,147456,207936],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00011112172940969915,0.0001301779923689661,0.00016600486062231902,0.00017507769072525934,0.00017510804166170527,0.00024378530315921374,0.0002616848842960284,0.0002911538719097656,0.00032120258246876303,0.00032275451614256713,0.000539647933688062,0.0006642355645005945,0.0006644474123095528,0.0010264938051098862,0.0021380313007782433],\"xaxis\":\"x\",\"y\":[75.48,77.694,78.242,78.054,75.014,78.8,79.92,79.24,80.61,80.852,82.242,81.312,80.3,83.414,85.892],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetd<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18d.ra2_in1k\",\"resnet34d.ra2_in1k\",\"resnet26d.bt_in1k\",\"resnet50d.a1_in1k\",\"resnet50d.ra2_in1k\",\"resnet50d.a2_in1k\",\"resnet50d.gluon_in1k\",\"resnet50d.a3_in1k\",\"resnet101d.ra2_in1k\",\"resnet101d.gluon_in1k\",\"resnet152d.ra2_in1k\",\"resnet152d.gluon_in1k\",\"resnet200d.ra2_in1k\"],\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#FF6692\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetd\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00011218547400045547,0.00017947263760167124,0.0002044542400742578,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.0010008807750820723,0.0010008807750820723,0.0014054023666975855,0.0014054023666975855,0.0019066503965832825],\"xaxis\":\"x\",\"y\":[73.794,78.436,77.408,81.45,81.356,81.164,79.078,78.722,83.016,80.426,83.684,80.476,83.964],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[256],[256],[256]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=mobilevit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"mobilevit_xxs.cvnets_in1k\",\"mobilevit_xs.cvnets_in1k\",\"mobilevit_s.cvnets_in1k\"],\"legendgroup\":\"mobilevit\",\"marker\":{\"color\":\"#B6E880\",\"size\":[65536,65536,65536],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"mobilevit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00019510063290645313,0.00032276493352656195,0.0004140683875348853],\"xaxis\":\"x\",\"y\":[68.932,74.636,78.312],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=repvgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"repvgg_b0.rvgg_in1k\",\"repvgg_a2.rvgg_in1k\",\"repvgg_b1.rvgg_in1k\",\"repvgg_b1g4.rvgg_in1k\",\"repvgg_b2.rvgg_in1k\",\"repvgg_b3.rvgg_in1k\",\"repvgg_b2g4.rvgg_in1k\",\"repvgg_b3g4.rvgg_in1k\"],\"legendgroup\":\"repvgg\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"repvgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00019805588344807372,0.00025848743492578826,0.0005164995790528431,0.0006192755714365336,0.0008039813154742284,0.0009981932701809725,0.0012302090125112257,0.0015526503741887404],\"xaxis\":\"x\",\"y\":[75.142,76.458,78.368,77.582,78.792,80.506,79.382,80.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[240],[240],[240],[240],[240],[240],[240],[240],[240],[408],[408]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=crossvit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"crossvit_tiny_240.in1k\",\"crossvit_9_240.in1k\",\"crossvit_9_dagger_240.in1k\",\"crossvit_small_240.in1k\",\"crossvit_15_240.in1k\",\"crossvit_15_dagger_240.in1k\",\"crossvit_18_240.in1k\",\"crossvit_18_dagger_240.in1k\",\"crossvit_base_240.in1k\",\"crossvit_15_dagger_408.in1k\",\"crossvit_18_dagger_408.in1k\"],\"legendgroup\":\"crossvit\",\"marker\":{\"color\":\"#FECB52\",\"size\":[57600,57600,57600,57600,57600,57600,57600,57600,57600,166464,166464],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"crossvit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00025943432938820195,0.0002746551018558445,0.0002807190900209978,0.0005422640609070993,0.0005881107530170082,0.0006054331571522846,0.0008294969101240098,0.0008531185749507324,0.0013383297644539614,0.002823662289990117,0.0038593647485623862],\"xaxis\":\"x\",\"y\":[73.336,73.958,76.98,81.016,81.534,82.33,82.396,82.516,82.216,83.842,84.198],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetv2_50.a1h_in1k\",\"resnetv2_101.a1h_in1k\"],\"legendgroup\":\"resnetv2\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00027003891260730673,0.0004473172150030194],\"xaxis\":\"x\",\"y\":[81.398,83.002],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convit_tiny.fb_in1k\",\"convit_small.fb_in1k\",\"convit_base.fb_in1k\"],\"legendgroup\":\"convit\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0003142578800163414,0.0007307163943530237,0.0014544608313698112],\"xaxis\":\"x\",\"y\":[73.112,81.42,82.29],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetaad<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetaa50d.sw_in12k_ft_in1k\",\"resnetaa101d.sw_in12k_ft_in1k\"],\"legendgroup\":\"resnetaad\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetaad\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00034852799202567954,0.0005280918457338101],\"xaxis\":\"x\",\"y\":[82.6,84.124],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[288],[320],[320],[352],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetrs<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetrs50.tf_in1k\",\"resnetrs101.tf_in1k\",\"resnetrs152.tf_in1k\",\"resnetrs200.tf_in1k\",\"resnetrs270.tf_in1k\",\"resnetrs350.tf_in1k\",\"resnetrs420.tf_in1k\"],\"legendgroup\":\"resnetrs\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,82944,102400,102400,123904,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetrs\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.000351576645466595,0.0009125586318920991,0.0015921792156925183,0.0021917327839389824,0.0034781398907864076,0.005297171310520182,0.007450454477723141],\"xaxis\":\"x\",\"y\":[79.896,82.284,83.702,84.444,84.428,84.714,85.006],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[320],[320],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetz<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetz_b16.ra3_in1k\",\"regnetz_c16.ra3_in1k\",\"regnetz_d8.ra3_in1k\",\"regnetz_040.ra3_in1k\",\"regnetz_d32.ra3_in1k\",\"regnetz_e8.ra3_in1k\",\"regnetz_c16_evos.ch_in1k\",\"regnetz_d8_evos.ch_in1k\"],\"legendgroup\":\"regnetz\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[82944,102400,102400,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetz\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00036824952587873543,0.0005641494319015222,0.0008748829844008363,0.000961917679085024,0.0009901872444079175,0.0016463344363774057,0.00167117884956048,0.002579646588417387],\"xaxis\":\"x\",\"y\":[80.728,82.634,84.054,84.24,84.022,85.036,82.632,84.126],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetblur<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetblur50.bt_in1k\"],\"legendgroup\":\"resnetblur\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetblur\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00038181346121538863],\"xaxis\":\"x\",\"y\":[80.234],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vgg11_bn.tv_in1k\",\"vgg13.tv_in1k\",\"vgg13_bn.tv_in1k\",\"vgg16.tv_in1k\",\"vgg19.tv_in1k\",\"vgg16_bn.tv_in1k\",\"vgg19_bn.tv_in1k\"],\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#FF6692\",\"size\":[50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0003856239395341663,0.000495051955702751,0.000609002271578473,0.00061273383454961,0.0007314379338341244,0.0007335465508641178,0.0008591212907438273],\"xaxis\":\"x\",\"y\":[70.382,69.932,71.588,71.592,72.378,73.37,74.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnetv2_rw_t.ra2_in1k\",\"efficientnetv2_rw_s.ra2_in1k\",\"efficientnetv2_rw_m.agc_in1k\"],\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#B6E880\",\"size\":[82944,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00039287790926091805,0.0009177342975661686,0.0025433643623785545],\"xaxis\":\"x\",\"y\":[82.35,83.808,84.812],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convnext<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convnext_tiny.in12k_ft_in1k_384\",\"convnext_tiny.in12k_ft_in1k\",\"convnext_tiny.fb_in22k_ft_in1k_384\",\"convnext_tiny.fb_in1k\",\"convnext_tiny.fb_in22k_ft_in1k\",\"convnext_tiny_hnf.a2h_in1k\",\"convnext_small.in12k_ft_in1k_384\",\"convnext_small.fb_in22k_ft_in1k_384\",\"convnext_small.in12k_ft_in1k\",\"convnext_small.fb_in22k_ft_in1k\",\"convnext_small.fb_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k_384\",\"convnext_base.fb_in22k_ft_in1k_384\",\"convnext_base.clip_laiona_augreg_ft_in1k_384\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k\",\"convnext_base.fb_in22k_ft_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in1k\",\"convnext_base.fb_in1k\",\"convnext_large.fb_in22k_ft_in1k_384\",\"convnext_large.fb_in22k_ft_in1k\",\"convnext_large.fb_in1k\"],\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convnext\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00048231356169272765,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001837424665588711,0.001837424665588711,0.001837424665588711],\"xaxis\":\"x\",\"y\":[85.122,84.45,84.088,82.698,78.898,82.584,86.182,85.778,85.33,85.262,83.7,87.134,86.796,86.502,86.37,86.274,86.158,84.428,87.472,87.026,84.846],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[384],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=swin<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"swin_tiny_patch4_window7_224.ms_in1k\",\"swin_tiny_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_s3_tiny_224.ms_in1k\",\"swin_small_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_small_patch4_window7_224.ms_in1k\",\"swin_s3_small_224.ms_in1k\",\"swin_base_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window7_224.ms_in1k\",\"swin_s3_base_224.ms_in1k\",\"swin_large_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in1k\",\"swin_large_patch4_window12_384.ms_in22k_ft_in1k\"],\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#FECB52\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,147456,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"swin\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0005460184335823177,0.0005460184335823177,0.000599319173418996,0.0008899409969119047,0.0008899409969119047,0.0012179822905374956,0.001254390366281987,0.001254390366281987,0.001502765087761481,0.002185123678000175,0.004700352526439483,0.004700352526439483,0.007950389569088886],\"xaxis\":\"x\",\"y\":[81.376,80.968,82.144,83.298,83.208,83.756,85.272,83.606,83.92,86.312,86.438,84.476,87.132],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[384],[384],[512]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=beit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"beit_base_patch16_224.in22k_ft_in22k_in1k\",\"beit_large_patch16_224.in22k_ft_in22k_in1k\",\"beit_base_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_512.in22k_ft_in22k_in1k\"],\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176,147456,147456,262144],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"beit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0010062791820962809,0.0030446034404018876,0.00418007774944614,0.0121580547112462,0.030184123151222455],\"xaxis\":\"x\",\"y\":[85.212,87.478,86.8,88.402,88.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetv<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetv_040.ra3_in1k\",\"regnetv_064.ra3_in1k\"],\"legendgroup\":\"regnetv\",\"marker\":{\"color\":\"#EF553B\",\"size\":[82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetv\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0011776343680813981,0.0021355201059217975],\"xaxis\":\"x\",\"y\":[83.198,83.716],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetv2d<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetv2_50d_evos.ah_in1k\"],\"legendgroup\":\"resnetv2d\",\"marker\":{\"color\":\"#00cc96\",\"size\":[82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetv2d\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0011976191331632715],\"xaxis\":\"x\",\"y\":[82.0],\"yaxis\":\"y\",\"type\":\"scatter\"}], {\"template\":{\"data\":{\"histogram2dcontour\":[{\"type\":\"histogram2dcontour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"choropleth\":[{\"type\":\"choropleth\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"histogram2d\":[{\"type\":\"histogram2d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmap\":[{\"type\":\"heatmap\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"type\":\"heatmapgl\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"type\":\"contourcarpet\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"contour\":[{\"type\":\"contour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"surface\":[{\"type\":\"surface\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"type\":\"mesh3d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"scatter\":[{\"fillpattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2},\"type\":\"scatter\"}],\"parcoords\":[{\"type\":\"parcoords\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"type\":\"scatterpolargl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"bar\":[{\"error_x\":{\"color\":\"#2a3f5f\"},\"error_y\":{\"color\":\"#2a3f5f\"},\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"bar\"}],\"scattergeo\":[{\"type\":\"scattergeo\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"type\":\"scatterpolar\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"histogram\"}],\"scattergl\":[{\"type\":\"scattergl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"type\":\"scatter3d\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"type\":\"scattermapbox\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"type\":\"scatterternary\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"type\":\"scattercarpet\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"carpet\":[{\"aaxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"baxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"type\":\"carpet\"}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"#EBF0F8\"},\"line\":{\"color\":\"white\"}},\"header\":{\"fill\":{\"color\":\"#C8D4E3\"},\"line\":{\"color\":\"white\"}},\"type\":\"table\"}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"barpolar\"}],\"pie\":[{\"automargin\":true,\"type\":\"pie\"}]},\"layout\":{\"autotypenumbers\":\"strict\",\"colorway\":[\"#636efa\",\"#EF553B\",\"#00cc96\",\"#ab63fa\",\"#FFA15A\",\"#19d3f3\",\"#FF6692\",\"#B6E880\",\"#FF97FF\",\"#FECB52\"],\"font\":{\"color\":\"#2a3f5f\"},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"paper_bgcolor\":\"white\",\"plot_bgcolor\":\"#E5ECF6\",\"polar\":{\"bgcolor\":\"#E5ECF6\",\"angularaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"radialaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"ternary\":{\"bgcolor\":\"#E5ECF6\",\"aaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"baxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"caxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"colorscale\":{\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"diverging\":[[0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1,\"#276419\"]]},\"xaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"yaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"scene\":{\"xaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"yaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"zaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2}},\"shapedefaults\":{\"line\":{\"color\":\"#2a3f5f\"}},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"geo\":{\"bgcolor\":\"white\",\"landcolor\":\"#E5ECF6\",\"subunitcolor\":\"white\",\"showland\":true,\"showlakes\":true,\"lakecolor\":\"white\"},\"title\":{\"x\":0.05},\"mapbox\":{\"style\":\"light\"}}},\"xaxis\":{\"anchor\":\"y\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"secs\"},\"type\":\"log\"},\"yaxis\":{\"anchor\":\"x\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"top1\"}},\"legend\":{\"title\":{\"text\":\"family\"},\"tracegroupgap\":0,\"itemsizing\":\"constant\"},\"title\":{\"text\":\"Inference\"},\"height\":800,\"width\":1000}, {\"responsive\": true} ).then(function(){\n",
|
|
" \n",
|
|
"var gd = document.getElementById('9a27303f-f4a0-4473-a5aa-129d200584d7');\n",
|
|
"var x = new MutationObserver(function (mutations, observer) {{\n",
|
|
" var display = window.getComputedStyle(gd).display;\n",
|
|
" if (!display || display === 'none') {{\n",
|
|
" console.log([gd, 'removed!']);\n",
|
|
" Plotly.purge(gd);\n",
|
|
" observer.disconnect();\n",
|
|
" }}\n",
|
|
"}});\n",
|
|
"\n",
|
|
"// Listen for the removal of the full notebook cells\n",
|
|
"var notebookContainer = gd.closest('#notebook-container');\n",
|
|
"if (notebookContainer) {{\n",
|
|
" x.observe(notebookContainer, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
"// Listen for the clearing of the current output cell\n",
|
|
"var outputEl = gd.closest('.output');\n",
|
|
"if (outputEl) {{\n",
|
|
" x.observe(outputEl, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
" }) }; }); </script> </div>"
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
}
|
|
],
|
|
"source": [
|
|
"show_all(df, 'Inference', 'infer_img_size')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "d868f5e1",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.037784,
|
|
"end_time": "2023-06-06T00:09:23.950736",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:23.912952",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"That number of families can be a bit overwhelming, so I'll just pick a subset which represents a single key model from each of the families that are looking best in our plot. I've also separated convnext models into those which have been pretrained on the larger 22,000 category imagenet sample (`convnext_in22`) vs those that haven't (`convnext`). (Note that many of the best performing models were trained on the larger sample -- see the papers for details before coming to conclusions about the effectiveness of these architectures more generally.)"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 8,
|
|
"id": "1a2b9819",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:24.034486Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:24.033959Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:24.037512Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:24.036869Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.049404,
|
|
"end_time": "2023-06-06T00:09:24.039792",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:23.990388",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"subs = 'levit|resnetd?|regnetx|vgg|convnext.*|efficientnetv2|beit|swin'"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "89918e3b",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.038349,
|
|
"end_time": "2023-06-06T00:09:24.121056",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:24.082707",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"In this chart, I'll add lines through the points of each family, to help see how they compare -- but note that we can see that a linear fit isn't actually ideal here! It's just there to help visually see the groups."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 9,
|
|
"id": "594b9d99",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:24.200873Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:24.200527Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:24.207337Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:24.206287Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.04978,
|
|
"end_time": "2023-06-06T00:09:24.210021",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:24.160241",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"def show_subs(df, title, size):\n",
|
|
" df_subs = df[df.family.str.fullmatch(subs)]\n",
|
|
" return px.scatter(df_subs, width=w, height=h, size=df_subs[size]**2, title=title,\n",
|
|
" trendline=\"ols\", trendline_options={'log_x':True},\n",
|
|
" x='secs', y='top1', log_x=True, color='family', hover_name='model_org', hover_data=[size])"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 10,
|
|
"id": "41360002",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:24.287887Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:24.287408Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:26.028754Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:26.027866Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 1.783648,
|
|
"end_time": "2023-06-06T00:09:26.031328",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:24.247680",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
"<div> <div id=\"5496e76f-7e1c-4bf8-b439-9bf49ae1fa11\" class=\"plotly-graph-div\" style=\"height:800px; width:1000px;\"></div> <script type=\"text/javascript\"> require([\"plotly\"], function(Plotly) { window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById(\"5496e76f-7e1c-4bf8-b439-9bf49ae1fa11\")) { Plotly.newPlot( \"5496e76f-7e1c-4bf8-b439-9bf49ae1fa11\", [{\"customdata\":[[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=levit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"levit_128s.fb_dist_in1k\",\"levit_128.fb_dist_in1k\",\"levit_192.fb_dist_in1k\",\"levit_256.fb_dist_in1k\",\"levit_384.fb_dist_in1k\"],\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"levit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00004654236751715086,0.00006822292249261998,0.00007756230968148262,0.00010599687945186893,0.00017720128293728847],\"xaxis\":\"x\",\"y\":[76.526,78.49,79.838,81.514,82.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 10.7162 * log10(secs) + 123.375<br>R<sup>2</sup>=0.940996<br><br>family=levit<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"levit\",\"showlegend\":false,\"x\":[0.00004654236751715086,0.00006822292249261998,0.00007756230968148262,0.00010599687945186893,0.00017720128293728847],\"xaxis\":\"x\",\"y\":[76.95096801723007,78.73074001900792,79.32785302803947,80.78142819739179,83.17301073833012],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetx<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetx_002.pycls_in1k\",\"regnetx_004.pycls_in1k\",\"regnetx_008.tv2_in1k\",\"regnetx_008.pycls_in1k\",\"regnetx_006.pycls_in1k\",\"regnetx_016.tv2_in1k\",\"regnetx_016.pycls_in1k\",\"regnetx_032.tv2_in1k\",\"regnetx_032.pycls_in1k\",\"regnetx_040.pycls_in1k\",\"regnetx_080.tv2_in1k\",\"regnetx_080.pycls_in1k\",\"regnetx_064.pycls_in1k\",\"regnetx_120.pycls_in1k\",\"regnetx_160.tv2_in1k\",\"regnetx_160.pycls_in1k\",\"regnetx_320.tv2_in1k\",\"regnetx_320.pycls_in1k\"],\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetx\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00005611048828469115,0.00006925193368711838,0.00011822399190402103,0.00011822399190402103,0.0001259786970023369,0.00026479614668647344,0.00026479614668647344,0.0006228278877415016,0.0006228278877415016,0.0006304057291272663,0.0007938902208602596,0.0007938902208602596,0.0008572212316554657,0.0012854296548621376,0.001604157977477622,0.001604157977477622,0.0038134462113411888,0.0038134462113411888],\"xaxis\":\"x\",\"y\":[68.746,72.398,77.304,75.03,73.868,79.436,76.924,80.926,78.168,78.492,81.538,79.202,79.066,79.588,82.566,79.866,82.81,80.246],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 5.61518 * log10(secs) + 96.687<br>R<sup>2</sup>=0.746676<br><br>family=regnetx<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#EF553B\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"regnetx\",\"showlegend\":false,\"x\":[0.00005611048828469115,0.00006925193368711838,0.00011822399190402103,0.00011822399190402103,0.0001259786970023369,0.00026479614668647344,0.00026479614668647344,0.0006228278877415016,0.0006228278877415016,0.0006304057291272663,0.0007938902208602596,0.0007938902208602596,0.0008572212316554657,0.0012854296548621376,0.001604157977477622,0.001604157977477622,0.0038134462113411888,0.0038134462113411888],\"xaxis\":\"x\",\"y\":[72.81712701145526,73.33028628679246,74.63454503496244,74.63454503496244,74.7894762361679,76.60101503914758,76.60101503914758,78.68680957427861,78.68680957427861,78.71630106780744,79.27860689563481,79.27860689563481,79.46577470059947,80.45379594191856,80.99396964700495,80.99396964700495,83.10567318660094,83.10567318660094],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[256],[224],[224],[224],[224],[224],[224],[224],[288],[288],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18.fb_swsl_ig1b_ft_in1k\",\"resnet18.a1_in1k\",\"resnet18.fb_ssl_yfcc100m_ft_in1k\",\"resnet18.a2_in1k\",\"resnet18.gluon_in1k\",\"resnet18.tv_in1k\",\"resnet18.a3_in1k\",\"resnet34.a1_in1k\",\"resnet34.a2_in1k\",\"resnet34.bt_in1k\",\"resnet34.gluon_in1k\",\"resnet34.a3_in1k\",\"resnet26.bt_in1k\",\"resnet26t.ra2_in1k\",\"resnet50.a1_in1k\",\"resnet50.fb_swsl_ig1b_ft_in1k\",\"resnet50.d_in1k\",\"resnet50.c1_in1k\",\"resnet50.c2_in1k\",\"resnet50.tv2_in1k\",\"resnet50.a2_in1k\",\"resnet50.b1k_in1k\",\"resnet50.a1h_in1k\",\"resnet50.b2k_in1k\",\"resnet50.ram_in1k\",\"resnet50.ra_in1k\",\"resnet50.bt_in1k\",\"resnet50.fb_ssl_yfcc100m_ft_in1k\",\"resnet50.am_in1k\",\"resnet50.a3_in1k\",\"resnet50.gluon_in1k\",\"resnet50.tv_in1k\",\"resnet32ts.ra2_in1k\",\"resnet33ts.ra2_in1k\",\"resnet101.a1h_in1k\",\"resnet101.a1_in1k\",\"resnet101.a2_in1k\",\"resnet101.tv2_in1k\",\"resnet101.a3_in1k\",\"resnet101.gluon_in1k\",\"resnet101.tv_in1k\",\"resnet51q.ra2_in1k\",\"resnet61q.ra2_in1k\",\"resnet152.a1h_in1k\",\"resnet152.a1_in1k\",\"resnet152.a2_in1k\",\"resnet152.tv2_in1k\",\"resnet152.a3_in1k\",\"resnet152.gluon_in1k\",\"resnet152.tv_in1k\"],\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,65536,50176,50176,50176,50176,50176,50176,50176,82944,82944,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00017561482751111642,0.0002638710409448694,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00029286350217890445,0.00029674294938752255,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.000534896657965681,0.0005959830740806961,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052],\"xaxis\":\"x\",\"y\":[73.282,73.158,72.594,72.372,70.838,69.76,68.254,77.918,77.158,76.48,74.578,72.97,76.366,78.332,81.214,81.182,80.972,80.912,80.87,80.85,80.772,80.706,80.676,80.454,79.976,79.836,79.64,79.234,78.998,78.048,77.58,76.13,79.392,79.726,82.778,82.322,82.236,81.89,79.814,79.31,77.376,82.36,82.524,83.45,82.732,82.608,82.288,80.546,79.694,78.322],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 11.8619 * log10(secs) + 120.758<br>R<sup>2</sup>=0.729144<br><br>family=resnet<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#00cc96\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"resnet\",\"showlegend\":false,\"x\":[0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00017561482751111642,0.0002638710409448694,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00029286350217890445,0.00029674294938752255,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.000534896657965681,0.0005959830740806961,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052],\"xaxis\":\"x\",\"y\":[72.90117975826331,72.90117975826331,72.90117975826331,72.90117975826331,72.90117975826331,72.90117975826331,72.90117975826331,75.72143552808535,75.72143552808535,75.72143552808535,75.72143552808535,75.72143552808535,76.2110276070153,78.30857867190008,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.67617789222197,78.84560987642557,78.91340265608835,81.17871958879768,81.17871958879768,81.17871958879768,81.17871958879768,81.17871958879768,81.17871958879768,81.17871958879768,81.94874493920726,82.50582897216374,83.058161735336,83.058161735336,83.058161735336,83.058161735336,83.058161735336,83.058161735336,83.058161735336],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetd<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18d.ra2_in1k\",\"resnet34d.ra2_in1k\",\"resnet26d.bt_in1k\",\"resnet50d.a1_in1k\",\"resnet50d.ra2_in1k\",\"resnet50d.a2_in1k\",\"resnet50d.gluon_in1k\",\"resnet50d.a3_in1k\",\"resnet101d.ra2_in1k\",\"resnet101d.gluon_in1k\",\"resnet152d.ra2_in1k\",\"resnet152d.gluon_in1k\",\"resnet200d.ra2_in1k\"],\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetd\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00011218547400045547,0.00017947263760167124,0.0002044542400742578,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.0010008807750820723,0.0010008807750820723,0.0014054023666975855,0.0014054023666975855,0.0019066503965832825],\"xaxis\":\"x\",\"y\":[73.794,78.436,77.408,81.45,81.356,81.164,79.078,78.722,83.016,80.426,83.684,80.476,83.964],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 5.6549 * log10(secs) + 99.0794<br>R<sup>2</sup>=0.645118<br><br>family=resnetd<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#ab63fa\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"resnetd\",\"showlegend\":false,\"x\":[0.00011218547400045547,0.00017947263760167124,0.0002044542400742578,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.0010008807750820723,0.0010008807750820723,0.0014054023666975855,0.0014054023666975855,0.0019066503965832825],\"xaxis\":\"x\",\"y\":[76.74221699212637,77.89616507547632,78.21622041619177,79.25698388797704,79.25698388797704,79.25698388797704,79.25698388797704,79.25698388797704,82.11689267526668,82.11689267526668,82.95052863536014,82.95052863536014,83.6996354550672],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vgg11_bn.tv_in1k\",\"vgg13.tv_in1k\",\"vgg13_bn.tv_in1k\",\"vgg16.tv_in1k\",\"vgg19.tv_in1k\",\"vgg16_bn.tv_in1k\",\"vgg19_bn.tv_in1k\"],\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0003856239395341663,0.000495051955702751,0.000609002271578473,0.00061273383454961,0.0007314379338341244,0.0007335465508641178,0.0008591212907438273],\"xaxis\":\"x\",\"y\":[70.382,69.932,71.588,71.592,72.378,73.37,74.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 11.8636 * log10(secs) + 110.028<br>R<sup>2</sup>=0.823327<br><br>family=vgg<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#FFA15A\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"vgg\",\"showlegend\":false,\"x\":[0.0003856239395341663,0.000495051955702751,0.000609002271578473,0.00061273383454961,0.0007314379338341244,0.0007335465508641178,0.0008591212907438273],\"xaxis\":\"x\",\"y\":[69.52744196709088,70.81449063233083,71.88184049620659,71.91331414679172,72.8256949943296,72.84052691476131,73.65469084848854],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnetv2_rw_t.ra2_in1k\",\"efficientnetv2_rw_s.ra2_in1k\",\"efficientnetv2_rw_m.agc_in1k\"],\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[82944,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00039287790926091805,0.0009177342975661686,0.0025433643623785545],\"xaxis\":\"x\",\"y\":[82.35,83.808,84.812],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 3.00972 * log10(secs) + 92.7236<br>R<sup>2</sup>=0.974977<br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#19d3f3\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"efficientnetv2\",\"showlegend\":false,\"x\":[0.00039287790926091805,0.0009177342975661686,0.0025433643623785545],\"xaxis\":\"x\",\"y\":[82.47323531828722,83.58219394486426,84.91457073684843],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convnext<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convnext_tiny.in12k_ft_in1k_384\",\"convnext_tiny.in12k_ft_in1k\",\"convnext_tiny.fb_in22k_ft_in1k_384\",\"convnext_tiny.fb_in1k\",\"convnext_tiny.fb_in22k_ft_in1k\",\"convnext_tiny_hnf.a2h_in1k\",\"convnext_small.in12k_ft_in1k_384\",\"convnext_small.fb_in22k_ft_in1k_384\",\"convnext_small.in12k_ft_in1k\",\"convnext_small.fb_in22k_ft_in1k\",\"convnext_small.fb_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k_384\",\"convnext_base.fb_in22k_ft_in1k_384\",\"convnext_base.clip_laiona_augreg_ft_in1k_384\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k\",\"convnext_base.fb_in22k_ft_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in1k\",\"convnext_base.fb_in1k\",\"convnext_large.fb_in22k_ft_in1k_384\",\"convnext_large.fb_in22k_ft_in1k\",\"convnext_large.fb_in1k\"],\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#FF6692\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convnext\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00048231356169272765,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001837424665588711,0.001837424665588711,0.001837424665588711],\"xaxis\":\"x\",\"y\":[85.122,84.45,84.088,82.698,78.898,82.584,86.182,85.778,85.33,85.262,83.7,87.134,86.796,86.502,86.37,86.274,86.158,84.428,87.472,87.026,84.846],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 6.3023 * log10(secs) + 104.608<br>R<sup>2</sup>=0.438464<br><br>family=convnext<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#FF6692\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"convnext\",\"showlegend\":false,\"x\":[0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00048231356169272765,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001837424665588711,0.001837424665588711,0.001837424665588711],\"xaxis\":\"x\",\"y\":[83.45100915074967,83.45100915074967,83.45100915074967,83.45100915074967,83.45100915074967,83.70560180292446,84.7597473424685,84.7597473424685,84.7597473424685,84.7597473424685,84.7597473424685,85.74845218086053,85.74845218086053,85.74845218086053,85.74845218086053,85.74845218086053,85.74845218086053,85.74845218086053,87.36648348832054,87.36648348832054,87.36648348832054],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[384],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=swin<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"swin_tiny_patch4_window7_224.ms_in1k\",\"swin_tiny_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_s3_tiny_224.ms_in1k\",\"swin_small_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_small_patch4_window7_224.ms_in1k\",\"swin_s3_small_224.ms_in1k\",\"swin_base_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window7_224.ms_in1k\",\"swin_s3_base_224.ms_in1k\",\"swin_large_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in1k\",\"swin_large_patch4_window12_384.ms_in22k_ft_in1k\"],\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#B6E880\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,147456,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"swin\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0005460184335823177,0.0005460184335823177,0.000599319173418996,0.0008899409969119047,0.0008899409969119047,0.0012179822905374956,0.001254390366281987,0.001254390366281987,0.001502765087761481,0.002185123678000175,0.004700352526439483,0.004700352526439483,0.007950389569088886],\"xaxis\":\"x\",\"y\":[81.376,80.968,82.144,83.298,83.208,83.756,85.272,83.606,83.92,86.312,86.438,84.476,87.132],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 4.44822 * log10(secs) + 96.5866<br>R<sup>2</sup>=0.772263<br><br>family=swin<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#B6E880\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"swin\",\"showlegend\":false,\"x\":[0.0005460184335823177,0.0005460184335823177,0.000599319173418996,0.0008899409969119047,0.0008899409969119047,0.0012179822905374956,0.001254390366281987,0.001254390366281987,0.001502765087761481,0.002185123678000175,0.004700352526439483,0.004700352526439483,0.007950389569088886],\"xaxis\":\"x\",\"y\":[82.07297953517894,82.07297953517894,82.25291375045575,83.01668605778377,83.01668605778377,83.62288793625561,83.67978834880432,83.67978834880432,84.02878824172078,84.75200119523171,86.23172002783448,86.23172002783448,87.24706093713317],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[384],[384],[512]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=beit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>infer_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"beit_base_patch16_224.in22k_ft_in22k_in1k\",\"beit_large_patch16_224.in22k_ft_in22k_in1k\",\"beit_base_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_512.in22k_ft_in22k_in1k\"],\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[50176,50176,147456,147456,262144],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"beit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0010062791820962809,0.0030446034404018876,0.00418007774944614,0.0121580547112462,0.030184123151222455],\"xaxis\":\"x\",\"y\":[85.212,87.478,86.8,88.402,88.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 2.24263 * log10(secs) + 92.3785<br>R<sup>2</sup>=0.860671<br><br>family=beit<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#FF97FF\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"beit\",\"showlegend\":false,\"x\":[0.0010062791820962809,0.0030446034404018876,0.00418007774944614,0.0121580547112462,0.030184123151222455],\"xaxis\":\"x\",\"y\":[85.6566759037742,86.73495920794267,87.04366516942372,88.08352661170262,88.96917310715659],\"yaxis\":\"y\",\"type\":\"scatter\"}], {\"template\":{\"data\":{\"histogram2dcontour\":[{\"type\":\"histogram2dcontour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"choropleth\":[{\"type\":\"choropleth\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"histogram2d\":[{\"type\":\"histogram2d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmap\":[{\"type\":\"heatmap\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"type\":\"heatmapgl\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"type\":\"contourcarpet\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"contour\":[{\"type\":\"contour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"surface\":[{\"type\":\"surface\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"type\":\"mesh3d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"scatter\":[{\"fillpattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2},\"type\":\"scatter\"}],\"parcoords\":[{\"type\":\"parcoords\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"type\":\"scatterpolargl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"bar\":[{\"error_x\":{\"color\":\"#2a3f5f\"},\"error_y\":{\"color\":\"#2a3f5f\"},\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"bar\"}],\"scattergeo\":[{\"type\":\"scattergeo\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"type\":\"scatterpolar\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"histogram\"}],\"scattergl\":[{\"type\":\"scattergl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"type\":\"scatter3d\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"type\":\"scattermapbox\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"type\":\"scatterternary\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"type\":\"scattercarpet\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"carpet\":[{\"aaxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"baxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"type\":\"carpet\"}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"#EBF0F8\"},\"line\":{\"color\":\"white\"}},\"header\":{\"fill\":{\"color\":\"#C8D4E3\"},\"line\":{\"color\":\"white\"}},\"type\":\"table\"}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"barpolar\"}],\"pie\":[{\"automargin\":true,\"type\":\"pie\"}]},\"layout\":{\"autotypenumbers\":\"strict\",\"colorway\":[\"#636efa\",\"#EF553B\",\"#00cc96\",\"#ab63fa\",\"#FFA15A\",\"#19d3f3\",\"#FF6692\",\"#B6E880\",\"#FF97FF\",\"#FECB52\"],\"font\":{\"color\":\"#2a3f5f\"},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"paper_bgcolor\":\"white\",\"plot_bgcolor\":\"#E5ECF6\",\"polar\":{\"bgcolor\":\"#E5ECF6\",\"angularaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"radialaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"ternary\":{\"bgcolor\":\"#E5ECF6\",\"aaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"baxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"caxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"colorscale\":{\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"diverging\":[[0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1,\"#276419\"]]},\"xaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"yaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"scene\":{\"xaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"yaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"zaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2}},\"shapedefaults\":{\"line\":{\"color\":\"#2a3f5f\"}},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"geo\":{\"bgcolor\":\"white\",\"landcolor\":\"#E5ECF6\",\"subunitcolor\":\"white\",\"showland\":true,\"showlakes\":true,\"lakecolor\":\"white\"},\"title\":{\"x\":0.05},\"mapbox\":{\"style\":\"light\"}}},\"xaxis\":{\"anchor\":\"y\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"secs\"},\"type\":\"log\"},\"yaxis\":{\"anchor\":\"x\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"top1\"}},\"legend\":{\"title\":{\"text\":\"family\"},\"tracegroupgap\":0,\"itemsizing\":\"constant\"},\"title\":{\"text\":\"Inference\"},\"height\":800,\"width\":1000}, {\"responsive\": true} ).then(function(){\n",
|
|
" \n",
|
|
"var gd = document.getElementById('5496e76f-7e1c-4bf8-b439-9bf49ae1fa11');\n",
|
|
"var x = new MutationObserver(function (mutations, observer) {{\n",
|
|
" var display = window.getComputedStyle(gd).display;\n",
|
|
" if (!display || display === 'none') {{\n",
|
|
" console.log([gd, 'removed!']);\n",
|
|
" Plotly.purge(gd);\n",
|
|
" observer.disconnect();\n",
|
|
" }}\n",
|
|
"}});\n",
|
|
"\n",
|
|
"// Listen for the removal of the full notebook cells\n",
|
|
"var notebookContainer = gd.closest('#notebook-container');\n",
|
|
"if (notebookContainer) {{\n",
|
|
" x.observe(notebookContainer, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
"// Listen for the clearing of the current output cell\n",
|
|
"var outputEl = gd.closest('.output');\n",
|
|
"if (outputEl) {{\n",
|
|
" x.observe(outputEl, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
" }) }; }); </script> </div>"
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
}
|
|
],
|
|
"source": [
|
|
"show_subs(df, 'Inference', 'infer_img_size')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "044f9ada",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.039246,
|
|
"end_time": "2023-06-06T00:09:26.112121",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.072875",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"From this, we can see that the *levit* family models are extremely fast for image recognition, and clearly the most accurate amongst the faster models. That's not surprising, since these models are a hybrid of the best ideas from CNNs and transformers, so get the benefit of each. In fact, we see a similar thing even in the middle category of speeds -- the best is the ConvNeXt, which is a pure CNN, but which takes advantage of ideas from the transformers literature.\n",
|
|
"\n",
|
|
"For the slowest models, *beit* is the most accurate -- although we need to be a bit careful of interpreting this, since it's trained on a larger dataset (ImageNet-21k, which is also used for *vit* models).\n",
|
|
"\n",
|
|
"I'll add one other plot here, which is of speed vs parameter count. Often, parameter count is used in papers as a proxy for speed. However, as we see, there is a wide variation in speeds at each level of parameter count, so it's really not a useful proxy.\n",
|
|
"\n",
|
|
"(Parameter count may be be useful for identifying how much memory a model needs, but even for that it's not always a great proxy.)"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 11,
|
|
"id": "10ac5b5b",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:26.198946Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:26.198348Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:26.314035Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:26.313164Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.16186,
|
|
"end_time": "2023-06-06T00:09:26.316322",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.154462",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
"<div> <div id=\"0d6571ef-c42e-4c56-97f2-e2bb88392a3e\" class=\"plotly-graph-div\" style=\"height:800px; width:1000px;\"></div> <script type=\"text/javascript\"> require([\"plotly\"], function(Plotly) { window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById(\"0d6571ef-c42e-4c56-97f2-e2bb88392a3e\")) { Plotly.newPlot( \"0d6571ef-c42e-4c56-97f2-e2bb88392a3e\", [{\"customdata\":[[21485.8,\"levit\"],[17821.98,\"regnetx\"],[16673.08,\"regnety\"],[14657.83,\"levit\"],[14440.03,\"regnetx\"],[12892.86,\"levit\"],[12098.59,\"vit\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[10826.05,\"resnet\"],[9982.58,\"regnety\"],[9895.77,\"vit\"],[9552.58,\"regnety\"],[9552.58,\"regnety\"],[9434.24,\"levit\"],[8999.14,\"efficientnet\"],[8913.81,\"resnetd\"],[8458.52,\"regnetx\"],[8458.52,\"regnetx\"],[7937.85,\"regnetx\"],[7871.11,\"regnety\"],[7681.79,\"efficientnet\"],[6262.0,\"resnet\"],[6262.0,\"resnet\"],[6262.0,\"resnet\"],[6262.0,\"resnet\"],[6262.0,\"resnet\"],[6224.71,\"vit\"],[6023.92,\"efficientnet\"],[5711.75,\"efficientnet\"],[5710.76,\"efficientnet\"],[5694.28,\"resnet\"],[5643.3,\"levit\"],[5571.88,\"resnetd\"],[5125.56,\"mobilevit\"],[5049.08,\"repvgg\"],[4891.07,\"resnetd\"],[4316.0,\"vit\"],[4316.0,\"vit\"],[4316.0,\"vit\"],[4101.97,\"efficientnet\"],[3868.66,\"repvgg\"],[3854.54,\"crossvit\"],[3821.39,\"efficientnet\"],[3802.4,\"vit\"],[3789.73,\"resnet\"],[3776.49,\"regnetx\"],[3776.49,\"regnetx\"],[3703.17,\"resnetv2\"],[3640.93,\"crossvit\"],[3562.28,\"crossvit\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3528.73,\"resnet\"],[3434.61,\"efficientnet\"],[3414.56,\"resnet\"],[3408.85,\"regnety\"],[3408.85,\"regnety\"],[3369.92,\"resnet\"],[3201.53,\"resnetd\"],[3201.53,\"resnetd\"],[3201.53,\"resnetd\"],[3201.53,\"resnetd\"],[3201.53,\"resnetd\"],[3182.1,\"convit\"],[3113.3,\"efficientnet\"],[3098.33,\"efficientnet\"],[3098.23,\"mobilevit\"],[2869.21,\"resnetaad\"],[2844.33,\"resnetrs\"],[2838.21,\"vit\"],[2838.21,\"vit\"],[2715.55,\"regnetz\"],[2700.75,\"vit\"],[2619.08,\"resnetblur\"],[2593.2,\"vgg\"],[2545.32,\"efficientnetv2\"],[2415.06,\"mobilevit\"],[2275.45,\"convnext\"],[2275.45,\"convnext\"],[2275.45,\"convnext\"],[2275.45,\"convnext\"],[2275.45,\"convnext\"],[2235.55,\"resnetv2\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2170.93,\"resnet\"],[2073.34,\"convnext\"],[2019.99,\"vgg\"],[1936.11,\"repvgg\"],[1893.61,\"resnetaad\"],[1869.52,\"resnet\"],[1853.06,\"efficientnet\"],[1844.12,\"crossvit\"],[1831.44,\"swin\"],[1831.44,\"swin\"],[1778.32,\"vit\"],[1772.58,\"regnetz\"],[1700.36,\"crossvit\"],[1677.9,\"resnet\"],[1668.56,\"swin\"],[1651.71,\"crossvit\"],[1642.03,\"vgg\"],[1632.03,\"vgg\"],[1614.79,\"repvgg\"],[1605.58,\"regnetx\"],[1605.58,\"regnetx\"],[1586.28,\"regnetx\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1507.31,\"resnet\"],[1505.49,\"efficientnet\"],[1505.01,\"efficientnet\"],[1460.68,\"vit\"],[1410.61,\"convnext\"],[1410.61,\"convnext\"],[1410.61,\"convnext\"],[1410.61,\"convnext\"],[1410.61,\"convnext\"],[1377.87,\"vit\"],[1377.87,\"vit\"],[1368.52,\"convit\"],[1367.75,\"regnety\"],[1367.75,\"regnety\"],[1367.75,\"regnety\"],[1367.17,\"vgg\"],[1363.24,\"vgg\"],[1259.62,\"regnetx\"],[1259.62,\"regnetx\"],[1243.81,\"repvgg\"],[1205.55,\"crossvit\"],[1172.17,\"crossvit\"],[1166.56,\"regnetx\"],[1163.98,\"vgg\"],[1143.01,\"regnetz\"],[1123.67,\"swin\"],[1123.67,\"swin\"],[1108.89,\"vit\"],[1095.82,\"resnetrs\"],[1089.64,\"efficientnetv2\"],[1073.46,\"vit\"],[1073.46,\"vit\"],[1073.46,\"vit\"],[1073.46,\"vit\"],[1073.46,\"vit\"],[1039.59,\"regnetz\"],[1009.91,\"regnetz\"],[1001.81,\"repvgg\"],[999.12,\"resnetd\"],[999.12,\"resnetd\"],[993.76,\"beit\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[982.94,\"convnext\"],[974.19,\"efficientnet\"],[849.33,\"regnety\"],[849.33,\"regnety\"],[849.16,\"regnetv\"],[834.99,\"resnetv2d\"],[821.03,\"swin\"],[812.87,\"repvgg\"],[797.2,\"swin\"],[797.2,\"swin\"],[777.95,\"regnetx\"],[754.35,\"regnety\"],[754.35,\"regnety\"],[747.2,\"crossvit\"],[721.71,\"vit\"],[711.54,\"resnetd\"],[711.54,\"resnetd\"],[687.54,\"convit\"],[683.58,\"vit\"],[683.58,\"vit\"],[665.44,\"swin\"],[644.06,\"repvgg\"],[628.07,\"resnetrs\"],[623.38,\"regnetx\"],[623.38,\"regnetx\"],[607.41,\"regnetz\"],[598.38,\"regnetz\"],[582.99,\"vit\"],[544.24,\"convnext\"],[544.24,\"convnext\"],[544.24,\"convnext\"],[536.38,\"regnety\"],[536.38,\"regnety\"],[524.48,\"resnetd\"],[479.45,\"vit\"],[471.86,\"regnety\"],[471.86,\"regnety\"],[468.27,\"regnetv\"],[467.72,\"efficientnet\"],[457.64,\"swin\"],[456.26,\"resnetrs\"],[415.34,\"regnety\"],[415.34,\"regnety\"],[415.34,\"regnety\"],[415.34,\"regnety\"],[415.34,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[414.45,\"regnety\"],[393.18,\"efficientnetv2\"],[387.65,\"regnetz\"],[354.58,\"vit\"],[354.15,\"crossvit\"],[328.45,\"beit\"],[287.51,\"resnetrs\"],[277.57,\"vit\"],[277.57,\"vit\"],[277.57,\"vit\"],[262.23,\"regnetx\"],[262.23,\"regnetx\"],[259.11,\"crossvit\"],[239.23,\"beit\"],[236.31,\"vit\"],[212.75,\"swin\"],[212.75,\"swin\"],[188.78,\"resnetrs\"],[182.98,\"vit\"],[182.98,\"vit\"],[171.75,\"vit\"],[134.22,\"resnetrs\"],[125.78,\"swin\"],[94.39,\"vit\"],[82.25,\"beit\"],[33.13,\"beit\"]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>param_count_x=%{x}<br>secs=%{y}<br>infer_samples_per_sec=%{customdata[0]}<br>family=%{customdata[1]}<br>infer_img_size=%{marker.color}<extra></extra>\",\"hovertext\":[\"levit_128s.fb_dist_in1k\",\"regnetx_002.pycls_in1k\",\"regnety_002.pycls_in1k\",\"levit_128.fb_dist_in1k\",\"regnetx_004.pycls_in1k\",\"levit_192.fb_dist_in1k\",\"vit_small_patch32_224.augreg_in21k_ft_in1k\",\"resnet18.fb_swsl_ig1b_ft_in1k\",\"resnet18.a1_in1k\",\"resnet18.fb_ssl_yfcc100m_ft_in1k\",\"resnet18.a2_in1k\",\"resnet18.gluon_in1k\",\"resnet18.tv_in1k\",\"resnet18.a3_in1k\",\"regnety_006.pycls_in1k\",\"vit_tiny_r_s16_p8_224.augreg_in21k_ft_in1k\",\"regnety_004.tv2_in1k\",\"regnety_004.pycls_in1k\",\"levit_256.fb_dist_in1k\",\"efficientnet_lite0.ra_in1k\",\"resnet18d.ra2_in1k\",\"regnetx_008.tv2_in1k\",\"regnetx_008.pycls_in1k\",\"regnetx_006.pycls_in1k\",\"regnety_008.pycls_in1k\",\"efficientnet_b0.ra_in1k\",\"resnet34.a1_in1k\",\"resnet34.a2_in1k\",\"resnet34.bt_in1k\",\"resnet34.gluon_in1k\",\"resnet34.a3_in1k\",\"vit_tiny_patch16_224.augreg_in21k_ft_in1k\",\"efficientnet_b1_pruned.in1k\",\"efficientnet_es.ra_in1k\",\"efficientnet_es_pruned.in1k\",\"resnet26.bt_in1k\",\"levit_384.fb_dist_in1k\",\"resnet34d.ra2_in1k\",\"mobilevit_xxs.cvnets_in1k\",\"repvgg_b0.rvgg_in1k\",\"resnet26d.bt_in1k\",\"vit_base_patch32_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_224.augreg_in1k\",\"vit_base_patch32_224.sam_in1k\",\"efficientnet_b1.ft_in1k\",\"repvgg_a2.rvgg_in1k\",\"crossvit_tiny_240.in1k\",\"efficientnet_b2_pruned.in1k\",\"vit_small_patch32_384.augreg_in21k_ft_in1k\",\"resnet26t.ra2_in1k\",\"regnetx_016.tv2_in1k\",\"regnetx_016.pycls_in1k\",\"resnetv2_50.a1h_in1k\",\"crossvit_9_240.in1k\",\"crossvit_9_dagger_240.in1k\",\"resnet50.a1_in1k\",\"resnet50.fb_swsl_ig1b_ft_in1k\",\"resnet50.d_in1k\",\"resnet50.c1_in1k\",\"resnet50.c2_in1k\",\"resnet50.tv2_in1k\",\"resnet50.a2_in1k\",\"resnet50.b1k_in1k\",\"resnet50.a1h_in1k\",\"resnet50.b2k_in1k\",\"resnet50.ram_in1k\",\"resnet50.ra_in1k\",\"resnet50.bt_in1k\",\"resnet50.fb_ssl_yfcc100m_ft_in1k\",\"resnet50.am_in1k\",\"resnet50.a3_in1k\",\"resnet50.gluon_in1k\",\"resnet50.tv_in1k\",\"efficientnet_em.ra2_in1k\",\"resnet32ts.ra2_in1k\",\"regnety_016.tv2_in1k\",\"regnety_016.pycls_in1k\",\"resnet33ts.ra2_in1k\",\"resnet50d.a1_in1k\",\"resnet50d.ra2_in1k\",\"resnet50d.a2_in1k\",\"resnet50d.gluon_in1k\",\"resnet50d.a3_in1k\",\"convit_tiny.fb_in1k\",\"efficientnet_b2.ra_in1k\",\"efficientnet_b3_pruned.in1k\",\"mobilevit_xs.cvnets_in1k\",\"resnetaa50d.sw_in12k_ft_in1k\",\"resnetrs50.tf_in1k\",\"vit_small_patch16_224.augreg_in21k_ft_in1k\",\"vit_small_patch16_224.augreg_in1k\",\"regnetz_b16.ra3_in1k\",\"vit_tiny_r_s16_p8_384.augreg_in21k_ft_in1k\",\"resnetblur50.bt_in1k\",\"vgg11_bn.tv_in1k\",\"efficientnetv2_rw_t.ra2_in1k\",\"mobilevit_s.cvnets_in1k\",\"convnext_tiny.in12k_ft_in1k_384\",\"convnext_tiny.in12k_ft_in1k\",\"convnext_tiny.fb_in22k_ft_in1k_384\",\"convnext_tiny.fb_in1k\",\"convnext_tiny.fb_in22k_ft_in1k\",\"resnetv2_101.a1h_in1k\",\"resnet101.a1h_in1k\",\"resnet101.a1_in1k\",\"resnet101.a2_in1k\",\"resnet101.tv2_in1k\",\"resnet101.a3_in1k\",\"resnet101.gluon_in1k\",\"resnet101.tv_in1k\",\"convnext_tiny_hnf.a2h_in1k\",\"vgg13.tv_in1k\",\"repvgg_b1.rvgg_in1k\",\"resnetaa101d.sw_in12k_ft_in1k\",\"resnet51q.ra2_in1k\",\"efficientnet_b3.ra2_in1k\",\"crossvit_small_240.in1k\",\"swin_tiny_patch4_window7_224.ms_in1k\",\"swin_tiny_patch4_window7_224.ms_in22k_ft_in1k\",\"vit_small_r26_s32_224.augreg_in21k_ft_in1k\",\"regnetz_c16.ra3_in1k\",\"crossvit_15_240.in1k\",\"resnet61q.ra2_in1k\",\"swin_s3_tiny_224.ms_in1k\",\"crossvit_15_dagger_240.in1k\",\"vgg13_bn.tv_in1k\",\"vgg16.tv_in1k\",\"repvgg_b1g4.rvgg_in1k\",\"regnetx_032.tv2_in1k\",\"regnetx_032.pycls_in1k\",\"regnetx_040.pycls_in1k\",\"resnet152.a1h_in1k\",\"resnet152.a1_in1k\",\"resnet152.a2_in1k\",\"resnet152.tv2_in1k\",\"resnet152.a3_in1k\",\"resnet152.gluon_in1k\",\"resnet152.tv_in1k\",\"efficientnet_el.ra_in1k\",\"efficientnet_el_pruned.in1k\",\"vit_tiny_patch16_384.augreg_in21k_ft_in1k\",\"convnext_small.in12k_ft_in1k_384\",\"convnext_small.fb_in22k_ft_in1k_384\",\"convnext_small.in12k_ft_in1k\",\"convnext_small.fb_in22k_ft_in1k\",\"convnext_small.fb_in1k\",\"vit_base_patch32_384.augreg_in21k_ft_in1k\",\"vit_base_patch32_384.augreg_in1k\",\"convit_small.fb_in1k\",\"regnety_032.ra_in1k\",\"regnety_032.tv2_in1k\",\"regnety_032.pycls_in1k\",\"vgg19.tv_in1k\",\"vgg16_bn.tv_in1k\",\"regnetx_080.tv2_in1k\",\"regnetx_080.pycls_in1k\",\"repvgg_b2.rvgg_in1k\",\"crossvit_18_240.in1k\",\"crossvit_18_dagger_240.in1k\",\"regnetx_064.pycls_in1k\",\"vgg19_bn.tv_in1k\",\"regnetz_d8.ra3_in1k\",\"swin_small_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_small_patch4_window7_224.ms_in1k\",\"vit_base_patch16_224_miil.in21k_ft_in1k\",\"resnetrs101.tf_in1k\",\"efficientnetv2_rw_s.ra2_in1k\",\"vit_base_patch16_224.augreg2_in21k_ft_in1k\",\"vit_base_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch16_224.orig_in21k_ft_in1k\",\"vit_base_patch16_224.sam_in1k\",\"vit_base_patch16_224.augreg_in1k\",\"regnetz_040.ra3_in1k\",\"regnetz_d32.ra3_in1k\",\"repvgg_b3.rvgg_in1k\",\"resnet101d.ra2_in1k\",\"resnet101d.gluon_in1k\",\"beit_base_patch16_224.in22k_ft_in22k_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k_384\",\"convnext_base.fb_in22k_ft_in1k_384\",\"convnext_base.clip_laiona_augreg_ft_in1k_384\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k\",\"convnext_base.fb_in22k_ft_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in1k\",\"convnext_base.fb_in1k\",\"efficientnet_b4.ra2_in1k\",\"regnety_040.ra3_in1k\",\"regnety_040.pycls_in1k\",\"regnetv_040.ra3_in1k\",\"resnetv2_50d_evos.ah_in1k\",\"swin_s3_small_224.ms_in1k\",\"repvgg_b2g4.rvgg_in1k\",\"swin_base_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window7_224.ms_in1k\",\"regnetx_120.pycls_in1k\",\"regnety_120.sw_in12k_ft_in1k\",\"regnety_120.pycls_in1k\",\"crossvit_base_240.in1k\",\"vit_large_r50_s32_224.augreg_in21k_ft_in1k\",\"resnet152d.ra2_in1k\",\"resnet152d.gluon_in1k\",\"convit_base.fb_in1k\",\"vit_small_patch16_384.augreg_in21k_ft_in1k\",\"vit_small_patch16_384.augreg_in1k\",\"swin_s3_base_224.ms_in1k\",\"repvgg_b3g4.rvgg_in1k\",\"resnetrs152.tf_in1k\",\"regnetx_160.tv2_in1k\",\"regnetx_160.pycls_in1k\",\"regnetz_e8.ra3_in1k\",\"regnetz_c16_evos.ch_in1k\",\"vit_small_r26_s32_384.augreg_in21k_ft_in1k\",\"convnext_large.fb_in22k_ft_in1k_384\",\"convnext_large.fb_in22k_ft_in1k\",\"convnext_large.fb_in1k\",\"regnety_080.ra3_in1k\",\"regnety_080.pycls_in1k\",\"resnet200d.ra2_in1k\",\"vit_large_patch32_384.orig_in21k_ft_in1k\",\"regnety_064.ra3_in1k\",\"regnety_064.pycls_in1k\",\"regnetv_064.ra3_in1k\",\"efficientnet_b5.sw_in12k_ft_in1k\",\"swin_large_patch4_window7_224.ms_in22k_ft_in1k\",\"resnetrs200.tf_in1k\",\"regnety_320.swag_ft_in1k\",\"regnety_320.swag_lc_in1k\",\"regnety_320.seer_ft_in1k\",\"regnety_320.tv2_in1k\",\"regnety_320.pycls_in1k\",\"regnety_160.swag_ft_in1k\",\"regnety_160.lion_in12k_ft_in1k\",\"regnety_160.sw_in12k_ft_in1k\",\"regnety_160.swag_lc_in1k\",\"regnety_160.deit_in1k\",\"regnety_160.tv2_in1k\",\"regnety_160.pycls_in1k\",\"efficientnetv2_rw_m.agc_in1k\",\"regnetz_d8_evos.ch_in1k\",\"vit_large_patch16_224.augreg_in21k_ft_in1k\",\"crossvit_15_dagger_408.in1k\",\"beit_large_patch16_224.in22k_ft_in22k_in1k\",\"resnetrs270.tf_in1k\",\"vit_base_patch16_384.augreg_in21k_ft_in1k\",\"vit_base_patch16_384.orig_in21k_ft_in1k\",\"vit_base_patch16_384.augreg_in1k\",\"regnetx_320.tv2_in1k\",\"regnetx_320.pycls_in1k\",\"crossvit_18_dagger_408.in1k\",\"beit_base_patch16_384.in22k_ft_in22k_in1k\",\"vit_large_r50_s32_384.augreg_in21k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in1k\",\"resnetrs350.tf_in1k\",\"vit_base_patch8_224.augreg2_in21k_ft_in1k\",\"vit_base_patch8_224.augreg_in21k_ft_in1k\",\"vit_base_r50_s16_384.orig_in21k_ft_in1k\",\"resnetrs420.tf_in1k\",\"swin_large_patch4_window12_384.ms_in22k_ft_in1k\",\"vit_large_patch16_384.augreg_in21k_ft_in1k\",\"beit_large_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_512.in22k_ft_in22k_in1k\"],\"legendgroup\":\"\",\"marker\":{\"color\":[224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,240,224,224,224,224,224,256,224,224,224,224,224,256,224,240,260,384,256,224,224,224,240,240,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,240,256,224,224,256,224,224,224,224,224,224,288,300,256,224,224,224,224,288,384,224,224,288,256,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,224,288,320,240,224,224,224,320,240,288,224,240,224,224,224,224,224,224,224,224,224,224,224,224,224,300,300,384,224,224,224,224,224,384,384,224,288,288,288,224,224,224,224,224,240,240,224,224,320,224,224,224,288,384,224,224,224,224,224,320,320,224,320,320,224,224,224,224,224,224,224,224,384,288,288,288,288,224,224,224,224,224,224,224,240,224,320,320,224,384,384,224,224,320,224,224,320,320,384,224,224,224,288,288,320,384,288,288,288,456,224,320,224,224,224,224,224,288,288,288,288,288,288,288,416,320,224,408,224,352,384,384,384,224,224,408,384,384,384,384,384,224,224,384,416,384,384,384,512],\"coloraxis\":\"coloraxis\",\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"\",\"orientation\":\"v\",\"showlegend\":false,\"x\":[7.78,2.68,3.16,9.21,5.16,10.95,22.88,11.69,11.69,11.69,11.69,11.69,11.69,11.69,6.06,6.34,4.34,4.34,18.89,4.65,11.71,7.26,7.26,6.2,6.26,5.29,21.8,21.8,21.8,21.8,21.8,5.72,6.33,5.44,5.44,16.0,39.13,21.82,1.27,15.82,16.01,88.22,88.22,88.22,7.79,28.21,7.01,8.31,22.92,16.01,9.19,9.19,25.55,8.55,8.78,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,25.56,6.9,17.96,11.2,11.2,19.68,25.58,25.58,25.58,25.58,25.58,5.71,9.11,9.86,2.32,25.58,35.69,22.05,22.05,9.72,6.36,25.56,132.87,13.65,5.58,28.59,28.59,28.59,28.59,28.59,44.54,44.55,44.55,44.55,44.55,44.55,44.55,44.55,28.59,133.05,57.42,44.57,35.7,12.23,26.86,28.29,28.29,36.43,13.46,27.53,36.85,28.33,28.21,133.05,138.36,39.97,15.3,15.3,22.12,60.19,60.19,60.19,60.19,60.19,60.19,60.19,10.59,10.59,5.79,50.22,50.22,50.22,50.22,50.22,88.3,88.3,27.78,19.44,19.44,19.44,143.67,138.37,39.57,39.57,89.02,43.27,44.27,26.21,143.68,23.37,49.61,49.61,86.54,63.62,23.94,86.57,86.57,86.57,86.57,86.57,27.12,27.58,123.09,44.57,44.57,86.53,88.59,88.59,88.59,88.59,88.59,88.59,88.59,19.34,20.65,20.65,20.64,25.59,49.74,61.76,87.77,87.77,46.11,51.82,51.82,105.03,328.99,60.21,60.21,86.54,22.2,22.2,71.13,83.83,86.62,54.28,54.28,57.7,13.49,36.47,197.77,197.77,197.77,39.18,39.18,64.69,306.63,30.58,30.58,30.58,30.39,196.53,93.21,145.05,145.05,145.05,145.05,145.05,83.59,83.59,83.59,83.59,83.59,83.59,83.59,53.24,23.46,304.33,28.5,304.43,129.86,86.86,86.86,86.86,107.81,107.81,44.61,86.74,329.09,87.9,87.9,163.96,86.58,86.58,98.95,191.89,196.74,304.72,305.0,305.67],\"xaxis\":\"x\",\"y\":[0.00004654236751715086,0.00005611048828469115,0.000059976920880845045,0.00006822292249261998,0.00006925193368711838,0.00007756230968148262,0.0000826542597112556,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00009236979323021786,0.00010017450398594352,0.00010105327831992861,0.00010468376082691796,0.00010468376082691796,0.00010599687945186893,0.00011112172940969915,0.00011218547400045547,0.00011822399190402103,0.00011822399190402103,0.0001259786970023369,0.00012704688411164372,0.0001301779923689661,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.00015969338869370808,0.0001606500543800434,0.00016600486062231902,0.00017507769072525934,0.00017510804166170527,0.00017561482751111642,0.00017720128293728847,0.00017947263760167124,0.00019510063290645313,0.00019805588344807372,0.0002044542400742578,0.00023169601482854495,0.00023169601482854495,0.00023169601482854495,0.00024378530315921374,0.00025848743492578826,0.00025943432938820195,0.0002616848842960284,0.0002629917946560067,0.0002638710409448694,0.00026479614668647344,0.00026479614668647344,0.00027003891260730673,0.0002746551018558445,0.0002807190900209978,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.00028338807446305045,0.0002911538719097656,0.00029286350217890445,0.00029335406368716726,0.00029335406368716726,0.00029674294938752255,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.00031235065734195835,0.0003142578800163414,0.00032120258246876303,0.00032275451614256713,0.00032276493352656195,0.00034852799202567954,0.000351576645466595,0.0003523347461956656,0.0003523347461956656,0.00036824952587873543,0.0003702675182819587,0.00038181346121538863,0.0003856239395341663,0.00039287790926091805,0.0004140683875348853,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.00043947351073414054,0.0004473172150030194,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00046063207933926936,0.00048231356169272765,0.000495051955702751,0.0005164995790528431,0.0005280918457338101,0.000534896657965681,0.000539647933688062,0.0005422640609070993,0.0005460184335823177,0.0005460184335823177,0.0005623284898106078,0.0005641494319015222,0.0005881107530170082,0.0005959830740806961,0.000599319173418996,0.0006054331571522846,0.000609002271578473,0.00061273383454961,0.0006192755714365336,0.0006228278877415016,0.0006228278877415016,0.0006304057291272663,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006634335339114052,0.0006642355645005945,0.0006644474123095528,0.0006846126461648,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007089131652263915,0.0007257578726585237,0.0007257578726585237,0.0007307163943530237,0.0007311277645768598,0.0007311277645768598,0.0007311277645768598,0.0007314379338341244,0.0007335465508641178,0.0007938902208602596,0.0007938902208602596,0.0008039813154742284,0.0008294969101240098,0.0008531185749507324,0.0008572212316554657,0.0008591212907438273,0.0008748829844008363,0.0008899409969119047,0.0008899409969119047,0.0009018027036045053,0.0009125586318920991,0.0009177342975661686,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.0009315670821455853,0.000961917679085024,0.0009901872444079175,0.0009981932701809725,0.0010008807750820723,0.0010008807750820723,0.0010062791820962809,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.001017356094980365,0.0010264938051098862,0.0011773986554107355,0.0011773986554107355,0.0011776343680813981,0.0011976191331632715,0.0012179822905374956,0.0012302090125112257,0.001254390366281987,0.001254390366281987,0.0012854296548621376,0.0013256445946841651,0.0013256445946841651,0.0013383297644539614,0.0013855980934170233,0.0014054023666975855,0.0014054023666975855,0.0014544608313698112,0.0014628865677755345,0.0014628865677755345,0.001502765087761481,0.0015526503741887404,0.0015921792156925183,0.001604157977477622,0.001604157977477622,0.0016463344363774057,0.00167117884956048,0.0017152952880838436,0.001837424665588711,0.001837424665588711,0.001837424665588711,0.0018643499011894553,0.0018643499011894553,0.0019066503965832825,0.002085723224528105,0.0021192726656211586,0.0021192726656211586,0.0021355201059217975,0.0021380313007782433,0.002185123678000175,0.0021917327839389824,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.002407666008571291,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0024128362890577875,0.0025433643623785545,0.002579646588417387,0.0028202380280895707,0.002823662289990117,0.0030446034404018876,0.0034781398907864076,0.0036026948157221604,0.0036026948157221604,0.0036026948157221604,0.0038134462113411888,0.0038134462113411888,0.0038593647485623862,0.00418007774944614,0.004231729507849859,0.004700352526439483,0.004700352526439483,0.005297171310520182,0.005465078150617554,0.005465078150617554,0.005822416302765648,0.007450454477723141,0.007950389569088886,0.010594342621040365,0.0121580547112462,0.030184123151222455],\"yaxis\":\"y\",\"type\":\"scatter\"}], {\"template\":{\"data\":{\"histogram2dcontour\":[{\"type\":\"histogram2dcontour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"choropleth\":[{\"type\":\"choropleth\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"histogram2d\":[{\"type\":\"histogram2d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmap\":[{\"type\":\"heatmap\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"type\":\"heatmapgl\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"type\":\"contourcarpet\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"contour\":[{\"type\":\"contour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"surface\":[{\"type\":\"surface\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"type\":\"mesh3d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"scatter\":[{\"fillpattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2},\"type\":\"scatter\"}],\"parcoords\":[{\"type\":\"parcoords\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"type\":\"scatterpolargl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"bar\":[{\"error_x\":{\"color\":\"#2a3f5f\"},\"error_y\":{\"color\":\"#2a3f5f\"},\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"bar\"}],\"scattergeo\":[{\"type\":\"scattergeo\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"type\":\"scatterpolar\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"histogram\"}],\"scattergl\":[{\"type\":\"scattergl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"type\":\"scatter3d\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"type\":\"scattermapbox\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"type\":\"scatterternary\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"type\":\"scattercarpet\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"carpet\":[{\"aaxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"baxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"type\":\"carpet\"}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"#EBF0F8\"},\"line\":{\"color\":\"white\"}},\"header\":{\"fill\":{\"color\":\"#C8D4E3\"},\"line\":{\"color\":\"white\"}},\"type\":\"table\"}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"barpolar\"}],\"pie\":[{\"automargin\":true,\"type\":\"pie\"}]},\"layout\":{\"autotypenumbers\":\"strict\",\"colorway\":[\"#636efa\",\"#EF553B\",\"#00cc96\",\"#ab63fa\",\"#FFA15A\",\"#19d3f3\",\"#FF6692\",\"#B6E880\",\"#FF97FF\",\"#FECB52\"],\"font\":{\"color\":\"#2a3f5f\"},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"paper_bgcolor\":\"white\",\"plot_bgcolor\":\"#E5ECF6\",\"polar\":{\"bgcolor\":\"#E5ECF6\",\"angularaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"radialaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"ternary\":{\"bgcolor\":\"#E5ECF6\",\"aaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"baxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"caxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"colorscale\":{\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"diverging\":[[0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1,\"#276419\"]]},\"xaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"yaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"scene\":{\"xaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"yaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"zaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2}},\"shapedefaults\":{\"line\":{\"color\":\"#2a3f5f\"}},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"geo\":{\"bgcolor\":\"white\",\"landcolor\":\"#E5ECF6\",\"subunitcolor\":\"white\",\"showland\":true,\"showlakes\":true,\"lakecolor\":\"white\"},\"title\":{\"x\":0.05},\"mapbox\":{\"style\":\"light\"}}},\"xaxis\":{\"anchor\":\"y\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"param_count_x\"},\"type\":\"log\"},\"yaxis\":{\"anchor\":\"x\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"secs\"},\"type\":\"log\"},\"coloraxis\":{\"colorbar\":{\"title\":{\"text\":\"infer_img_size\"}},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]},\"legend\":{\"tracegroupgap\":0},\"margin\":{\"t\":60},\"height\":800,\"width\":1000}, {\"responsive\": true} ).then(function(){\n",
|
|
" \n",
|
|
"var gd = document.getElementById('0d6571ef-c42e-4c56-97f2-e2bb88392a3e');\n",
|
|
"var x = new MutationObserver(function (mutations, observer) {{\n",
|
|
" var display = window.getComputedStyle(gd).display;\n",
|
|
" if (!display || display === 'none') {{\n",
|
|
" console.log([gd, 'removed!']);\n",
|
|
" Plotly.purge(gd);\n",
|
|
" observer.disconnect();\n",
|
|
" }}\n",
|
|
"}});\n",
|
|
"\n",
|
|
"// Listen for the removal of the full notebook cells\n",
|
|
"var notebookContainer = gd.closest('#notebook-container');\n",
|
|
"if (notebookContainer) {{\n",
|
|
" x.observe(notebookContainer, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
"// Listen for the clearing of the current output cell\n",
|
|
"var outputEl = gd.closest('.output');\n",
|
|
"if (outputEl) {{\n",
|
|
" x.observe(outputEl, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
" }) }; }); </script> </div>"
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
}
|
|
],
|
|
"source": [
|
|
"px.scatter(df, width=w, height=h,\n",
|
|
" x='param_count_x', y='secs', log_x=True, log_y=True, color='infer_img_size',\n",
|
|
" hover_name='model_org', hover_data=['infer_samples_per_sec', 'family']\n",
|
|
")"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "adddcfc5",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.040703,
|
|
"end_time": "2023-06-06T00:09:26.397893",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.357190",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"## Training results"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "81a05be8",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.041581,
|
|
"end_time": "2023-06-06T00:09:26.480648",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.439067",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"We'll now replicate the above analysis for training performance. First we grab the data:"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 12,
|
|
"id": "fbc3b0e3",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:26.571526Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:26.571055Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:26.599861Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:26.598755Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.080089,
|
|
"end_time": "2023-06-06T00:09:26.602703",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.522614",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": [
|
|
"tdf = get_data('train', 'train_samples_per_sec')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "764ade98",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.041981,
|
|
"end_time": "2023-06-06T00:09:26.686571",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.644590",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"Now we can repeat the same *family* plot we did above:"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 13,
|
|
"id": "bff04fca",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:26.773391Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:26.773101Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:27.009934Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:27.008975Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.283234,
|
|
"end_time": "2023-06-06T00:09:27.012608",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:26.729374",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
"<div> <div id=\"b6c48dab-470a-492f-b091-9d50a9067108\" class=\"plotly-graph-div\" style=\"height:800px; width:1000px;\"></div> <script type=\"text/javascript\"> require([\"plotly\"], function(Plotly) { window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById(\"b6c48dab-470a-492f-b091-9d50a9067108\")) { Plotly.newPlot( \"b6c48dab-470a-492f-b091-9d50a9067108\", [{\"customdata\":[[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=levit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"levit_128s.fb_dist_in1k\",\"levit_128.fb_dist_in1k\",\"levit_192.fb_dist_in1k\",\"levit_256.fb_dist_in1k\",\"levit_384.fb_dist_in1k\"],\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"levit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00015865108501477042,0.00022550151537018326,0.00026151037934695625,0.000342053415061296,0.0005556697765651828],\"xaxis\":\"x\",\"y\":[76.526,78.49,79.838,81.514,82.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[384],[384],[224],[224],[224],[384],[384],[384],[224],[224],[224],[224],[224],[224],[384],[384],[224],[384],[384],[224],[384],[384],[384],[384],[224],[224],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vit_small_patch32_224.augreg_in21k_ft_in1k\",\"vit_tiny_r_s16_p8_224.augreg_in21k_ft_in1k\",\"vit_tiny_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_224.augreg_in1k\",\"vit_base_patch32_224.sam_in1k\",\"vit_small_patch32_384.augreg_in21k_ft_in1k\",\"vit_tiny_r_s16_p8_384.augreg_in21k_ft_in1k\",\"vit_small_patch16_224.augreg_in21k_ft_in1k\",\"vit_small_patch16_224.augreg_in1k\",\"vit_small_r26_s32_224.augreg_in21k_ft_in1k\",\"vit_base_patch32_384.augreg_in21k_ft_in1k\",\"vit_base_patch32_384.augreg_in1k\",\"vit_tiny_patch16_384.augreg_in21k_ft_in1k\",\"vit_base_patch16_224_miil.in21k_ft_in1k\",\"vit_base_patch16_224.augreg2_in21k_ft_in1k\",\"vit_base_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch16_224.orig_in21k_ft_in1k\",\"vit_base_patch16_224.sam_in1k\",\"vit_base_patch16_224.augreg_in1k\",\"vit_small_patch16_384.augreg_in21k_ft_in1k\",\"vit_small_patch16_384.augreg_in1k\",\"vit_large_r50_s32_224.augreg_in21k_ft_in1k\",\"vit_small_r26_s32_384.augreg_in21k_ft_in1k\",\"vit_large_patch32_384.orig_in21k_ft_in1k\",\"vit_large_patch16_224.augreg_in21k_ft_in1k\",\"vit_base_patch16_384.augreg_in21k_ft_in1k\",\"vit_base_patch16_384.orig_in21k_ft_in1k\",\"vit_base_patch16_384.augreg_in1k\",\"vit_large_r50_s32_384.augreg_in21k_ft_in1k\",\"vit_base_patch8_224.augreg2_in21k_ft_in1k\",\"vit_base_patch8_224.augreg_in21k_ft_in1k\",\"vit_base_r50_s16_384.orig_in21k_ft_in1k\",\"vit_large_patch16_384.augreg_in21k_ft_in1k\"],\"legendgroup\":\"vit\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176,50176,50176,50176,147456,147456,50176,50176,50176,147456,147456,147456,50176,50176,50176,50176,50176,50176,147456,147456,50176,147456,147456,50176,147456,147456,147456,147456,50176,50176,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00023073053903268528,0.00025923592802573695,0.0004485431319075642,0.0006199781767681778,0.0006199781767681778,0.0006199781767681778,0.0007068736392682444,0.0008379069085424609,0.0009731128908264647,0.0009731128908264647,0.0014655450361989624,0.0019330395113276114,0.0019330395113276114,0.001984363217843394,0.002551866690484089,0.002595851828777613,0.002595851828777613,0.002595851828777613,0.002595851828777613,0.002595851828777613,0.004245923913043478,0.004245923913043478,0.004369101712687872,0.004516507836141096,0.0061793239819563734,0.008666262241095415,0.010450412791305257,0.010450412791305257,0.010450412791305257,0.013199577613516367,0.01588310038119441,0.01588310038119441,0.016992353440951572,0.03466204506065858],\"xaxis\":\"x\",\"y\":[75.994,71.798,75.454,80.716,74.894,73.694,80.486,75.962,81.384,78.846,81.864,83.35,78.752,78.424,84.266,85.096,84.532,81.786,80.244,79.154,83.802,81.116,84.422,84.048,81.51,85.834,85.996,84.2,81.102,86.182,86.218,85.798,84.976,87.084],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18.fb_swsl_ig1b_ft_in1k\",\"resnet18.a1_in1k\",\"resnet18.fb_ssl_yfcc100m_ft_in1k\",\"resnet18.a2_in1k\",\"resnet18.gluon_in1k\",\"resnet18.tv_in1k\",\"resnet18.a3_in1k\",\"resnet34.a1_in1k\",\"resnet34.a2_in1k\",\"resnet34.bt_in1k\",\"resnet34.gluon_in1k\",\"resnet34.a3_in1k\",\"resnet26.bt_in1k\",\"resnet26t.ra2_in1k\",\"resnet50.a1_in1k\",\"resnet50.fb_swsl_ig1b_ft_in1k\",\"resnet50.d_in1k\",\"resnet50.c1_in1k\",\"resnet50.c2_in1k\",\"resnet50.tv2_in1k\",\"resnet50.a2_in1k\",\"resnet50.b1k_in1k\",\"resnet50.a1h_in1k\",\"resnet50.b2k_in1k\",\"resnet50.ram_in1k\",\"resnet50.ra_in1k\",\"resnet50.bt_in1k\",\"resnet50.fb_ssl_yfcc100m_ft_in1k\",\"resnet50.am_in1k\",\"resnet50.a3_in1k\",\"resnet50.gluon_in1k\",\"resnet50.tv_in1k\",\"resnet32ts.ra2_in1k\",\"resnet33ts.ra2_in1k\",\"resnet101.a1h_in1k\",\"resnet101.a1_in1k\",\"resnet101.a2_in1k\",\"resnet101.tv2_in1k\",\"resnet101.a3_in1k\",\"resnet101.gluon_in1k\",\"resnet101.tv_in1k\",\"resnet152.a1h_in1k\",\"resnet152.a1_in1k\",\"resnet152.a2_in1k\",\"resnet152.tv2_in1k\",\"resnet152.a3_in1k\",\"resnet152.gluon_in1k\",\"resnet152.tv_in1k\",\"resnet51q.ra2_in1k\",\"resnet61q.ra2_in1k\"],\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0005087349795997273,0.000814431730260211,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0009786938352075321,0.0009906973518659784,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0035980282805022847,0.004809773459670049],\"xaxis\":\"x\",\"y\":[73.282,73.158,72.594,72.372,70.838,69.76,68.254,77.918,77.158,76.48,74.578,72.97,76.366,78.332,81.214,81.182,80.972,80.912,80.87,80.85,80.772,80.706,80.676,80.454,79.976,79.836,79.64,79.234,78.998,78.048,77.58,76.13,79.392,79.726,82.778,82.322,82.236,81.89,79.814,79.31,77.376,83.45,82.732,82.608,82.288,80.546,79.694,78.322,82.36,82.524],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetd<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18d.ra2_in1k\",\"resnet34d.ra2_in1k\",\"resnet26d.bt_in1k\",\"resnet50d.a1_in1k\",\"resnet50d.ra2_in1k\",\"resnet50d.a2_in1k\",\"resnet50d.gluon_in1k\",\"resnet50d.a3_in1k\",\"resnet101d.ra2_in1k\",\"resnet101d.gluon_in1k\",\"resnet152d.ra2_in1k\",\"resnet152d.gluon_in1k\",\"resnet200d.ra2_in1k\"],\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetd\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0003533543932551713,0.0005558550996926121,0.0006213611537433903,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.003054274457102715,0.003054274457102715,0.0046277014207043365,0.0046277014207043365,0.006017209218364523],\"xaxis\":\"x\",\"y\":[73.794,78.436,77.408,81.45,81.356,81.164,79.078,78.722,83.016,80.426,83.684,80.476,83.964],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetx<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetx_002.pycls_in1k\",\"regnetx_004.pycls_in1k\",\"regnetx_006.pycls_in1k\",\"regnetx_008.tv2_in1k\",\"regnetx_008.pycls_in1k\",\"regnetx_016.tv2_in1k\",\"regnetx_016.pycls_in1k\",\"regnetx_032.tv2_in1k\",\"regnetx_032.pycls_in1k\",\"regnetx_040.pycls_in1k\",\"regnetx_080.tv2_in1k\",\"regnetx_080.pycls_in1k\",\"regnetx_064.pycls_in1k\",\"regnetx_120.pycls_in1k\",\"regnetx_160.tv2_in1k\",\"regnetx_160.pycls_in1k\",\"regnetx_320.tv2_in1k\",\"regnetx_320.pycls_in1k\"],\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetx\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0004215904922912179,0.0008689456213830139,0.0012649261283141065,0.001689760054072322,0.001689760054072322,0.002637061258933045,0.002637061258933045,0.005628095452498874,0.005628095452498874,0.006177796997590659,0.0066657778962804955,0.0066657778962804955,0.008056070248932571,0.012896569512509672,0.015382248884786955,0.015382248884786955,0.021663778162911613,0.021663778162911613],\"xaxis\":\"x\",\"y\":[68.746,72.398,73.868,77.304,75.03,79.436,76.924,80.926,78.168,78.492,81.538,79.202,79.066,79.588,82.566,79.866,82.81,80.246],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[288],[288],[288],[288],[288],[224],[224],[288],[288],[224],[224],[224],[224],[224],[288],[288],[288],[288],[288],[288],[288],[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnety<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnety_002.pycls_in1k\",\"regnety_004.tv2_in1k\",\"regnety_004.pycls_in1k\",\"regnety_006.pycls_in1k\",\"regnety_008.pycls_in1k\",\"regnety_016.tv2_in1k\",\"regnety_016.pycls_in1k\",\"regnety_032.ra_in1k\",\"regnety_032.tv2_in1k\",\"regnety_032.pycls_in1k\",\"regnety_040.ra3_in1k\",\"regnety_040.pycls_in1k\",\"regnety_120.sw_in12k_ft_in1k\",\"regnety_120.pycls_in1k\",\"regnety_064.ra3_in1k\",\"regnety_064.pycls_in1k\",\"regnety_320.swag_ft_in1k\",\"regnety_320.swag_lc_in1k\",\"regnety_320.seer_ft_in1k\",\"regnety_320.tv2_in1k\",\"regnety_320.pycls_in1k\",\"regnety_080.ra3_in1k\",\"regnety_080.pycls_in1k\",\"regnety_160.swag_ft_in1k\",\"regnety_160.lion_in12k_ft_in1k\",\"regnety_160.sw_in12k_ft_in1k\",\"regnety_160.swag_lc_in1k\",\"regnety_160.deit_in1k\",\"regnety_160.tv2_in1k\",\"regnety_160.pycls_in1k\"],\"legendgroup\":\"regnety\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[50176,50176,50176,50176,50176,50176,50176,82944,82944,82944,82944,82944,50176,50176,82944,82944,50176,50176,50176,50176,50176,82944,82944,82944,82944,82944,82944,82944,82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnety\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00044342751733801594,0.0009734728644439036,0.0009734728644439036,0.0012694221590332081,0.0015109848599317035,0.002829975096219153,0.002829975096219153,0.005617661929105107,0.005617661929105107,0.005617661929105107,0.008316008316008316,0.008316008316008316,0.013273161667109104,0.013273161667109104,0.013757050488375293,0.013757050488375293,0.014817009927396653,0.014817009927396653,0.014817009927396653,0.014817009927396653,0.014817009927396653,0.015278838808250572,0.015278838808250572,0.02077274615704196,0.02077274615704196,0.02077274615704196,0.02077274615704196,0.02077274615704196,0.02077274615704196,0.02077274615704196],\"xaxis\":\"x\",\"y\":[70.278,75.598,74.028,75.27,76.302,80.668,77.862,82.728,81.756,78.876,83.044,79.232,85.4,80.386,83.72,79.714,86.836,84.546,83.334,83.162,80.808,83.926,79.868,86.01,85.986,85.986,83.782,83.69,82.642,80.298],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[240],[240],[256],[260],[288],[300],[300],[300],[320],[384],[456]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnet_lite0.ra_in1k\",\"efficientnet_b0.ra_in1k\",\"efficientnet_es.ra_in1k\",\"efficientnet_es_pruned.in1k\",\"efficientnet_b1_pruned.in1k\",\"efficientnet_em.ra2_in1k\",\"efficientnet_b1.ft_in1k\",\"efficientnet_b2_pruned.in1k\",\"efficientnet_b2.ra_in1k\",\"efficientnet_b3_pruned.in1k\",\"efficientnet_el.ra_in1k\",\"efficientnet_el_pruned.in1k\",\"efficientnet_b3.ra2_in1k\",\"efficientnet_b4.ra2_in1k\",\"efficientnet_b5.sw_in12k_ft_in1k\"],\"legendgroup\":\"efficientnet\",\"marker\":{\"color\":\"#FF6692\",\"size\":[50176,50176,50176,50176,57600,57600,65536,67600,82944,90000,90000,90000,102400,147456,207936],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0004526361529548088,0.0005553796853218703,0.0006177300890149058,0.0006187850773790739,0.0007223763291724458,0.0010220141855568955,0.001047219109654313,0.0012109909538975743,0.0013808149569876141,0.0019251872244575787,0.0021957753282684117,0.002201091741503786,0.0028314174075542214,0.004141301196836046,0.010279605263157895],\"xaxis\":\"x\",\"y\":[75.48,77.694,78.054,75.014,78.242,79.24,78.8,79.92,80.61,80.852,81.312,80.3,82.242,83.414,85.892],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=repvgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"repvgg_b0.rvgg_in1k\",\"repvgg_a2.rvgg_in1k\",\"repvgg_b1.rvgg_in1k\",\"repvgg_b2.rvgg_in1k\",\"repvgg_b3.rvgg_in1k\",\"repvgg_b1g4.rvgg_in1k\",\"repvgg_b2g4.rvgg_in1k\",\"repvgg_b3g4.rvgg_in1k\"],\"legendgroup\":\"repvgg\",\"marker\":{\"color\":\"#B6E880\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"repvgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0006304573968414084,0.0008755494072530513,0.0015941081761808359,0.0026313712075362473,0.003168969451134491,0.0056050669805504175,0.00977230528681716,0.011799410029498525],\"xaxis\":\"x\",\"y\":[75.142,76.458,78.368,78.792,80.506,77.582,79.382,80.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[256],[256],[256]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=mobilevit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"mobilevit_xxs.cvnets_in1k\",\"mobilevit_xs.cvnets_in1k\",\"mobilevit_s.cvnets_in1k\"],\"legendgroup\":\"mobilevit\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[65536,65536,65536],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"mobilevit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0006599091964945623,0.0010994931336653802,0.0013611738763509651],\"xaxis\":\"x\",\"y\":[68.932,74.636,78.312],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[240],[240],[240],[240],[240],[240],[240],[240],[240],[408],[408]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=crossvit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"crossvit_tiny_240.in1k\",\"crossvit_9_240.in1k\",\"crossvit_9_dagger_240.in1k\",\"crossvit_small_240.in1k\",\"crossvit_15_240.in1k\",\"crossvit_15_dagger_240.in1k\",\"crossvit_18_240.in1k\",\"crossvit_18_dagger_240.in1k\",\"crossvit_base_240.in1k\",\"crossvit_15_dagger_408.in1k\",\"crossvit_18_dagger_408.in1k\"],\"legendgroup\":\"crossvit\",\"marker\":{\"color\":\"#FECB52\",\"size\":[57600,57600,57600,57600,57600,57600,57600,57600,57600,166464,166464],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"crossvit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0007573864109730144,0.0008087343307723412,0.0008364071295343722,0.0016024613806807258,0.001759138725679907,0.0018183140592043056,0.0024990628514307135,0.002577651759247326,0.004000160006400256,0.008588851670531649,0.011364927832708264],\"xaxis\":\"x\",\"y\":[73.336,73.958,76.98,81.016,81.534,82.33,82.396,82.516,82.216,83.842,84.198],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetv2_50.a1h_in1k\",\"resnetv2_101.a1h_in1k\"],\"legendgroup\":\"resnetv2\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0007716049382716049,0.0013201494409167118],\"xaxis\":\"x\",\"y\":[81.398,83.002],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convit_tiny.fb_in1k\",\"convit_small.fb_in1k\",\"convit_base.fb_in1k\"],\"legendgroup\":\"convit\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0009024537718055393,0.0022212843466092097,0.004373496610540126],\"xaxis\":\"x\",\"y\":[73.112,81.42,82.29],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetaad<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetaa50d.sw_in12k_ft_in1k\",\"resnetaa101d.sw_in12k_ft_in1k\"],\"legendgroup\":\"resnetaad\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetaad\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0010616387455676581,0.00160970976932859],\"xaxis\":\"x\",\"y\":[82.6,84.124],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vgg11.tv_in1k\",\"vgg11_bn.tv_in1k\",\"vgg13.tv_in1k\",\"vgg13_bn.tv_in1k\",\"vgg16.tv_in1k\",\"vgg16_bn.tv_in1k\",\"vgg19.tv_in1k\",\"vgg19_bn.tv_in1k\"],\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.001074575542660649,0.0012416499043929573,0.0015078180365193528,0.001758118110374655,0.001863967641521743,0.0021277953911951826,0.0022130748461912982,0.002501626056937009],\"xaxis\":\"x\",\"y\":[69.022,70.382,69.932,71.588,71.592,73.37,72.378,74.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetblur<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetblur50.bt_in1k\"],\"legendgroup\":\"resnetblur\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetblur\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.001099408518217199],\"xaxis\":\"x\",\"y\":[80.234],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[288],[320],[320],[352],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetrs<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetrs50.tf_in1k\",\"resnetrs101.tf_in1k\",\"resnetrs152.tf_in1k\",\"resnetrs200.tf_in1k\",\"resnetrs270.tf_in1k\",\"resnetrs350.tf_in1k\",\"resnetrs420.tf_in1k\"],\"legendgroup\":\"resnetrs\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[50176,82944,102400,102400,123904,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetrs\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0011601466425356164,0.0031080997078386276,0.00584316933504733,0.00808080808080808,0.013285505513484789,0.021177467174925878,0.03105590062111801],\"xaxis\":\"x\",\"y\":[79.896,82.284,83.702,84.444,84.428,84.714,85.006],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convnext<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convnext_tiny.in12k_ft_in1k_384\",\"convnext_tiny.in12k_ft_in1k\",\"convnext_tiny.fb_in22k_ft_in1k_384\",\"convnext_tiny.fb_in1k\",\"convnext_tiny.fb_in22k_ft_in1k\",\"convnext_tiny_hnf.a2h_in1k\",\"convnext_small.in12k_ft_in1k_384\",\"convnext_small.fb_in22k_ft_in1k_384\",\"convnext_small.in12k_ft_in1k\",\"convnext_small.fb_in22k_ft_in1k\",\"convnext_small.fb_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k_384\",\"convnext_base.fb_in22k_ft_in1k_384\",\"convnext_base.clip_laiona_augreg_ft_in1k_384\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k\",\"convnext_base.fb_in22k_ft_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in1k\",\"convnext_base.fb_in1k\",\"convnext_large.fb_in22k_ft_in1k_384\",\"convnext_large.fb_in22k_ft_in1k\",\"convnext_large.fb_in1k\"],\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#FF6692\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convnext\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0014666412448850886,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.005535872453498672,0.005535872453498672,0.005535872453498672],\"xaxis\":\"x\",\"y\":[85.122,84.45,84.088,82.698,78.898,82.584,86.182,85.778,85.33,85.262,83.7,87.134,86.796,86.502,86.37,86.274,86.158,84.428,87.472,87.026,84.846],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnetv2_rw_t.ra2_in1k\",\"efficientnetv2_rw_s.ra2_in1k\",\"efficientnetv2_rw_m.agc_in1k\"],\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#B6E880\",\"size\":[82944,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00146096306685367,0.0033831788348332096,0.007923302432453847],\"xaxis\":\"x\",\"y\":[82.35,83.808,84.812],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[384],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=swin<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"swin_tiny_patch4_window7_224.ms_in1k\",\"swin_tiny_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_s3_tiny_224.ms_in1k\",\"swin_small_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_small_patch4_window7_224.ms_in1k\",\"swin_s3_small_224.ms_in1k\",\"swin_base_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window7_224.ms_in1k\",\"swin_s3_base_224.ms_in1k\",\"swin_large_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in1k\",\"swin_large_patch4_window12_384.ms_in22k_ft_in1k\"],\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,147456,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"swin\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0015640885274106513,0.0015640885274106513,0.0017278319165111619,0.002542071279678682,0.002542071279678682,0.003609456776755098,0.0036254214552441724,0.0036254214552441724,0.004564750992833341,0.006607201850016518,0.013585110718652357,0.013585110718652357,0.024378352023403216],\"xaxis\":\"x\",\"y\":[81.376,80.968,82.144,83.298,83.208,83.756,85.272,83.606,83.92,86.312,86.438,84.476,87.132],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[384],[384],[512]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=beit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"beit_base_patch16_224.in22k_ft_in22k_in1k\",\"beit_large_patch16_224.in22k_ft_in22k_in1k\",\"beit_base_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_512.in22k_ft_in22k_in1k\"],\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#FECB52\",\"size\":[50176,50176,147456,147456,262144],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"beit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0028385704958982655,0.009381743127873158,0.012087513598452797,0.039824771007566706,0.10615711252653928],\"xaxis\":\"x\",\"y\":[85.212,87.478,86.8,88.402,88.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[320],[320],[288],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetz<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetz_d8.ra3_in1k\",\"regnetz_c16.ra3_in1k\",\"regnetz_b16.ra3_in1k\",\"regnetz_e8.ra3_in1k\",\"regnetz_c16_evos.ch_in1k\",\"regnetz_d8_evos.ch_in1k\",\"regnetz_040.ra3_in1k\",\"regnetz_d32.ra3_in1k\"],\"legendgroup\":\"regnetz\",\"marker\":{\"color\":\"#636efa\",\"size\":[102400,102400,82944,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetz\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0032123353678123997,0.003997441637352095,0.005506607929515419,0.006836671908115129,0.008684324793747285,0.010453690152623877,0.010575296108291032,0.013854253255749514],\"xaxis\":\"x\",\"y\":[84.054,82.634,80.728,85.036,82.632,84.126,84.24,84.022],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetv2d<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnetv2_50d_evos.ah_in1k\"],\"legendgroup\":\"resnetv2d\",\"marker\":{\"color\":\"#EF553B\",\"size\":[82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetv2d\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.004472271914132379],\"xaxis\":\"x\",\"y\":[82.0],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetv<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetv_040.ra3_in1k\",\"regnetv_064.ra3_in1k\"],\"legendgroup\":\"regnetv\",\"marker\":{\"color\":\"#00cc96\",\"size\":[82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetv\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.008409014463504878,0.013925637097897228],\"xaxis\":\"x\",\"y\":[83.198,83.716],\"yaxis\":\"y\",\"type\":\"scatter\"}], {\"template\":{\"data\":{\"histogram2dcontour\":[{\"type\":\"histogram2dcontour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"choropleth\":[{\"type\":\"choropleth\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"histogram2d\":[{\"type\":\"histogram2d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmap\":[{\"type\":\"heatmap\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"type\":\"heatmapgl\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"type\":\"contourcarpet\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"contour\":[{\"type\":\"contour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"surface\":[{\"type\":\"surface\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"type\":\"mesh3d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"scatter\":[{\"fillpattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2},\"type\":\"scatter\"}],\"parcoords\":[{\"type\":\"parcoords\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"type\":\"scatterpolargl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"bar\":[{\"error_x\":{\"color\":\"#2a3f5f\"},\"error_y\":{\"color\":\"#2a3f5f\"},\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"bar\"}],\"scattergeo\":[{\"type\":\"scattergeo\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"type\":\"scatterpolar\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"histogram\"}],\"scattergl\":[{\"type\":\"scattergl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"type\":\"scatter3d\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"type\":\"scattermapbox\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"type\":\"scatterternary\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"type\":\"scattercarpet\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"carpet\":[{\"aaxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"baxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"type\":\"carpet\"}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"#EBF0F8\"},\"line\":{\"color\":\"white\"}},\"header\":{\"fill\":{\"color\":\"#C8D4E3\"},\"line\":{\"color\":\"white\"}},\"type\":\"table\"}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"barpolar\"}],\"pie\":[{\"automargin\":true,\"type\":\"pie\"}]},\"layout\":{\"autotypenumbers\":\"strict\",\"colorway\":[\"#636efa\",\"#EF553B\",\"#00cc96\",\"#ab63fa\",\"#FFA15A\",\"#19d3f3\",\"#FF6692\",\"#B6E880\",\"#FF97FF\",\"#FECB52\"],\"font\":{\"color\":\"#2a3f5f\"},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"paper_bgcolor\":\"white\",\"plot_bgcolor\":\"#E5ECF6\",\"polar\":{\"bgcolor\":\"#E5ECF6\",\"angularaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"radialaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"ternary\":{\"bgcolor\":\"#E5ECF6\",\"aaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"baxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"caxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"colorscale\":{\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"diverging\":[[0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1,\"#276419\"]]},\"xaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"yaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"scene\":{\"xaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"yaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"zaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2}},\"shapedefaults\":{\"line\":{\"color\":\"#2a3f5f\"}},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"geo\":{\"bgcolor\":\"white\",\"landcolor\":\"#E5ECF6\",\"subunitcolor\":\"white\",\"showland\":true,\"showlakes\":true,\"lakecolor\":\"white\"},\"title\":{\"x\":0.05},\"mapbox\":{\"style\":\"light\"}}},\"xaxis\":{\"anchor\":\"y\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"secs\"},\"type\":\"log\"},\"yaxis\":{\"anchor\":\"x\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"top1\"}},\"legend\":{\"title\":{\"text\":\"family\"},\"tracegroupgap\":0,\"itemsizing\":\"constant\"},\"title\":{\"text\":\"Training\"},\"height\":800,\"width\":1000}, {\"responsive\": true} ).then(function(){\n",
|
|
" \n",
|
|
"var gd = document.getElementById('b6c48dab-470a-492f-b091-9d50a9067108');\n",
|
|
"var x = new MutationObserver(function (mutations, observer) {{\n",
|
|
" var display = window.getComputedStyle(gd).display;\n",
|
|
" if (!display || display === 'none') {{\n",
|
|
" console.log([gd, 'removed!']);\n",
|
|
" Plotly.purge(gd);\n",
|
|
" observer.disconnect();\n",
|
|
" }}\n",
|
|
"}});\n",
|
|
"\n",
|
|
"// Listen for the removal of the full notebook cells\n",
|
|
"var notebookContainer = gd.closest('#notebook-container');\n",
|
|
"if (notebookContainer) {{\n",
|
|
" x.observe(notebookContainer, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
"// Listen for the clearing of the current output cell\n",
|
|
"var outputEl = gd.closest('.output');\n",
|
|
"if (outputEl) {{\n",
|
|
" x.observe(outputEl, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
" }) }; }); </script> </div>"
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
}
|
|
],
|
|
"source": [
|
|
"show_all(tdf, 'Training', 'train_img_size')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "a15756d3",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.043046,
|
|
"end_time": "2023-06-06T00:09:27.098532",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:27.055486",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"...and we'll also look at our chosen subset of models:"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": 14,
|
|
"id": "65a40fe0",
|
|
"metadata": {
|
|
"execution": {
|
|
"iopub.execute_input": "2023-06-06T00:09:27.185428Z",
|
|
"iopub.status.busy": "2023-06-06T00:09:27.185118Z",
|
|
"iopub.status.idle": "2023-06-06T00:09:27.389152Z",
|
|
"shell.execute_reply": "2023-06-06T00:09:27.388142Z"
|
|
},
|
|
"papermill": {
|
|
"duration": 0.250038,
|
|
"end_time": "2023-06-06T00:09:27.391617",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:27.141579",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [
|
|
{
|
|
"data": {
|
|
"text/html": [
|
|
"<div> <div id=\"ba524fc8-737f-4ac7-915a-f1c159ecb282\" class=\"plotly-graph-div\" style=\"height:800px; width:1000px;\"></div> <script type=\"text/javascript\"> require([\"plotly\"], function(Plotly) { window.PLOTLYENV=window.PLOTLYENV || {}; if (document.getElementById(\"ba524fc8-737f-4ac7-915a-f1c159ecb282\")) { Plotly.newPlot( \"ba524fc8-737f-4ac7-915a-f1c159ecb282\", [{\"customdata\":[[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=levit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"levit_128s.fb_dist_in1k\",\"levit_128.fb_dist_in1k\",\"levit_192.fb_dist_in1k\",\"levit_256.fb_dist_in1k\",\"levit_384.fb_dist_in1k\"],\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"size\":[50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"levit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00015865108501477042,0.00022550151537018326,0.00026151037934695625,0.000342053415061296,0.0005556697765651828],\"xaxis\":\"x\",\"y\":[76.526,78.49,79.838,81.514,82.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 11.4642 * log10(secs) + 120.491<br>R<sup>2</sup>=0.944715<br><br>family=levit<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"levit\",\"marker\":{\"color\":\"#636efa\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"levit\",\"showlegend\":false,\"x\":[0.00015865108501477042,0.00022550151537018326,0.00026151037934695625,0.000342053415061296,0.0005556697765651828],\"xaxis\":\"x\",\"y\":[76.93184652926374,78.68250384396546,79.42010451720395,80.75688786183713,83.17265724772935],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[256],[256],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[288],[288]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnet<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18.fb_swsl_ig1b_ft_in1k\",\"resnet18.a1_in1k\",\"resnet18.fb_ssl_yfcc100m_ft_in1k\",\"resnet18.a2_in1k\",\"resnet18.gluon_in1k\",\"resnet18.tv_in1k\",\"resnet18.a3_in1k\",\"resnet34.a1_in1k\",\"resnet34.a2_in1k\",\"resnet34.bt_in1k\",\"resnet34.gluon_in1k\",\"resnet34.a3_in1k\",\"resnet26.bt_in1k\",\"resnet26t.ra2_in1k\",\"resnet50.a1_in1k\",\"resnet50.fb_swsl_ig1b_ft_in1k\",\"resnet50.d_in1k\",\"resnet50.c1_in1k\",\"resnet50.c2_in1k\",\"resnet50.tv2_in1k\",\"resnet50.a2_in1k\",\"resnet50.b1k_in1k\",\"resnet50.a1h_in1k\",\"resnet50.b2k_in1k\",\"resnet50.ram_in1k\",\"resnet50.ra_in1k\",\"resnet50.bt_in1k\",\"resnet50.fb_ssl_yfcc100m_ft_in1k\",\"resnet50.am_in1k\",\"resnet50.a3_in1k\",\"resnet50.gluon_in1k\",\"resnet50.tv_in1k\",\"resnet32ts.ra2_in1k\",\"resnet33ts.ra2_in1k\",\"resnet101.a1h_in1k\",\"resnet101.a1_in1k\",\"resnet101.a2_in1k\",\"resnet101.tv2_in1k\",\"resnet101.a3_in1k\",\"resnet101.gluon_in1k\",\"resnet101.tv_in1k\",\"resnet152.a1h_in1k\",\"resnet152.a1_in1k\",\"resnet152.a2_in1k\",\"resnet152.tv2_in1k\",\"resnet152.a3_in1k\",\"resnet152.gluon_in1k\",\"resnet152.tv_in1k\",\"resnet51q.ra2_in1k\",\"resnet61q.ra2_in1k\"],\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#EF553B\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,65536,65536,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,82944,82944],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnet\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0005087349795997273,0.000814431730260211,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0009786938352075321,0.0009906973518659784,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0035980282805022847,0.004809773459670049],\"xaxis\":\"x\",\"y\":[73.282,73.158,72.594,72.372,70.838,69.76,68.254,77.918,77.158,76.48,74.578,72.97,76.366,78.332,81.214,81.182,80.972,80.912,80.87,80.85,80.772,80.706,80.676,80.454,79.976,79.836,79.64,79.234,78.998,78.048,77.58,76.13,79.392,79.726,82.778,82.322,82.236,81.89,79.814,79.31,77.376,83.45,82.732,82.608,82.288,80.546,79.694,78.322,82.36,82.524],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 10.2924 * log10(secs) + 110.15<br>R<sup>2</sup>=0.672103<br><br>family=resnet<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"resnet\",\"marker\":{\"color\":\"#EF553B\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"resnet\",\"showlegend\":false,\"x\":[0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.000279003066243698,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0004805543675183692,0.0005087349795997273,0.000814431730260211,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0008179223137386412,0.0009786938352075321,0.0009906973518659784,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0013745704467353953,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0020006802312786346,0.0035980282805022847,0.004809773459670049],\"xaxis\":\"x\",\"y\":[73.56696861190554,73.56696861190554,73.56696861190554,73.56696861190554,73.56696861190554,73.56696861190554,73.56696861190554,75.99734498828548,75.99734498828548,75.99734498828548,75.99734498828548,75.99734498828548,76.25207184652481,78.35545448781573,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,78.3745712559405,79.17670583607934,79.23119523643628,80.69503935085184,80.69503935085184,80.69503935085184,80.69503935085184,80.69503935085184,80.69503935085184,80.69503935085184,82.37280728374353,82.37280728374353,82.37280728374353,82.37280728374353,82.37280728374353,82.37280728374353,82.37280728374353,84.99620016310867,86.29365815617194],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[320],[320],[320],[320],[320]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=resnetd<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"resnet18d.ra2_in1k\",\"resnet34d.ra2_in1k\",\"resnet26d.bt_in1k\",\"resnet50d.a1_in1k\",\"resnet50d.ra2_in1k\",\"resnet50d.a2_in1k\",\"resnet50d.gluon_in1k\",\"resnet50d.a3_in1k\",\"resnet101d.ra2_in1k\",\"resnet101d.gluon_in1k\",\"resnet152d.ra2_in1k\",\"resnet152d.gluon_in1k\",\"resnet200d.ra2_in1k\"],\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#00cc96\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,102400,102400,102400,102400,102400],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"resnetd\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0003533543932551713,0.0005558550996926121,0.0006213611537433903,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.003054274457102715,0.003054274457102715,0.0046277014207043365,0.0046277014207043365,0.006017209218364523],\"xaxis\":\"x\",\"y\":[73.794,78.436,77.408,81.45,81.356,81.164,79.078,78.722,83.016,80.426,83.684,80.476,83.964],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 5.46902 * log10(secs) + 95.7864<br>R<sup>2</sup>=0.628381<br><br>family=resnetd<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"resnetd\",\"marker\":{\"color\":\"#00cc96\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"resnetd\",\"showlegend\":false,\"x\":[0.0003533543932551713,0.0005558550996926121,0.0006213611537433903,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.0009343960531110716,0.003054274457102715,0.003054274457102715,0.0046277014207043365,0.0046277014207043365,0.006017209218364523],\"xaxis\":\"x\",\"y\":[76.90849425388389,77.98453017763592,78.24913511607791,79.21817400293459,79.21817400293459,79.21817400293459,79.21817400293459,79.21817400293459,82.03131305246268,82.03131305246268,83.0182376815073,83.0182376815073,83.6418689697901],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=regnetx<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"regnetx_002.pycls_in1k\",\"regnetx_004.pycls_in1k\",\"regnetx_006.pycls_in1k\",\"regnetx_008.tv2_in1k\",\"regnetx_008.pycls_in1k\",\"regnetx_016.tv2_in1k\",\"regnetx_016.pycls_in1k\",\"regnetx_032.tv2_in1k\",\"regnetx_032.pycls_in1k\",\"regnetx_040.pycls_in1k\",\"regnetx_080.tv2_in1k\",\"regnetx_080.pycls_in1k\",\"regnetx_064.pycls_in1k\",\"regnetx_120.pycls_in1k\",\"regnetx_160.tv2_in1k\",\"regnetx_160.pycls_in1k\",\"regnetx_320.tv2_in1k\",\"regnetx_320.pycls_in1k\"],\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#ab63fa\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"regnetx\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0004215904922912179,0.0008689456213830139,0.0012649261283141065,0.001689760054072322,0.001689760054072322,0.002637061258933045,0.002637061258933045,0.005628095452498874,0.005628095452498874,0.006177796997590659,0.0066657778962804955,0.0066657778962804955,0.008056070248932571,0.012896569512509672,0.015382248884786955,0.015382248884786955,0.021663778162911613,0.021663778162911613],\"xaxis\":\"x\",\"y\":[68.746,72.398,73.868,77.304,75.03,79.436,76.924,80.926,78.168,78.492,81.538,79.202,79.066,79.588,82.566,79.866,82.81,80.246],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 6.57304 * log10(secs) + 93.4706<br>R<sup>2</sup>=0.807124<br><br>family=regnetx<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"regnetx\",\"marker\":{\"color\":\"#ab63fa\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"regnetx\",\"showlegend\":false,\"x\":[0.0004215904922912179,0.0008689456213830139,0.0012649261283141065,0.001689760054072322,0.001689760054072322,0.002637061258933045,0.002637061258933045,0.005628095452498874,0.005628095452498874,0.006177796997590659,0.0066657778962804955,0.0066657778962804955,0.008056070248932571,0.012896569512509672,0.015382248884786955,0.015382248884786955,0.021663778162911613,0.021663778162911613],\"xaxis\":\"x\",\"y\":[71.28585487111543,73.35045710741372,74.42233886848831,75.24896300134068,75.24896300134068,76.5194990855813,76.5194990855813,78.68361343092039,78.68361343092039,78.94963850078474,79.16666176662224,79.16666176662224,79.70744121364271,81.05064732831511,81.55378447903152,81.55378447903152,82.5312892916237,82.5312892916237],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=vgg<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"vgg11.tv_in1k\",\"vgg11_bn.tv_in1k\",\"vgg13.tv_in1k\",\"vgg13_bn.tv_in1k\",\"vgg16.tv_in1k\",\"vgg16_bn.tv_in1k\",\"vgg19.tv_in1k\",\"vgg19_bn.tv_in1k\"],\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#FFA15A\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"vgg\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.001074575542660649,0.0012416499043929573,0.0015078180365193528,0.001758118110374655,0.001863967641521743,0.0021277953911951826,0.0022130748461912982,0.002501626056937009],\"xaxis\":\"x\",\"y\":[69.022,70.382,69.932,71.588,71.592,73.37,72.378,74.216],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 12.9585 * log10(secs) + 107.374<br>R<sup>2</sup>=0.885938<br><br>family=vgg<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"vgg\",\"marker\":{\"color\":\"#FFA15A\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"vgg\",\"showlegend\":false,\"x\":[0.001074575542660649,0.0012416499043929573,0.0015078180365193528,0.001758118110374655,0.001863967641521743,0.0021277953911951826,0.0022130748461912982,0.002501626056937009],\"xaxis\":\"x\",\"y\":[68.90298324828235,69.71628704046168,70.80933322468678,71.6736533954418,72.00267376015793,72.74767704773944,72.96882981982678,73.65856246340243],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[224]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=convnext<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"convnext_tiny.in12k_ft_in1k_384\",\"convnext_tiny.in12k_ft_in1k\",\"convnext_tiny.fb_in22k_ft_in1k_384\",\"convnext_tiny.fb_in1k\",\"convnext_tiny.fb_in22k_ft_in1k\",\"convnext_tiny_hnf.a2h_in1k\",\"convnext_small.in12k_ft_in1k_384\",\"convnext_small.fb_in22k_ft_in1k_384\",\"convnext_small.in12k_ft_in1k\",\"convnext_small.fb_in22k_ft_in1k\",\"convnext_small.fb_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k_384\",\"convnext_base.fb_in22k_ft_in1k_384\",\"convnext_base.clip_laiona_augreg_ft_in1k_384\",\"convnext_base.clip_laion2b_augreg_ft_in12k_in1k\",\"convnext_base.fb_in22k_ft_in1k\",\"convnext_base.clip_laion2b_augreg_ft_in1k\",\"convnext_base.fb_in1k\",\"convnext_large.fb_in22k_ft_in1k_384\",\"convnext_large.fb_in22k_ft_in1k\",\"convnext_large.fb_in1k\"],\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#19d3f3\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,50176],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"convnext\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0014666412448850886,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.005535872453498672,0.005535872453498672,0.005535872453498672],\"xaxis\":\"x\",\"y\":[85.122,84.45,84.088,82.698,78.898,82.584,86.182,85.778,85.33,85.262,83.7,87.134,86.796,86.502,86.37,86.274,86.158,84.428,87.472,87.026,84.846],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 6.17519 * log10(secs) + 101.288<br>R<sup>2</sup>=0.439434<br><br>family=convnext<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"convnext\",\"marker\":{\"color\":\"#19d3f3\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"convnext\",\"showlegend\":false,\"x\":[0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0012801310854231474,0.0014666412448850886,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0021101943488995335,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.0030553009471432934,0.005535872453498672,0.005535872453498672,0.005535872453498672],\"xaxis\":\"x\",\"y\":[83.42472180338534,83.42472180338534,83.42472180338534,83.42472180338534,83.42472180338534,83.78948700648864,84.76515847525603,84.76515847525603,84.76515847525603,84.76515847525603,84.76515847525603,85.75770660464568,85.75770660464568,85.75770660464568,85.75770660464568,85.75770660464568,85.75770660464568,85.75770660464568,87.35172178926092,87.35172178926092,87.35172178926092],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[288],[384],[416]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"efficientnetv2_rw_t.ra2_in1k\",\"efficientnetv2_rw_s.ra2_in1k\",\"efficientnetv2_rw_m.agc_in1k\"],\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#FF6692\",\"size\":[82944,147456,173056],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"efficientnetv2\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.00146096306685367,0.0033831788348332096,0.007923302432453847],\"xaxis\":\"x\",\"y\":[82.35,83.808,84.812],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 3.35158 * log10(secs) + 91.9319<br>R<sup>2</sup>=0.987967<br><br>family=efficientnetv2<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"efficientnetv2\",\"marker\":{\"color\":\"#FF6692\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"efficientnetv2\",\"showlegend\":false,\"x\":[0.00146096306685367,0.0033831788348332096,0.007923302432453847],\"xaxis\":\"x\",\"y\":[82.42892403321238,83.65119737976138,84.88987858702616],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[224],[224],[224],[224],[224],[224],[224],[224],[384],[384],[384]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=swin<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"swin_tiny_patch4_window7_224.ms_in1k\",\"swin_tiny_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_s3_tiny_224.ms_in1k\",\"swin_small_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_small_patch4_window7_224.ms_in1k\",\"swin_s3_small_224.ms_in1k\",\"swin_base_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window7_224.ms_in1k\",\"swin_s3_base_224.ms_in1k\",\"swin_large_patch4_window7_224.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in22k_ft_in1k\",\"swin_base_patch4_window12_384.ms_in1k\",\"swin_large_patch4_window12_384.ms_in22k_ft_in1k\"],\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#B6E880\",\"size\":[50176,50176,50176,50176,50176,50176,50176,50176,50176,50176,147456,147456,147456],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"swin\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0015640885274106513,0.0015640885274106513,0.0017278319165111619,0.002542071279678682,0.002542071279678682,0.003609456776755098,0.0036254214552441724,0.0036254214552441724,0.004564750992833341,0.006607201850016518,0.013585110718652357,0.013585110718652357,0.024378352023403216],\"xaxis\":\"x\",\"y\":[81.376,80.968,82.144,83.298,83.208,83.756,85.272,83.606,83.92,86.312,86.438,84.476,87.132],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 4.39329 * log10(secs) + 94.3862<br>R<sup>2</sup>=0.778111<br><br>family=swin<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"swin\",\"marker\":{\"color\":\"#B6E880\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"swin\",\"showlegend\":false,\"x\":[0.0015640885274106513,0.0015640885274106513,0.0017278319165111619,0.002542071279678682,0.002542071279678682,0.003609456776755098,0.0036254214552441724,0.0036254214552441724,0.004564750992833341,0.006607201850016518,0.013585110718652357,0.013585110718652357,0.024378352023403216],\"xaxis\":\"x\",\"y\":[82.05981506767431,82.05981506767431,82.24978153696058,82.9864753951552,82.9864753951552,83.65537155240705,83.66379196953142,83.66379196953142,84.10337814611505,84.80894227038542,86.18424168350984,86.18424168350984,87.29987826239132],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"customdata\":[[224],[224],[384],[384],[512]],\"hovertemplate\":\"<b>%{hovertext}</b><br><br>family=beit<br>secs=%{x}<br>top1=%{y}<br>size=%{marker.size}<br>train_img_size=%{customdata[0]}<extra></extra>\",\"hovertext\":[\"beit_base_patch16_224.in22k_ft_in22k_in1k\",\"beit_large_patch16_224.in22k_ft_in22k_in1k\",\"beit_base_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_384.in22k_ft_in22k_in1k\",\"beit_large_patch16_512.in22k_ft_in22k_in1k\"],\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#FF97FF\",\"size\":[50176,50176,147456,147456,262144],\"sizemode\":\"area\",\"sizeref\":655.36,\"symbol\":\"circle\"},\"mode\":\"markers\",\"name\":\"beit\",\"orientation\":\"v\",\"showlegend\":true,\"x\":[0.0028385704958982655,0.009381743127873158,0.012087513598452797,0.039824771007566706,0.10615711252653928],\"xaxis\":\"x\",\"y\":[85.212,87.478,86.8,88.402,88.596],\"yaxis\":\"y\",\"type\":\"scatter\"},{\"hovertemplate\":\"<b>OLS trendline</b><br>top1 = 2.11281 * log10(secs) + 91.0441<br>R<sup>2</sup>=0.866259<br><br>family=beit<br>secs=%{x}<br>top1=%{y} <b>(trend)</b><extra></extra>\",\"legendgroup\":\"beit\",\"marker\":{\"color\":\"#FF97FF\",\"symbol\":\"circle\"},\"mode\":\"lines\",\"name\":\"beit\",\"showlegend\":false,\"x\":[0.0028385704958982655,0.009381743127873158,0.012087513598452797,0.039824771007566706,0.10615711252653928],\"xaxis\":\"x\",\"y\":[85.66299314096136,86.75993002199235,86.99245203535588,88.08649956032822,88.98612524136213],\"yaxis\":\"y\",\"type\":\"scatter\"}], {\"template\":{\"data\":{\"histogram2dcontour\":[{\"type\":\"histogram2dcontour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"choropleth\":[{\"type\":\"choropleth\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"histogram2d\":[{\"type\":\"histogram2d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmap\":[{\"type\":\"heatmap\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"heatmapgl\":[{\"type\":\"heatmapgl\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"contourcarpet\":[{\"type\":\"contourcarpet\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"contour\":[{\"type\":\"contour\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"surface\":[{\"type\":\"surface\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"},\"colorscale\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]]}],\"mesh3d\":[{\"type\":\"mesh3d\",\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}],\"scatter\":[{\"fillpattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2},\"type\":\"scatter\"}],\"parcoords\":[{\"type\":\"parcoords\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolargl\":[{\"type\":\"scatterpolargl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"bar\":[{\"error_x\":{\"color\":\"#2a3f5f\"},\"error_y\":{\"color\":\"#2a3f5f\"},\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"bar\"}],\"scattergeo\":[{\"type\":\"scattergeo\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterpolar\":[{\"type\":\"scatterpolar\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"histogram\":[{\"marker\":{\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"histogram\"}],\"scattergl\":[{\"type\":\"scattergl\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatter3d\":[{\"type\":\"scatter3d\",\"line\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattermapbox\":[{\"type\":\"scattermapbox\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scatterternary\":[{\"type\":\"scatterternary\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"scattercarpet\":[{\"type\":\"scattercarpet\",\"marker\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}}}],\"carpet\":[{\"aaxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"baxis\":{\"endlinecolor\":\"#2a3f5f\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"minorgridcolor\":\"white\",\"startlinecolor\":\"#2a3f5f\"},\"type\":\"carpet\"}],\"table\":[{\"cells\":{\"fill\":{\"color\":\"#EBF0F8\"},\"line\":{\"color\":\"white\"}},\"header\":{\"fill\":{\"color\":\"#C8D4E3\"},\"line\":{\"color\":\"white\"}},\"type\":\"table\"}],\"barpolar\":[{\"marker\":{\"line\":{\"color\":\"#E5ECF6\",\"width\":0.5},\"pattern\":{\"fillmode\":\"overlay\",\"size\":10,\"solidity\":0.2}},\"type\":\"barpolar\"}],\"pie\":[{\"automargin\":true,\"type\":\"pie\"}]},\"layout\":{\"autotypenumbers\":\"strict\",\"colorway\":[\"#636efa\",\"#EF553B\",\"#00cc96\",\"#ab63fa\",\"#FFA15A\",\"#19d3f3\",\"#FF6692\",\"#B6E880\",\"#FF97FF\",\"#FECB52\"],\"font\":{\"color\":\"#2a3f5f\"},\"hovermode\":\"closest\",\"hoverlabel\":{\"align\":\"left\"},\"paper_bgcolor\":\"white\",\"plot_bgcolor\":\"#E5ECF6\",\"polar\":{\"bgcolor\":\"#E5ECF6\",\"angularaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"radialaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"ternary\":{\"bgcolor\":\"#E5ECF6\",\"aaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"baxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"},\"caxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\"}},\"coloraxis\":{\"colorbar\":{\"outlinewidth\":0,\"ticks\":\"\"}},\"colorscale\":{\"sequential\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"sequentialminus\":[[0.0,\"#0d0887\"],[0.1111111111111111,\"#46039f\"],[0.2222222222222222,\"#7201a8\"],[0.3333333333333333,\"#9c179e\"],[0.4444444444444444,\"#bd3786\"],[0.5555555555555556,\"#d8576b\"],[0.6666666666666666,\"#ed7953\"],[0.7777777777777778,\"#fb9f3a\"],[0.8888888888888888,\"#fdca26\"],[1.0,\"#f0f921\"]],\"diverging\":[[0,\"#8e0152\"],[0.1,\"#c51b7d\"],[0.2,\"#de77ae\"],[0.3,\"#f1b6da\"],[0.4,\"#fde0ef\"],[0.5,\"#f7f7f7\"],[0.6,\"#e6f5d0\"],[0.7,\"#b8e186\"],[0.8,\"#7fbc41\"],[0.9,\"#4d9221\"],[1,\"#276419\"]]},\"xaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"yaxis\":{\"gridcolor\":\"white\",\"linecolor\":\"white\",\"ticks\":\"\",\"title\":{\"standoff\":15},\"zerolinecolor\":\"white\",\"automargin\":true,\"zerolinewidth\":2},\"scene\":{\"xaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"yaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2},\"zaxis\":{\"backgroundcolor\":\"#E5ECF6\",\"gridcolor\":\"white\",\"linecolor\":\"white\",\"showbackground\":true,\"ticks\":\"\",\"zerolinecolor\":\"white\",\"gridwidth\":2}},\"shapedefaults\":{\"line\":{\"color\":\"#2a3f5f\"}},\"annotationdefaults\":{\"arrowcolor\":\"#2a3f5f\",\"arrowhead\":0,\"arrowwidth\":1},\"geo\":{\"bgcolor\":\"white\",\"landcolor\":\"#E5ECF6\",\"subunitcolor\":\"white\",\"showland\":true,\"showlakes\":true,\"lakecolor\":\"white\"},\"title\":{\"x\":0.05},\"mapbox\":{\"style\":\"light\"}}},\"xaxis\":{\"anchor\":\"y\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"secs\"},\"type\":\"log\"},\"yaxis\":{\"anchor\":\"x\",\"domain\":[0.0,1.0],\"title\":{\"text\":\"top1\"}},\"legend\":{\"title\":{\"text\":\"family\"},\"tracegroupgap\":0,\"itemsizing\":\"constant\"},\"title\":{\"text\":\"Training\"},\"height\":800,\"width\":1000}, {\"responsive\": true} ).then(function(){\n",
|
|
" \n",
|
|
"var gd = document.getElementById('ba524fc8-737f-4ac7-915a-f1c159ecb282');\n",
|
|
"var x = new MutationObserver(function (mutations, observer) {{\n",
|
|
" var display = window.getComputedStyle(gd).display;\n",
|
|
" if (!display || display === 'none') {{\n",
|
|
" console.log([gd, 'removed!']);\n",
|
|
" Plotly.purge(gd);\n",
|
|
" observer.disconnect();\n",
|
|
" }}\n",
|
|
"}});\n",
|
|
"\n",
|
|
"// Listen for the removal of the full notebook cells\n",
|
|
"var notebookContainer = gd.closest('#notebook-container');\n",
|
|
"if (notebookContainer) {{\n",
|
|
" x.observe(notebookContainer, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
"// Listen for the clearing of the current output cell\n",
|
|
"var outputEl = gd.closest('.output');\n",
|
|
"if (outputEl) {{\n",
|
|
" x.observe(outputEl, {childList: true});\n",
|
|
"}}\n",
|
|
"\n",
|
|
" }) }; }); </script> </div>"
|
|
]
|
|
},
|
|
"metadata": {},
|
|
"output_type": "display_data"
|
|
}
|
|
],
|
|
"source": [
|
|
"show_subs(tdf, 'Training', 'train_img_size')"
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "markdown",
|
|
"id": "f9bb9e9a",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.042772,
|
|
"end_time": "2023-06-06T00:09:27.480454",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:27.437682",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"source": [
|
|
"Finally, we should remember that speed depends on hardware. If you're using something other than a modern NVIDIA GPU, your results may be different. In particular, I suspect that transformers-based models might have worse performance in general on CPUs (although I need to study this more to be sure)."
|
|
]
|
|
},
|
|
{
|
|
"cell_type": "code",
|
|
"execution_count": null,
|
|
"id": "d1274b15",
|
|
"metadata": {
|
|
"papermill": {
|
|
"duration": 0.042991,
|
|
"end_time": "2023-06-06T00:09:27.566602",
|
|
"exception": false,
|
|
"start_time": "2023-06-06T00:09:27.523611",
|
|
"status": "completed"
|
|
},
|
|
"tags": []
|
|
},
|
|
"outputs": [],
|
|
"source": []
|
|
}
|
|
],
|
|
"metadata": {
|
|
"kernelspec": {
|
|
"display_name": "Python 3 (ipykernel)",
|
|
"language": "python",
|
|
"name": "python3"
|
|
},
|
|
"language_info": {
|
|
"codemirror_mode": {
|
|
"name": "ipython",
|
|
"version": 3
|
|
},
|
|
"file_extension": ".py",
|
|
"mimetype": "text/x-python",
|
|
"name": "python",
|
|
"nbconvert_exporter": "python",
|
|
"pygments_lexer": "ipython3",
|
|
"version": "3.10.13"
|
|
},
|
|
"papermill": {
|
|
"default_parameters": {},
|
|
"duration": 23.634953,
|
|
"end_time": "2023-06-06T00:09:28.533193",
|
|
"environment_variables": {},
|
|
"exception": null,
|
|
"input_path": "__notebook__.ipynb",
|
|
"output_path": "__notebook__.ipynb",
|
|
"parameters": {},
|
|
"start_time": "2023-06-06T00:09:04.898240",
|
|
"version": "2.3.4"
|
|
}
|
|
},
|
|
"nbformat": 4,
|
|
"nbformat_minor": 5
|
|
}
|