ICSR-TomL.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 3526,
     "status": "ok",
     "timestamp": 1667574556192,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "cBO0vpkwXi2-",
    "outputId": "cedf09b6-3e1c-488b-abb4-e3cce7f3ccd0"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "gpu?True\n"
     ]
    }
   ],
   "source": [
    "#!pip install torch torchvision torchaudio\n",
    "import torch\n",
    "print('gpu?'+str(torch.cuda.is_available()))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "## HEART-MET Assistive Robot Challenge with VideoMae Transformers\n",
    "\n",
    "Olmer Garcia-Bedoya, Jose Tomas Lorente , Sebastian Murcia\n",
    "\n",
    "**[Ekumens Inc](https://www.ekumenlabs.com/)**\n",
    "Copyright 2022- Ekumen Inc. All rights reserved.\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "mPZJoSgn3_AN"
   },
   "source": [
    "## Colab Configuration"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {
    "executionInfo": {
     "elapsed": 2,
     "status": "ok",
     "timestamp": 1667574764430,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "FUj139BDY4Uy"
   },
   "outputs": [],
   "source": [
    "names=['Opening the door and walking in/out',\n",
    "        'Putting on a jacket',\n",
    "        'Touching a hot surface',\n",
    "        'Opening the fridge',\n",
    "        'Drinking water',\n",
    "        'Colliding against something',\n",
    "        'Eating food with a fork',\n",
    "        'Coughing or sneezing',\n",
    "        'Wiping a table',\n",
    "        'Reading a book',\n",
    "        'Neck roll exercise',\n",
    "        'Freehand exercise',\n",
    "        'Lying down',\n",
    "        'Limping',\n",
    "        'Talking on the phone',\n",
    "        'Using a computer',\n",
    "        'Falling down',\n",
    "        'Brushing teeth',\n",
    "        'Writing',\n",
    "        'Unknown activity']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "mY5TJSm4YRhs"
   },
   "source": [
    "The next code is adapted from (higgingFace->VideMAE-> VideoMAEForVideoClassification)[https://huggingface.co/docs/transformers/main/en/model_doc/videomae#transformers.VideoMAEForVideoClassification]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {
    "executionInfo": {
     "elapsed": 4961,
     "status": "ok",
     "timestamp": 1667574772521,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "DB0vY8SrZGyS"
   },
   "outputs": [],
   "source": [
    "from decord import VideoReader, cpu\n",
    "from transformers import VideoMAEFeatureExtractor, VideoMAEForPreTraining,VideoMAEConfig,VideoMAEForVideoClassification\n",
    "import numpy as np\n",
    "import torch\n",
    "import os\n",
    "import json\n",
    "import csv #I make in a venv here more easy pandas..."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 113,
     "referenced_widgets": [
      "60a8726cf933422db26f755d9c5623d1",
      "017e3f0a45c942e29b0fc432dca2ffc8",
      "373864a337c048778aacc3218f0aa5eb",
      "8f7ad298e78848c4918602274ddd45d1",
      "2e37ade3222b47b4bb3d9566dc862117",
      "55742a800669463d81d67456044285cb",
      "77d5ea8f038c4dd48d16cd885b00629a",
      "679fc76bd85144659d03c25ea1cf67b1",
      "e193535750a84ec0b98ab5077a6b5aa5",
      "5bcc6cfea7be4f3f8171f64ee9f44e17",
      "a533fd53359e42548409f60ac412c7ba",
      "bd9d32c5d158420990bf82ffb68f48c9",
      "a06160cdb0be42c2af5f55ec835e44ff",
      "295a086f553e46ecb8eb8b2c9b56916b",
      "17b6f0610cee47e1a33f2b54edc3631e",
      "9a9d479f3065407d88be6ca2b12abffa",
      "811ee525a96b49b1819473a5ccdc01a6",
      "6c590b31f3b043a4a2dcc3bacb742452",
      "fbdb8309e4654b6c839127fdb5e29cf0",
      "b698e60171154efabc766b47d2d7c486",
      "1a8775c21a7f466c944c790277a34326",
      "9b00cff2e12c4886b3f6cf1e6879d725",
      "9e90e00ea181485c8ac420e32b989f08",
      "fa4749f5fa94493a9ab3e9f218922106",
      "b7ff863729484b8fbb5fbc6a8c791e3e",
      "69f8d2bece1e4bc4987f81c63d82aded",
      "1af7e067011a4854a1e5f97624b230cd",
      "cafb90a4897b49028fbbcfe6b981e385",
      "622ef2865684418eb481e799c337c523",
      "87fea88df3494c8592b5de4485bcf8a7",
      "f04bb6ab61ee477c8a02719eeab23dff",
      "24fbf1047b6c4180815d2ea167d17252",
      "6687dc570dc74feba3bd2413c408eb76"
     ]
    },
    "executionInfo": {
     "elapsed": 30509,
     "status": "ok",
     "timestamp": 1667574811596,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "4ElqfGdNZBwO",
    "outputId": "5a9ec4ce-2667-4814-e1f0-a537176ec7b5"
   },
   "outputs": [],
   "source": [
    "name_model=\"MCG-NJU/videomae-base-finetuned-kinetics\"\n",
    "#name_model=\"MCG-NJU/videomae-base\"\n",
    "feature_extractor = VideoMAEFeatureExtractor.from_pretrained(name_model)\n",
    "output=json.load(open('training_labels.json'))\n",
    "validation_labels = json.load(open('validation_labels.json'))\n",
    "path='training_set'\n",
    "validation_path='validation_set'"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "uUdrM7onc2Im"
   },
   "source": [
    "## Fine tuning VideoMAE\n",
    "\n",
    "Fine tuning is the gold of transformers, from few videos/images/sentences we can make a classifier.\n",
    "\n",
    "VideoMAE is based of a ImageMAE which is based in ViT (Vision Transformer), which is Based in Transformers, so let try.\n",
    "\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "4hXykNNbdm3F"
   },
   "source": [
    "### Create DataSet\n",
    "\n",
    "based in [image dataset](https://huggingface.co/docs/datasets/image_dataset). I think that it is not used in the best way the library [link text](https://huggingface.co/course/chapter5/4?fw=pt)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "executionInfo": {
     "elapsed": 1297,
     "status": "ok",
     "timestamp": 1667574841424,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "batqReKX57xm"
   },
   "outputs": [],
   "source": [
    "from datasets import Dataset\n",
    "import numpy as np\n",
    "\n",
    "my_set=[{'file_name':path+'/'+a,'labels':output[a][0],'description':names[output[a][0]]} for a in output.keys()]\n",
    "validation_set=[{'file_name':validation_path+'/'+a,'labels':validation_labels[a][0],'description':names[validation_labels[a][0]]} for a in validation_labels.keys()]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "3a171dea8d6648978aff3e6ac19919bb",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/792 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from tqdm.notebook import tqdm\n",
    "\n",
    "augmented_set = []\n",
    "for elem in tqdm(my_set):\n",
    "    file_path = elem['file_name']\n",
    "    videoreader = VideoReader(file_path, num_threads=1, ctx=cpu(0))\n",
    "    videoreader.seek(0)\n",
    "    file_size = len(videoreader)\n",
    "    batches = int(file_size/16)\n",
    "    for i in range(batches):\n",
    "        new_elem = {}\n",
    "        new_elem['file_name'] = file_path + '@' + str(i)\n",
    "        new_elem['labels'] = elem['labels']\n",
    "        augmented_set.append(new_elem)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "03e1aba2740b42788ff97d64771bf193",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/136 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "augmented_validation_set = []\n",
    "for elem in tqdm(validation_set):\n",
    "    file_path = elem['file_name']\n",
    "    videoreader = VideoReader(file_path, num_threads=1, ctx=cpu(0))\n",
    "    videoreader.seek(0)\n",
    "    file_size = len(videoreader)\n",
    "    batches = int(file_size/16)\n",
    "    for i in range(batches):\n",
    "        new_elem = {}\n",
    "        new_elem['file_name'] = file_path + '@' + str(i)\n",
    "        new_elem['labels'] = elem['labels']\n",
    "        augmented_validation_set.append(new_elem)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "7148"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(augmented_set)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "1220"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "len(augmented_validation_set)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {
    "executionInfo": {
     "elapsed": 444,
     "status": "ok",
     "timestamp": 1667574846938,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "NYXrxPaYBnaw"
   },
   "outputs": [],
   "source": [
    "# from sklearn.model_selection import train_test_split\n",
    "# my_set_trian,my_set_val =train_test_split(augmented_set, test_size=0.2, random_state=42)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {
    "executionInfo": {
     "elapsed": 8,
     "status": "ok",
     "timestamp": 1667574850782,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "_KPPhlYQ57xn"
   },
   "outputs": [],
   "source": [
    "# all_set = {}\n",
    "# full_train_set = {}\n",
    "\n",
    "# all_set['train'] = my_set_trian\n",
    "# all_set['validation'] = my_set_val\n",
    "# full_train_set['train'] = augmented_set\n",
    "\n",
    "full_augmented_set = {}\n",
    "full_augmented_set['train'] = augmented_set\n",
    "full_augmented_set['validation'] = augmented_validation_set\n",
    "\n",
    "with open(\"train_augmented.json\", \"w\") as final:\n",
    "    json.dump(full_augmented_set, final)\n",
    "    \n",
    "# with open(\"full_train.json\", \"w\") as final:\n",
    "#     json.dump(full_train_set, final)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 249,
     "referenced_widgets": [
      "431c07b2e7ed4dbf9014c67d306945f8",
      "028465bf497d4737a5384f6f7c58200a",
      "d9b6dbfb87fd4c469058532892cf7a09",
      "cc31d15c0a584eb2af3b23c6db3d2503",
      "77033cd66ad340acbbdaeb82aa47591c",
      "462f437cc6144a7982a6dc89bd6f2a90",
      "21e17f19d8c84ababf07dd94864f53e5",
      "47c46c504521428d9bf84e798fde8937",
      "08301e86bd1745f28af465f1b9f9d050",
      "5f879ff41f624a7ba425b9e28646ab58",
      "824d814cdeea438798bd18426092fe41",
      "09e0443823d54f578af5cf635b7b3715",
      "ae9b118bc353457ab8e6c21208a8d57b",
      "bfe6a0d505be48b888ea13cdc0d56447",
      "bcea670e5b234125a4d801fafe8928f7",
      "045cd9695f3e479fb21048b39abfc18b",
      "24270d9757e247669e9ca2105a727cb8",
      "7e98903f8faf4030a3b46fb8b744b5e5",
      "743fdc0668b44aa2a79d9c64b1e2d08d",
      "7254dc86b6714a81b46997dc132360e0",
      "107b16ef81554781856cd67a6ae038da",
      "68141e3ab39b40169949a3576477a42b",
      "6372d32e9b8c4efb9e212a376a4c7947",
      "1144746deacc4c07aa06c81906f6ce77",
      "45af82f6eb18460784ab055d93f280ef",
      "c6d60b6c586f484ebc402f5d44cc2f7a",
      "7e0fd7d1189048f09ad63b0d6f5e7783",
      "4a2741e1b02749f5887bf798ee8e21d6",
      "52e6c6ed71eb427b88df2e3fbf5b87c1",
      "20fb65d2eee24bbb8d74fec87df215e6",
      "e6bcacc7468d430990aebd786bd5db3c",
      "3519c3abbb684bae90a994f8a089d4ff",
      "51379fdebbaf4587b5cabb85d4fb8faa",
      "1f6a6b3791e54b56bb5b7f2f0ba812d9",
      "1649a5747b8c48e58c4508a9906fea8f",
      "e2eafd1b4cfa4965bf05c9caa0ea4595",
      "e3ac5081836d40f797a5305f1429175e",
      "5ebfc1a0964a4af7a600afb7904c8e0b",
      "0dd258e5733e4584a0031bfa3a1e9392",
      "7e251276f132481e886901a9c0fa5562",
      "3197fad62a9d4d289c40772bfe021d7f",
      "71bfa349d37c4717bb34bb93e8779bd8",
      "5f2c37ea11f24e96864754cb94c6c5dd",
      "2f6043f91b71453ab2b7ac628c04e556",
      "fec838d6713444ff837f6f340502adb9",
      "21cf114acd51449da8bb1532a5f18f8b",
      "33da8b0d87a14575aa6f65b46f803bd2",
      "0e8d7313d9f24c49821bb81bb013a925",
      "7478c6eda4694875a8dcfb3b59676f26",
      "ddbbe0f725de4361bb71b756f749a215",
      "d251f651ebf24f6da07d1735559818b6",
      "13d7e978cba64a3cbb9bd0e9bb50ecbc",
      "20589c5d2372402e99f4c1406659c0ee",
      "5100f2875c724d10b1801c55084c33ab",
      "32ea79387ae845cea889c436ffabd9e1",
      "77c5c395d16247cf9bd2a0d4e7a216f9",
      "29aae51c7130465f97ce90491f0c9696",
      "bfa55478d7ed4d629c85c76d44c08a3c",
      "d1f5438cbf314ffaaecc473f9922ee70",
      "e9045bde9871448a863b44559d114a5a",
      "d20cd3c0c8484cf8a4581619bfd061fb",
      "c0b8d07504094fd3b4dc918fe80d5099",
      "fcaf3755cdc44224a46a32762fcae938",
      "c59ef23f2be94dcba663c347779c860a",
      "781aceb284cf4bb192dde0fd2b731079",
      "81aa9067dbd94f979c23bc64897a3eab"
     ]
    },
    "executionInfo": {
     "elapsed": 3621,
     "status": "ok",
     "timestamp": 1667574858629,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "KBRAccAV57xn",
    "outputId": "5a4bcc8b-f459-4c2e-ac0a-7bc3e5161209"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Using custom data configuration default-27712e88fc2a575c\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Downloading and preparing dataset json/default to /home/tomas/.cache/huggingface/datasets/json/default-27712e88fc2a575c/0.0.0...\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "257b509ffddc4d12bc957bf784e021fa",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Downloading data files:   0%|          | 0/1 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "8f5825efd72d4554847e959049844a67",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Extracting data files:   0%|          | 0/1 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "0 tables [00:00, ? tables/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Using custom data configuration default-99d1998bd928da80\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Dataset json downloaded and prepared to /home/tomas/.cache/huggingface/datasets/json/default-27712e88fc2a575c/0.0.0. Subsequent calls will reuse this data.\n",
      "Downloading and preparing dataset json/default to /home/tomas/.cache/huggingface/datasets/json/default-99d1998bd928da80/0.0.0...\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "a9e5dd7c0e074b0386fcbd5aa20f5271",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Downloading data files:   0%|          | 0/1 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "69c959165cf54c909f3bbc57099644e5",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Extracting data files:   0%|          | 0/1 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "0 tables [00:00, ? tables/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Dataset json downloaded and prepared to /home/tomas/.cache/huggingface/datasets/json/default-99d1998bd928da80/0.0.0. Subsequent calls will reuse this data.\n"
     ]
    }
   ],
   "source": [
    "# dataset = Dataset.from_json('train.json',field='train')\n",
    "# dataset_validation = Dataset.from_json('train.json',field='validation')\n",
    "# dataset_full = Dataset.from_json('full_train.json', field='train')\n",
    "dataset = Dataset.from_json('train_augmented.json',field='train')\n",
    "dataset_validation = Dataset.from_json('train_augmented.json',field='validation')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 194,
     "status": "ok",
     "timestamp": 1667421550894,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "ohfjncJwfSNz",
    "outputId": "89189f43-ecd5-4c17-9684-aa7ee9bc3a15"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'file_name': 'training_set/video0000.mp4@0', 'labels': 14}"
      ]
     },
     "execution_count": 13,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dataset[0]\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "# for i in range(int(144/16)):\n",
    "#     sub = int(144/16)\n",
    "#     indices = np.linspace(i, 144-sub+i, num=16)\n",
    "#     indices = np.clip(indices, 0, 144- 1).astype(np.int64)\n",
    "#     print(indices)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [],
   "source": [
    "# def multi_sample(pre_dataset):\n",
    "#     new_dataset = []\n",
    "#     for elem in tqdm(pre_dataset):\n",
    "#         file_path = elem['file_name']\n",
    "#         videoreader = VideoReader(file_path, num_threads=1, ctx=cpu(0))\n",
    "#         videoreader.seek(0)\n",
    "#         file_size = len(videoreader)\n",
    "#         batches = int(file_size/16)\n",
    "#         for i in range(batches):\n",
    "#             indices = np.linspace(i, len(videoreader)-batches+i, num=16)\n",
    "#             indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "#             output = {}\n",
    "#             output['pixel_values'] = feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0]\n",
    "#             output['labels'] = elem['labels']\n",
    "#             new_dataset.append(output)\n",
    "#     return new_dataset"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "# prepared_train = multi_sample(dataset)\n",
    "# prepared_validation = multi_sample(dataset_validation)\n",
    "# prepared_full = multi_sample(dataset_full)\n",
    "# TAKES TOO MUCH RAM, IMMPOSIBLE"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {
    "executionInfo": {
     "elapsed": 4,
     "status": "ok",
     "timestamp": 1667574958234,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "o-3gRb9VzuuD"
   },
   "outputs": [],
   "source": [
    "# def transform(sample):\n",
    "#     \"\"\"\n",
    "#     TODO: test different sampling methods\n",
    "#     \"\"\"\n",
    "#     inputs=[]\n",
    "    \n",
    "#     for s in sample['file_name']:\n",
    "#       videoreader = VideoReader(s, num_threads=1, ctx=cpu(0))\n",
    "#       videoreader.seek(0)\n",
    "#       #indices = sample_frame_indices(clip_len=16, frame_sample_rate=4, seg_len=len(videoreader))\n",
    "#       indices = np.linspace(0, len(videoreader), num=16)\n",
    "#       indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "#       inputs.append(feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0])\n",
    "#     output={}  \n",
    "#     output['pixel_values'] =inputs \n",
    "#     # Don't forget to include the labels!\n",
    "#     output['labels'] = sample['labels']\n",
    "#     return output"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "executionInfo": {
     "elapsed": 364,
     "status": "ok",
     "timestamp": 1667575053854,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "E8Y_89HDy8jy"
   },
   "outputs": [],
   "source": [
    "# prepared_train = dataset.with_transform(transform)\n",
    "# prepared_validation = dataset_validation.with_transform(transform)\n",
    "# prepared_full = dataset_full.with_transform(transform)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "id": "2c3rQkYcoxjU"
   },
   "outputs": [],
   "source": [
    "# prepared_train[0]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [],
   "source": [
    "import cv2 as cv\n",
    "\n",
    "# params for ShiTomasi corner detection\n",
    "feature_params = dict( maxCorners = 100,\n",
    "                       qualityLevel = 0.3,\n",
    "                       minDistance = 7,\n",
    "                       blockSize = 7 )\n",
    "# Parameters for lucas kanade optical flow\n",
    "lk_params = dict( winSize  = (15, 15),\n",
    "                  maxLevel = 2,\n",
    "                  criteria = (cv.TERM_CRITERIA_EPS | cv.TERM_CRITERIA_COUNT, 10, 0.03))\n",
    "\n",
    "def optical_flow(video):\n",
    "    temp_video = videoreader[:].asnumpy()\n",
    "    old_gray = cv.cvtColor(temp_video[0], cv.COLOR_BGR2GRAY)\n",
    "    p0 = cv.goodFeaturesToTrack(old_gray, mask = None, **feature_params)\n",
    "    output = []\n",
    "    for frame in temp_video[1:]:\n",
    "        frame_gray = cv.cvtColor(frame, cv.COLOR_BGR2GRAY)\n",
    "        # calculate optical flow\n",
    "        p1, st, err = cv.calcOpticalFlowPyrLK(old_gray, frame_gray, p0, None, **lk_params)\n",
    "        # Select good points\n",
    "        mask = np.zeros_like(old_gray)\n",
    "        if p1 is not None:\n",
    "            good_new = p1[st==1]\n",
    "            good_old = p0[st==1]\n",
    "        for i, (new, old) in enumerate(zip(good_new, good_old)):\n",
    "            a, b = new.ravel()\n",
    "            c, d = old.ravel()\n",
    "            mask = cv.line(mask, (int(a), int(b)), (int(c), int(d)), 255, 2)\n",
    "            mask = cv.circle(mask, (int(a), int(b)), 5, 255, -1)\n",
    "        # Now update the previous frame and previous points\n",
    "        output.append(mask)\n",
    "        old_gray = frame_gray.copy()\n",
    "        p0 = good_new.reshape(-1, 1, 2)\n",
    "    return np.asarray(output)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [],
   "source": [
    "videoreader = VideoReader(my_set[0]['file_name'], num_threads=1, ctx=cpu(0))\n",
    "videoreader.seek(0)\n",
    "\n",
    "optical_output = optical_flow(videoreader[:].asnumpy())"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(140, 480, 640, 3)\n",
      "(139, 480, 640)\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "<matplotlib.image.AxesImage at 0x7feee144a970>"
      ]
     },
     "execution_count": 66,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAiQAAAGiCAYAAADX8t0oAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjYuMiwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy8o6BhiAAAACXBIWXMAAA9hAAAPYQGoP6dpAAA0MElEQVR4nO3deXxU1f3/8fcsyWSdCQGSECEsgiyyqKwjtlVJRcWtYqstKrVUCwZcsFaxrVS/bfGrv9ZKFXAr+K1SWtuKSgFFEKwSAkSRTRAUDQJJWJOwZJmZ8/sDGY3JAIFkTpbX8/GYh5lzzsz93ENk3tx77h2HMcYIAADAIqftAgAAAAgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDqrgeSpp55Sp06dFBcXp8GDB2vlypU2ywEAAJZYCyR///vfNXHiRE2ePFnvv/+++vXrp+HDh6u4uNhWSQAAwBKHrS/XGzx4sAYOHKgnn3xSkhQKhdShQwdNmDBB999/v42SAACAJW4bG62srFR+fr4mTZoUbnM6ncrOzlZubm6N8RUVFaqoqAg/D4VC2rdvn1q3bi2HwxGVmgEAQN0ZY1RWVqbMzEw5nZFPzFgJJHv27FEwGFR6enq19vT0dG3atKnG+ClTpuihhx6KVnkAAKCebd++Xe3bt4/YbyWQ1NWkSZM0ceLE8POSkhJlZWXpAl0ut2IsVgYAAI4noCq9q/lKTk4+7jgrgaRNmzZyuVwqKiqq1l5UVKSMjIwa4z0ejzweT412t2LkdhBIAABotL5cqXqiJRZWrrKJjY1V//79tXjx4nBbKBTS4sWL5ff7bZQEAAAssnbKZuLEiRo9erQGDBigQYMG6U9/+pMOHTqkW265xVZJAADAEmuB5Prrr9fu3bv14IMPqrCwUOecc44WLlxYY6ErAABo/qzdh+R0lJaWyufz6UJdzRoSAAAasYCp0lK9qpKSEnm93ojj+C4bAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIIEkyd2xg8z5/WyXAQBooZrEl+uh4RTnnK+DQw+rS/oeDWr9vv6+sb9ChXHqOnGF7dIAAC0IgaQFK/3REM2+9/+pZ2xCuO23aetUEjqi/uZunXkPoQQAEB2csmnBKryOamHkGJ8zXia9wkJFAICWikDSQrlapyr+mqKI/defnc+aEgBA1BBIWihz6LAKN6VF7M/d01kx2/dGsSIAQEtGIGmhQuXl8m1yROwvKEpVYPsXUawIANCSEUhasFYfV+pP+zvVaF9bWS7fu3HRLwgA0GJxlU0L5l6Sr9cnDNNfu8XqQE+jtmftUdWrbeUpMWo7J9d2eQCAFoRA0sK5l+SrzRIpLS5OjsQEBfdutV0SAKAFIpBA0tE1JSovt10GAKCFYg0JAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOq2zQ4ri6d1UoOU6fXJesmIMOZS0slfPAIQW3brNdGgC0WAQStCjBi87T9556Q2NTdnzVeLs0effZyh07QI7cD+0VBwAtGKds0KJsuzK2ehj50kNtN2j7dxMtVAQAkAgkLY4zMVHOuJb5PTUOj0ehhFDE/kCikcPNQUMAsIG/fVuI8isG6Ugblw5cekhV++PUNs+l5O2Vci/Ot11a1IT699Ck78yL2H/biDf19v8NUHDD5ihWBQCQCCQtQumPhuihh5/XJQlVXzVeLT1TkqnZE0fIs2CVveKiyLH8Q/3vgqt02w0zau3/yz+GK2vD8ihXBQCQOGXTIhT5TfUw8qXbfDu1+5wYCxXZ4ww4FDQ1T9tUmaCcAQsFAQAkcYSk2XO1aa24doci9h/uGJAzOVmhsrIoVmVPl/tX6qzMMbqm54c6P3mrDoVi9eGhLP171QCd9Uie7fIAoMUikDRzpn26sjtFXhNxbq9tqmjdqsUEEoWC6nrjB1ov6f1Lr5f7YJWc767RWVppuzIAaNE4ZdPMhdZs1Lzc8yL2b17QTYHPCqJYUeMRu3CVnO+usV0GAEAEkhYh5oBT+4OHa7R/ETio2BZyYAQA0LhxyqYF6PTrXA2KvUexXUt1eeeNKqpIVv7ODtJqn9o/yVUlAAD7CCQtRJf7ciVJawf1ketghdpv3GC5IgAAvkIgaWlWrlPQdg0AAHwDa0gAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBC2Cu2MH2yUAAI6D+5Cg2XImJ6vwpj6SpLvv+Icef/IHUkjKnP9Fi/3+HgBorAgkaLY+ntZVnwybFn5+8wNHf/7uyCvlvjJBocM1v98HAGAHp2zQbM0cOrPW9vk95srh8US5GgDA8RBI0CyZoecoxVlea59TDpVdeFaUKwIAHA+BBM3S3rPjleIMROzf09cVxWoAACdCIEGz1OaZXH0WSKq1LySjzlM/inJFAIDjIZCg2Xppj7/W9n8dbCMTiHz0BAAQfVxlg2Zr+4gknfnHWyRJ/zf0ed28fIxkpG5/qpQp22C5OgDA1xFI0GwFd+9W15t2S5Luu26cuv5rpWSMjOW6AAA1EUjQIiT+M892CQCA42ANCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsK7OgeSdd97RlVdeqczMTDkcDs2dO7davzFGDz74oNq1a6f4+HhlZ2dry5Yt1cbs27dPo0aNktfrVUpKisaMGaODBw+e1o4AAICmq86B5NChQ+rXr5+eeuqpWvsfffRRTZ06VTNmzFBeXp4SExM1fPhwlZeXh8eMGjVKGzZs0KJFizRv3jy98847uu222059LwAAQJPmMMaYU36xw6FXXnlF11xzjaSjR0cyMzN1zz336Oc//7kkqaSkROnp6Zo1a5ZuuOEGffTRR+rVq5dWrVqlAQMGSJIWLlyoyy+/XF988YUyMzNPuN3S0lL5fD5dqKvldsScavkAAKCBBUyVlupVlZSUyOv1RhxXr2tItm3bpsLCQmVnZ4fbfD6fBg8erNzcXElSbm6uUlJSwmFEkrKzs+V0OpWXl1fr+1ZUVKi0tLTaA82Xu/0ZcsTE2i4DABBF7vp8s8LCQklSenp6tfb09PRwX2FhodLS0qoX4XYrNTU1POabpkyZooceeqg+S0UjtHucX0GPQ4N++KHeeau/4nY7lL7ykBzLP7RdGgCggdVrIGkokyZN0sSJE8PPS0tL1aFDB4sVob4VTD5fy3/6/9TKlXC04Zb3JEm/Ku6j/NG9FfrwI4vVAQAaWr2essnIyJAkFRUVVWsvKioK92VkZKi4uLhafyAQ0L59+8Jjvsnj8cjr9VZ7oHlp/+3tX4WRr/lt2jodyUyyUBEAIJrqNZB07txZGRkZWrx4cbittLRUeXl58vv9kiS/368DBw4oPz8/PGbJkiUKhUIaPHhwfZaDJsLZu4f6puyI2F80OEZyuqJYEQAg2up8yubgwYPaunVr+Pm2bdu0Zs0apaamKisrS3fddZd++9vfqlu3burcubN+/etfKzMzM3wlTs+ePXXppZfq1ltv1YwZM1RVVaXx48frhhtuOKkrbND8VGQmqVt8UeT+LuVyOB0yoSgWBQCIqjoHktWrV+uiiy4KPz+2tmP06NGaNWuWfvGLX+jQoUO67bbbdODAAV1wwQVauHCh4uLiwq956aWXNH78eA0bNkxOp1MjR47U1KlT62F30BTFvLla/9p1nsZGOEqS9TeXTCAQ5aoAANF0WvchsYX7kDQ/Hz8/QJsunS7PN/48Fx9x6ZHRN8n57ho7hQEATsvJ3oekSVxlg+bvrDGr1fPJ8TLxQd055C0989EFOlISpzMWuJT4bu33pwEANB8EEjQa3cYfDR7zLrxYndZ8ouCBEssVAQCihUCCRse19H0FbRcBAIiqer3sFwAA4FQQSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAoBbBi86To//ZtstoMdy2CwCABjGkrwqHJCnjT8ttV4Im5uMZg9Sz+xe6LG2J9gcStWpfR23N66jO9+faLq1ZI5AAaDZcXq82/bmr5n5nmhId78rndGjnXS69VnqOci8/U4EvdtguEY3cp4/4teGKJ5TgjP2qse0GlXQ7om/tvkft/kDAbSgEEgDNxu7rztan350uKS7c1sYl9W2zSd3/MEidrieQ4PiC8aZ6GPmSzxmvYM1m1CPWkAAAIElD+uqnF70dsXvYyFVydesSxYJaFgIJgGbBnZGuCb94OWL/7EHPqfRHQ6JYEZoa54Ztem7N0Ij985f1l9m+M4oVtSwEEgDNQqCwSFMf+37E/lGrxsg7e0UUK0JTEyork/ZHPi/j2eNUqLw8ihW1LAQSAM2Gw0TuM8YRvULQZHV4K6R/HfTWaH9s35lql0sYaUgsagXQbKQt2Kbzrrle75z3gmIcLjnlVIWp0vzD6ery+yqFbBeIRi/u9ZV6es/39OeUWH1+jRSz363MZQHFFR+WK/992+U1aw5jzHH+TdE4lZaWyufz6UJdLbcjxnY5ABoRR0ysHLExqvD30K6hHnX6fx9Kxih0+LDt0tDEONxumZCRQkHbpTRpAVOlpXpVJSUl8nprHn06hiMkAJoVU1UpU1WpmLfylfWWOCqCU2YCAdsltCisIQEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEABoZd+eOClzcP6rbLLlxiBxud1S3CXwdv30A0EgU3nm+nBfvU7fWuzUsZZ3++skgHShM1lk/W9Ug23N5vdrxf2fI6TCa3ucpTbjhhwoEnUp9IlHuJfkNsk0gEgIJADQCJaOGaO7ER9U5JincNjH1Ux0OVar3UxPULSev3rfZ4a0qzW//ty+fubTqvH9IklY+X6WHzr9SgV2F9b5NIBJO2QBAIxBIcFQLI8ckOGPlalXRINsc6t1Sa/sgT4zkcjXINoFICCQAYJmrdapa37A9Yv9tff+r4EXn1es2d4/1a2BcQcT+j+5vX6/bA06EQAIAloVKD2pbXoeI/a9+0U+eTTvrdZsZ7+zVp4HUiP0d3jD1uj3gRAgkAGCZqaqUd1vk/qJ93npfzxHc+LH2BmqeIjom6YMd9bo94EQIJADQCKRuPKLJu8+u0b62sly+xfENss2H511Xa/u3131P5uDBBtkmEInDGNPkjsuVlpbK5/PpQl0ttyPGdjkAUD+G9FXJmQnad7ZDSb33KfbvrRR7KKT4uSsbZHOOmFgd+MHRtSk/mPSm/vaH4XJVGrV+b6cCn0VeXwLURcBUaaleVUlJibxeb8RxdTpCMmXKFA0cOFDJyclKS0vTNddco82bN1cbU15erpycHLVu3VpJSUkaOXKkioqKqo0pKCjQiBEjlJCQoLS0NN17770KBAJ1KQUAmjxXm9Zy9u6hquz+KpnfVc6DlUpds19dJucrfdRO+V5a0WBhRDp6qsj30gr5Xlqhty7srNSZuUp9Y4vMvgMNtk0gkjrdh2TZsmXKycnRwIEDFQgE9MADD+iSSy7Rxo0blZiYKEm6++679Z///Ecvv/yyfD6fxo8fr2uvvVbvvfeeJCkYDGrEiBHKyMjQ8uXLtWvXLt18882KiYnR73//+/rfQwBohFzpado+o43WDZ79VeObUknoiIbfd7d8L62Iaj37L+mmw2nd5bp4r/bvTZL3Q49SPgko7vWGC0TA153WKZvdu3crLS1Ny5Yt07e//W2VlJSobdu2mj17tq677ui5yU2bNqlnz57Kzc3VkCFDtGDBAl1xxRXauXOn0tPTJUkzZszQfffdp927dys2NvaE2+WUDYCmzvj76c1/vVBr363bh6pg8KGo1bL3Vr+mPTD16P1HvmZOWStN+8X3Ff8qoQSnrkFO2XxTSUmJJCk19eilY/n5+aqqqlJ2dnZ4TI8ePZSVlaXc3FxJUm5urvr06RMOI5I0fPhwlZaWasOGDbVup6KiQqWlpdUeANCUVfki/+Mr3lUp55dHnaNh73nBGmFEkm5I3q/93bmhN6LjlANJKBTSXXfdpaFDh6p3796SpMLCQsXGxiolJaXa2PT0dBUWFobHfD2MHOs/1lebKVOmyOfzhR8dOkS+Xh8AGj2nS61/Gfk635+1eUe7xvSLSinu9mcoveO+iP0He1bIleKLSi1o2U45kOTk5Gj9+vWaM2dOfdZTq0mTJqmkpCT82L498h0NAaDRCwVV+oszInb/qShb6VOXR6eU1GT1TC2K2H9Gu/1yxDfMZcfA151SIBk/frzmzZunt99+W+3bf3V74YyMDFVWVurAgQPVxhcVFSkjIyM85ptX3Rx7fmzMN3k8Hnm93moPAI2YwyGHxyNXepo+fn6AHB6PHDEnXh/WkjiMUZUJ1tp3JBi9tXGhtZu09IOeEftLlmTwJXuIijoFEmOMxo8fr1deeUVLlixR586dq/X3799fMTExWrx4cbht8+bNKigokN/vlyT5/X6tW7dOxcXF4TGLFi2S1+tVr169TmdfADQCzrg4ffrIEL24dYleWj1XH1/6tF7cukTPfbJEoW+da7u8xiNvnQb9foIm7z5bj+07Ux9VHtbk3Wdr/I7B2ju89qDSUOJ3uvVFoOaN0DZUHlHcniZ3q6oG4UpPk7t95KNaOH11usrm9ttv1+zZs/Xqq6+qe/fu4Xafz6f4Lw/pjRs3TvPnz9esWbPk9Xo1YcIESdLy5UcPPwaDQZ1zzjnKzMzUo48+qsLCQt1000366U9/etKX/XKVDdB4uXqdpflv/aPWvt/u6aH/9o2LckXRUXH5QCV8vEfBrce5B3wErtap2nFzD2U8Hp3TNLUpmHy+yrMqdfHZm1RwqJW2fpYu35pYpf/ZXk2NQcmNQ1TS1SlnnxJ5E8p1IC9diTuMWj+ba7u0JuNkr7Kp0/Lp6dOnS5IuvPDCau0zZ87Uj3/8Y0nS448/LqfTqZEjR6qiokLDhw/XtGnTwmNdLpfmzZuncePGye/3KzExUaNHj9bDDz9cl1IAoFHY+tdz1SF9v27q8LpWlJ6pLSWdtHdRpjIfO/kP8uDefVbDiCRlPXR0+zv79VRs2RGd9elqq/U0BiWjhuh3Dz2rYfFfO2LVT8qvqNSt7jvVdjqhpD5x63gA9SorL1HPdniv1r7i4CF9a9bP1enXzeMv8o+fGahNI6bJ842/h4qDh3TVpHvkezG6NzdD/dr+y/O1MWdarX1n/n2sut7Nn+/JiMp9SADgm3bcEvk8+zP7+zebMCJJMcmVNcKIJKW5EhXwOE76fcpuGFKfZaEeuNLTpHMj3/OqXc9iuTtlRbGi5o873gDAKagcPkAT+y2I2N/px1t0eG6qgntrv8eHu0snffzbFEnSHP9U3XDVbZKkbpNLFdzyab3Xi7pxOJ2K91RG7E+MqZRxc4S+PnGEBEC9Cn3yuXo8N07bqg6qIHBQFaZK26oO6qPKw3p3zEDb5dWb+PxtmvWZP2L/2ne7SU5X7Z1Ol4a9tlZbLpylLRfOUn9PbPjny+bmy+Hm34q2BXYV6siKNhH7t65tf0oLmBEZgQRAvTIVFer4YK7Gdv6Oxp57lXq8lqOxnb+ju7p8S2bVOtvl1Zvgnr3aVxL59u4f3fyUHsxbKHN+zTuuOpwOXeddW+vrrkuu/Ss0EH1JO4xWVlTVaP+o8rCSPuPjs74RwwE0jFBQwb37dNa45vvFbK3mJ2jNkAqd4/HU6HM5nBoSJ+1/4IhSr6jet/POQUp1vlvreyY73dpx96A6XaWDhtFqVq7Gxd6hku5GqT32qlXcEX2ypr0SC5zKeII/n/pGIAGAU5Ty11xN3HW7dlwUq823TK91jMNhJIdD+toFjWn55TpsgkqqZXyVCSl9dXkDVYy6avNMrtpIcndoL+OJ0ZlbubKmoXDMCQBOQ9zqrbrje/Mi9j/T60Xtu6X6VTTud9eqPMIdF8pNSO7/1n465+ucfXvUrVCclsD2L1gz0sAIJABwGoIHSjT7NyMi9t+64Sal/qX6pc4mGNRlq35W6/hkp1t7flz74l9ncrK+eOB8ffHA+brlnwu0/ddHf3Z173rqOwA0EgQSAIgS4++nvT/1S8ao488K1ePdm2qMSXLG6elfPqE9P6t5Bc+25ztpw/hp2jB+mn6QVKKN447+nP5CkVx86SiaONaQAMBp8s5bqy7f+plmjXhaiY5KZboqtSWQpHcPdlfaHZXaOLO/nvv2LLV25snnrNKnk3yas2eItrydJF1Q8/36e2K1v5fRNy86/cN5L9e6/ec6LNOVnuH1v2NAFBFIAOA0hQ4fVrcJefrdhHPk6nWWvri0jdr98ehVGLvHttO24ccWvHokedQ5JqhhHd6Tbq79FvuS1K57sdwdOyjw+XZJUtUlA3SGK+/L96jO5XCq+Kquav387nreMyB6CCQAUI+CGz9Wu40fn/b7tI0/pMq45PDz8lZueRzBiOPL25z8reqBxog1JABQzxwxsXJ5vXKd3V2/ueeFU3qPtWs6K7h5a/h58t9X6NNAaq1jgyakrL9sOaXtAI0FR0gAoB65Unz66A/dtOnSo6dpavvyvWOWHnEq2Vmu/p7YGn3x7cvkSk9TsKg43Panz7+rET1frzH2if1dpUCgHqoH7OEICQDUo6o+XbTtsufkccQcN4xI0pjlo3Xr/96pgsDBGn0b/C9p25PpcsbFhdtiRpaqyz9/pi7//JkWHvaoyytHf1504xAF9++v930BookjJABQn07in3lBE9LcQynqNjUgsypXW+71Kctdc33I+vNf0JWJ2VL50Tu3Bg+UqNsdeZKkR1+7Ud0Wr5SMUahedwCwg0ACAPXE4XZr8BOrI/YXBw/p2zN/ri5TP5aCIZn96+Tu0kmJjnxJtX8zcKB7BzmW76vRHvNWfn2VDTQKnLIBgHpiAgHlTRgQsX/i9hHq+GCugnv2hk+xfP79THV0H6l1vMvh1Jabal7mCzRHBBIAsOiM/12ujVW+WvuCJqSev9paax/Q3BBIAKAeuVZu1Fmzxim/olJrK8u1P3hY+RWVeu1QgvbfmFLra9aVd6i1fVNVhRSq/Uv4gObGYUyEr5xsxEpLS+Xz+XShrpb7BKvYAcAW9xmZ2jquozr9Kvf44zLSdfivR6+mebLbHN2x9XqFjEPuh1Pl/O8H0SgVaDABU6WlelUlJSXyHuc7lwgkANCIFN9+vtKm50pN769moFYnG0i4ygYAGpG0acttlwBYwRoSAABgHYEEAABYRyABAADWEUgANDh3RrqcCQm2y4gKV9fOtksAmiQWtQKWlNw4RL4XV9TpNWXXD5H33+/LVFU2UFX1a98tflX6HEq7crs+2dBHyZ+61Hp9RbO77bm7Syd9cVWmjFO672d/16PTr5ckZT77oUKHDlmuDmgaCCRAFLnbn6FPH0+VJL04YKpuuuYnMsahTr8LKrRmY62vcSYmatvMLnI4pKf7z1DODT9SIOBS5oxYuRc33g/2wrvP17/velRnxiQdbeh59D9/3t9Rr44fJtfb79srrh45k5MVM/OIPuw2Ldw26hdHfz5zwC3qeiP3EQFOBoEEiKKh87fqP202f/ksVhvPf1GSNPflJD3dr69Chw/XeE3iwnhtOvOv4efrBs+WJL3XP6TfX3S1Ap9vb/C6T8WRwQe/CiNfM6HV5/q/zh6lvm2hqAbgiIvTv7ouUG1nwJ8aMluPH0tiAI6LNSRAFF2evLbW9kvi90kOR619F7XeXGv70Din5Kr9G2Jtc3XtrF7tiiL27+1n5IyLi2JFDWd/9pkR+9q6yhT61rlRrAZouggkQJQU3nW+Mt2BWvtiHC5tu69vjfZ9P/FraHzkL1f76J70equvPgXaetXdGzmQJHUskSM2NooVNZwD3ZxyOWr/qzTZWaWSLs0jeAENjUACREm798p0IFR7X0ghZb5Tc6Fqm9X79VmgdcT3zPhv7UdVbHPkfqhXNtcMWMd4XktRsLQ0ihU1nM7Ttyhoav+D/bQqVa1eOP732AA4ikACRIlZtU6HQ7Uv2woaI0/uphrtobWbtKOqVcT3bLWysN7qq2+hLxK0P1hzTczKiirFRUpmTVEgoFmlmbV2/aXwgigXAzRdLGoFoujad8bp0+/+pUb7Be/fpLTKbbW+5vEFI5Tzwxk12i/dNELO0rJ6r7G+nPnzFRoUvEeBNlW67tx8LdvVVbsLfWrzXoxS/918jhoE9+/XyzcO029vj5ecRi9853mNfvunkqSev/jUcnVA08G3/QJR5PJ6tXvk2ZKkCfe9rD8/+n3JSGkLtymwq/ajHY6YWO0b1V/GIf3gnjf1tycvkatCavvfQgW31h5iGp1BfeTevjviPjYbDoeOXDVQ8a+utF0J0Gic7Lf9EkgAS9wZ6QoURl74WRtXepqCRcUNVBEA1L+TDSSsIQEsqWsYkUQYAdBsEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANbVKZBMnz5dffv2ldfrldfrld/v14IFC8L95eXlysnJUevWrZWUlKSRI0eqqKio2nsUFBRoxIgRSkhIUFpamu69914FAoH62RsAANAk1SmQtG/fXo888ojy8/O1evVqXXzxxbr66qu1YcMGSdLdd9+t119/XS+//LKWLVumnTt36tprrw2/PhgMasSIEaqsrNTy5cv1wgsvaNasWXrwwQfrd68AAECT4jDGmNN5g9TUVD322GO67rrr1LZtW82ePVvXXXedJGnTpk3q2bOncnNzNWTIEC1YsEBXXHGFdu7cqfT0dEnSjBkzdN9992n37t2KjY09qW2WlpbK5/PpQl0ttyPmdMoHAAANKGCqtFSvqqSkRF6vN+K4U15DEgwGNWfOHB06dEh+v1/5+fmqqqpSdnZ2eEyPHj2UlZWl3NxcSVJubq769OkTDiOSNHz4cJWWloaPstSmoqJCpaWl1R4AAKD5qHMgWbdunZKSkuTxeDR27Fi98sor6tWrlwoLCxUbG6uUlJRq49PT01VYWChJKiwsrBZGjvUf64tkypQp8vl84UeHDh3qWjYAAGjE6hxIunfvrjVr1igvL0/jxo3T6NGjtXHjxoaoLWzSpEkqKSkJP7Zv396g2wMAAKem7IYhcrVOrfPr3HV9QWxsrLp27SpJ6t+/v1atWqUnnnhC119/vSorK3XgwIFqR0mKioqUkZEhScrIyNDKlSurvd+xq3COjamNx+ORx+Opa6kAACAaHA4Vz+0uX3y5ftlllp6//VvaV95Jh2e3U/LMd07qLU77PiShUEgVFRXq37+/YmJitHjx4nDf5s2bVVBQIL/fL0ny+/1at26diouLw2MWLVokr9erXr16nW4pAADAgv3zumr1gNla2nuuRiSU699dF2lp77n658OPKXR+35N6jzodIZk0aZIuu+wyZWVlqaysTLNnz9bSpUv1xhtvyOfzacyYMZo4caJSU1Pl9Xo1YcIE+f1+DRkyRJJ0ySWXqFevXrrpppv06KOPqrCwUL/61a+Uk5PDERAAAJqo9skH5HLUPMaR5U5SKPbkjn3UKZAUFxfr5ptv1q5du+Tz+dS3b1+98cYb+u53vytJevzxx+V0OjVy5EhVVFRo+PDhmjZtWvj1LpdL8+bN07hx4+T3+5WYmKjRo0fr4YcfrksZAACgkSj90RDdnTkzYn/VnfulpSd+n9O+D4kN3IcEAAB7nAkJcsTH6ZC/qwqukK4duFp/aPd+rWPPeeAWrZv5yxPeh6TOi1oBAEDL5e7QXgeejdXSPi/LqbckqdbTNcf4tlWe3PvWS3UAAKBFKLqkg1b3nS7JdcKx12wZrrjP953U+xJIAADAyTvOGtXLN1+uOFeVPn+pqxILg0r6aK8C2zad1NsSSAAAwElxZ6Rr/D3/itj/m06vKufhO9Rm1grJGAXr8N6nfR8SAADQMgQKi/TkYyMj9t+YN0apM3OlU7hehkACAACsI5AAAICT1nbOWnWe/1O9Uy6tqajQF4GDeqdcumfXeep6Z+Qvyj0R1pAAAICTFjp0SGf9dLV+p3PkGNhHRQOTlTZtuaSQpOITvTwiAgkAADglZtU6pa2qn/filA0AoHlzuuSIibVdBU6AIyQAgGbJce7ZOnJGoooGuRQ4s1xn/C1GsWVVci77wHZpqAWBBADQ7Jih52jItFV6qO2GrxovkpYeceqXk25T0j9W2CsOteKUDQCg2SkakFA9jHzpwviQdg4PWKgIJ0IgAQA0Kw6PR0fSI9+YKyHliFytWkWxIpwMAgkAoFlxtWmtoRevj9g/pnuuqvp2il5BOCkEEgBAsxLYsVPv/61PxP4/513MwtZGiEACAGh23OVGe4KHarQfDlXKcchloSKcCFfZAACanTZP5+rbafcq/ds71KfVTnVPKNQ/d5ynzz5vq7PuyLNdHmpBIAEANEsd/me5JGnr2d21/ox+in1ztc7S55arQiQEEgBAsxbcsFkxNa8ARiPDGhIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYRyABAADWEUgAAIB1BBIAAGAdgQQAAFhHIAEAANYRSAAAgHUEEgAAYB2BBAAAWEcgAQAA1hFIAACAdQQSAABgHYEEAABYd1qB5JFHHpHD4dBdd90VbisvL1dOTo5at26tpKQkjRw5UkVFRdVeV1BQoBEjRighIUFpaWm69957FQgETqcUAADQhJ1yIFm1apWefvpp9e3bt1r73Xffrddff10vv/yyli1bpp07d+raa68N9weDQY0YMUKVlZVavny5XnjhBc2aNUsPPvjgqe8FAABo0k4pkBw8eFCjRo3Ss88+q1atWoXbS0pK9Pzzz+uPf/yjLr74YvXv318zZ87U8uXLtWLFCknSm2++qY0bN+rFF1/UOeeco8suu0z/8z//o6eeekqVlZX1s1cAAKBJOaVAkpOToxEjRig7O7tae35+vqqqqqq19+jRQ1lZWcrNzZUk5ebmqk+fPkpPTw+PGT58uEpLS7Vhw4Zat1dRUaHS0tJqDwAA0Hy46/qCOXPm6P3339eqVatq9BUWFio2NlYpKSnV2tPT01VYWBge8/Uwcqz/WF9tpkyZooceeqiupQIAgCaiTkdItm/frjvvvFMvvfSS4uLiGqqmGiZNmqSSkpLwY/v27VHbNgAAaHh1CiT5+fkqLi7WeeedJ7fbLbfbrWXLlmnq1Klyu91KT09XZWWlDhw4UO11RUVFysjIkCRlZGTUuOrm2PNjY77J4/HI6/VWewAAgOajToFk2LBhWrdundasWRN+DBgwQKNGjQr/HBMTo8WLF4dfs3nzZhUUFMjv90uS/H6/1q1bp+Li4vCYRYsWyev1qlevXvW0WwAAoCmp0xqS5ORk9e7du1pbYmKiWrduHW4fM2aMJk6cqNTUVHm9Xk2YMEF+v19DhgyRJF1yySXq1auXbrrpJj366KMqLCzUr371K+Xk5Mjj8dTTbgEAgKakzotaT+Txxx+X0+nUyJEjVVFRoeHDh2vatGnhfpfLpXnz5mncuHHy+/1KTEzU6NGj9fDDD9d3KQAAoIlwGGOM7SLqqrS0VD6fTxfqarkdMbbLAQAAEQRMlZbqVZWUlBx3DSjfZQMAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACsI5AAAADrCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArHPbLuBUGGMkSQFVScZyMQAAIKKAqiR99dkdSZMMJHv37pUkvav5lisBAAAno6ysTD6fL2J/kwwkqampkqSCgoLj7hy+Ulpaqg4dOmj79u3yer22y2kSmLO6Y87qjjmrO+as7mzOmTFGZWVlyszMPO64JhlInM6jS198Ph+/jHXk9XqZszpizuqOOas75qzumLO6szVnJ3PwgEWtAADAOgIJAACwrkkGEo/Ho8mTJ8vj8dgupclgzuqOOas75qzumLO6Y87qrinMmcOc6DocAACABtYkj5AAAIDmhUACAACsI5AAAADrCCQAAMC6JhlInnrqKXXq1ElxcXEaPHiwVq5cabska9555x1deeWVyszMlMPh0Ny5c6v1G2P04IMPql27doqPj1d2dra2bNlSbcy+ffs0atQoeb1epaSkaMyYMTp48GAU9yJ6pkyZooEDByo5OVlpaWm65pprtHnz5mpjysvLlZOTo9atWyspKUkjR45UUVFRtTEFBQUaMWKEEhISlJaWpnvvvVeBQCCauxI106dPV9++fcM3VPL7/VqwYEG4n/k6sUceeUQOh0N33XVXuI15q+43v/mNHA5HtUePHj3C/cxX7Xbs2KEbb7xRrVu3Vnx8vPr06aPVq1eH+5vUZ4BpYubMmWNiY2PNX/7yF7NhwwZz6623mpSUFFNUVGS7NCvmz59vfvnLX5p///vfRpJ55ZVXqvU/8sgjxufzmblz55oPP/zQXHXVVaZz587myJEj4TGXXnqp6devn1mxYoX573//a7p27Wp++MMfRnlPomP48OFm5syZZv369WbNmjXm8ssvN1lZWebgwYPhMWPHjjUdOnQwixcvNqtXrzZDhgwx559/frg/EAiY3r17m+zsbPPBBx+Y+fPnmzZt2phJkybZ2KUG99prr5n//Oc/5uOPPzabN282DzzwgImJiTHr1683xjBfJ7Jy5UrTqVMn07dvX3PnnXeG25m36iZPnmzOPvtss2vXrvBj9+7d4X7mq6Z9+/aZjh07mh//+McmLy/PfPrpp+aNN94wW7duDY9pSp8BTS6QDBo0yOTk5ISfB4NBk5mZaaZMmWKxqsbhm4EkFAqZjIwM89hjj4XbDhw4YDwej/nb3/5mjDFm48aNRpJZtWpVeMyCBQuMw+EwO3bsiFrtthQXFxtJZtmyZcaYo/MTExNjXn755fCYjz76yEgyubm5xpijIdDpdJrCwsLwmOnTpxuv12sqKiqiuwOWtGrVyjz33HPM1wmUlZWZbt26mUWLFpnvfOc74UDCvNU0efJk069fv1r7mK/a3XfffeaCCy6I2N/UPgOa1CmbyspK5efnKzs7O9zmdDqVnZ2t3Nxci5U1Ttu2bVNhYWG1+fL5fBo8eHB4vnJzc5WSkqIBAwaEx2RnZ8vpdCovLy/qNUdbSUmJpK++sDE/P19VVVXV5qxHjx7KysqqNmd9+vRRenp6eMzw4cNVWlqqDRs2RLH66AsGg5ozZ44OHTokv9/PfJ1ATk6ORowYUW1+JH7PItmyZYsyMzPVpUsXjRo1SgUFBZKYr0hee+01DRgwQN///veVlpamc889V88++2y4v6l9BjSpQLJnzx4Fg8Fqv3CSlJ6ersLCQktVNV7H5uR481VYWKi0tLRq/W63W6mpqc1+TkOhkO666y4NHTpUvXv3lnR0PmJjY5WSklJt7DfnrLY5PdbXHK1bt05JSUnyeDwaO3asXnnlFfXq1Yv5Oo45c+bo/fff15QpU2r0MW81DR48WLNmzdLChQs1ffp0bdu2Td/61rdUVlbGfEXw6aefavr06erWrZveeOMNjRs3TnfccYdeeOEFSU3vM6BJftsvUB9ycnK0fv16vfvuu7ZLafS6d++uNWvWqKSkRP/85z81evRoLVu2zHZZjdb27dt15513atGiRYqLi7NdTpNw2WWXhX/u27evBg8erI4dO+of//iH4uPjLVbWeIVCIQ0YMEC///3vJUnnnnuu1q9frxkzZmj06NGWq6u7JnWEpE2bNnK5XDVWVhcVFSkjI8NSVY3XsTk53nxlZGSouLi4Wn8gENC+ffua9ZyOHz9e8+bN09tvv6327duH2zMyMlRZWakDBw5UG//NOattTo/1NUexsbHq2rWr+vfvrylTpqhfv3564oknmK8I8vPzVVxcrPPOO09ut1tut1vLli3T1KlT5Xa7lZ6ezrydQEpKis466yxt3bqV37MI2rVrp169elVr69mzZ/hUV1P7DGhSgSQ2Nlb9+/fX4sWLw22hUEiLFy+W3++3WFnj1LlzZ2VkZFSbr9LSUuXl5YXny+/368CBA8rPzw+PWbJkiUKhkAYPHhz1mhuaMUbjx4/XK6+8oiVLlqhz587V+vv376+YmJhqc7Z582YVFBRUm7N169ZV+5940aJF8nq9Nf5yaK5CoZAqKiqYrwiGDRumdevWac2aNeHHgAEDNGrUqPDPzNvxHTx4UJ988onatWvH71kEQ4cOrXHbgo8//lgdO3aU1AQ/A6K6hLYezJkzx3g8HjNr1iyzceNGc9ttt5mUlJRqK6tbkrKyMvPBBx+YDz74wEgyf/zjH80HH3xgPv/8c2PM0Uu+UlJSzKuvvmrWrl1rrr766lov+Tr33HNNXl6eeffdd023bt2a7WW/48aNMz6fzyxdurTa5YWHDx8Ojxk7dqzJysoyS5YsMatXrzZ+v9/4/f5w/7HLCy+55BKzZs0as3DhQtO2bdtme3nh/fffb5YtW2a2bdtm1q5da+6//37jcDjMm2++aYxhvk7W16+yMYZ5+6Z77rnHLF261Gzbts289957Jjs727Rp08YUFxcbY5iv2qxcudK43W7zu9/9zmzZssW89NJLJiEhwbz44ovhMU3pM6DJBRJjjPnzn/9ssrKyTGxsrBk0aJBZsWKF7ZKsefvtt42kGo/Ro0cbY45e9vXrX//apKenG4/HY4YNG2Y2b95c7T327t1rfvjDH5qkpCTj9XrNLbfcYsrKyizsTcOrba4kmZkzZ4bHHDlyxNx+++2mVatWJiEhwXzve98zu3btqvY+n332mbnssstMfHy8adOmjbnnnntMVVVVlPcmOn7yk5+Yjh07mtjYWNO2bVszbNiwcBgxhvk6Wd8MJMxbdddff71p166diY2NNWeccYa5/vrrq91Pg/mq3euvv2569+5tPB6P6dGjh3nmmWeq9TelzwCHMcZE95gMAABAdU1qDQkAAGieCCQAAMA6AgkAALCOQAIAAKwjkAAAAOsIJAAAwDoCCQAAsI5AAgAArCOQAAAA6wgkAADAOgIJAACwjkACAACs+/9siY0Vgt3HOgAAAABJRU5ErkJggg==",
      "text/plain": [
       "<Figure size 640x480 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "print(videoreader[:].asnumpy().shape)\n",
    "print(optical_output.shape)\n",
    "plt.imshow(optical_output[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "gZaUiZpT6cos"
   },
   "source": [
    "### Training and validation\n",
    "\n",
    "Based in [Fine tuning ViT](https://huggingface.co/blog/fine-tune-vit)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "executionInfo": {
     "elapsed": 917,
     "status": "ok",
     "timestamp": 1667575068999,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "3EyE_Een6fK5"
   },
   "outputs": [],
   "source": [
    "import torch\n",
    "\n",
    "# def collate_fn(batch):\n",
    "    \n",
    "#     return {\n",
    "#         'pixel_values': torch.stack([x['pixel_values'] for x in batch]),\n",
    "#         'labels': torch.tensor([x['labels'] for x in batch])\n",
    "#     }"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "# def collate_multi_with_path_batches(batch):\n",
    "#     pixel_values = []\n",
    "#     labels = []\n",
    "#     for elem in batch:\n",
    "#         file_path = elem['file_name']\n",
    "#         videoreader = VideoReader(file_path, num_threads=1, ctx=cpu(0))\n",
    "#         videoreader.seek(0)\n",
    "#         file_size = len(videoreader)\n",
    "#         batches = int(file_size/16)\n",
    "#         for i in range(batches):\n",
    "#             indices = np.linspace(i, len(videoreader)-batches+i, num=16)\n",
    "#             indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "#             pixel_values.append(feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0])\n",
    "#             labels.append(elem['labels'])\n",
    "#     return {\n",
    "#         'pixel_values': torch.stack(pixel_values),\n",
    "#         'labels': torch.tensor(labels)\n",
    "#     }\n",
    "    \n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "def collate_with_path_batches(batch):\n",
    "    pixel_values = []\n",
    "    labels = []\n",
    "    for elem in batch:\n",
    "        file_path, i = elem['file_name'].split('@')\n",
    "        i = int(i)\n",
    "        videoreader = VideoReader(file_path, num_threads=1, ctx=cpu(0))\n",
    "        videoreader.seek(0)\n",
    "        file_size = len(videoreader)\n",
    "        batches = int(file_size/16)\n",
    "        indices = np.linspace(i, len(videoreader)-batches+i, num=16)\n",
    "        indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "        pixel_values.append(feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0])\n",
    "        labels.append(elem['labels'])\n",
    "    return {\n",
    "        'pixel_values': torch.stack(pixel_values),\n",
    "        'labels': torch.tensor(labels)\n",
    "    }"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "executionInfo": {
     "elapsed": 2026,
     "status": "ok",
     "timestamp": 1667575074037,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "3G56RcBI6uOk"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/tmp/ipykernel_3808937/2425197347.py:4: FutureWarning: load_metric is deprecated and will be removed in the next major version of datasets. Use 'evaluate.load' instead, from the new library 🤗 Evaluate: https://huggingface.co/docs/evaluate\n",
      "  metric = load_metric(\"accuracy\")\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "from datasets import load_metric\n",
    "\n",
    "metric = load_metric(\"accuracy\")\n",
    "def compute_metrics(p):\n",
    "    return metric.compute(predictions=np.argmax(p.predictions, axis=1), references=p.label_ids)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 4861,
     "status": "ok",
     "timestamp": 1667575087394,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "vsUZpL-66zPa",
    "outputId": "4b41f94c-11ee-4e14-c643-75bee01b3f8c"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Some weights of VideoMAEForVideoClassification were not initialized from the model checkpoint at MCG-NJU/videomae-base-finetuned-kinetics and are newly initialized because the shapes did not match:\n",
      "- classifier.weight: found shape torch.Size([400, 768]) in the checkpoint and torch.Size([20, 768]) in the model instantiated\n",
      "- classifier.bias: found shape torch.Size([400]) in the checkpoint and torch.Size([20]) in the model instantiated\n",
      "You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.\n"
     ]
    }
   ],
   "source": [
    "labels = names\n",
    "\n",
    "model = VideoMAEForVideoClassification.from_pretrained(\n",
    "    name_model,\n",
    "    num_labels=len(labels),\n",
    "    id2label={str(i): c for i, c in enumerate(labels)},\n",
    "    label2id={c: str(i) for i, c in enumerate(labels)},\n",
    "    ignore_mismatched_sizes=True,\n",
    "#     patch_size = 32,\n",
    "#     num_frames = 64\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "classifier.weight\n",
      "classifier.bias\n"
     ]
    }
   ],
   "source": [
    "for name, param in model.named_parameters():\n",
    "    if param.requires_grad:\n",
    "        if 'videomae' in name or 'fc_norm' in name:\n",
    "            param.requires_grad = False\n",
    "            \n",
    "for name, param in model.named_parameters():\n",
    "    if param.requires_grad:\n",
    "        print(name)\n",
    "\n",
    "# for name, param in model.named_parameters():\n",
    "#     if param.requires_grad:\n",
    "#         if 'videomae' in name:\n",
    "#             param.requires_grad = False\n",
    "            \n",
    "# for name, param in model.named_parameters():\n",
    "#     if param.requires_grad:\n",
    "#         print(name)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 490,
     "status": "ok",
     "timestamp": 1667575094273,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "BmvmWI4a57xr",
    "outputId": "bafabebc-6568-4f83-acfd-14f46f7d57f0"
   },
   "outputs": [],
   "source": [
    "from transformers import TrainingArguments\n",
    "\n",
    "training_args = TrainingArguments(\n",
    "  output_dir=\"./videomae-icsr-heart\",\n",
    "  per_device_train_batch_size=16,\n",
    "  per_device_eval_batch_size=16,\n",
    "  evaluation_strategy=\"steps\",\n",
    "  num_train_epochs=12,\n",
    "  fp16=True,\n",
    "  save_steps=50,\n",
    "  eval_steps=50,\n",
    "  logging_steps=50,\n",
    "#   weight_decay =0.05,\n",
    "#   learning_rate=1e-5,\n",
    "  save_total_limit=5,\n",
    "  remove_unused_columns=False,\n",
    "  push_to_hub=False,\n",
    "  #report_to='tensorboard',\n",
    "  load_best_model_at_end=True,\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [],
   "source": [
    "# from transformers import TrainingArguments\n",
    "\n",
    "# training_args = TrainingArguments(\n",
    "#   output_dir=\"./videomae-icsr-heart\",\n",
    "#   per_device_train_batch_size=2,\n",
    "#   num_train_epochs=16,\n",
    "#   save_steps=198,\n",
    "#   logging_steps=198,\n",
    "#   save_total_limit=5,\n",
    "#   remove_unused_columns=False,\n",
    "# )"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 378,
     "status": "ok",
     "timestamp": 1667575104288,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "WYSSr6k157xr",
    "outputId": "43f59bb8-5f1c-4d81-8f75-1ce809c54371"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Using cuda_amp half precision backend\n"
     ]
    }
   ],
   "source": [
    "from transformers import Trainer\n",
    "\n",
    "trainer = Trainer(\n",
    "    model=model,\n",
    "    args=training_args,\n",
    "    data_collator=collate_with_path_batches,\n",
    "    compute_metrics=compute_metrics,\n",
    "    train_dataset=dataset,\n",
    "    eval_dataset=dataset_validation,\n",
    "    tokenizer=feature_extractor,\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "id": "vfyxQlfx57xs"
   },
   "outputs": [],
   "source": [
    "torch.cuda.empty_cache()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 1000
    },
    "executionInfo": {
     "elapsed": 4359410,
     "status": "ok",
     "timestamp": 1667579468076,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "jxWG5dOA57xs",
    "outputId": "7cf52156-2971-4d4f-f8fc-dd4326645ea7"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/tomas/.local/lib/python3.8/site-packages/transformers/optimization.py:306: FutureWarning: This implementation of AdamW is deprecated and will be removed in a future version. Use the PyTorch implementation torch.optim.AdamW instead, or set `no_deprecation_warning=True` to disable this warning\n",
      "  warnings.warn(\n",
      "***** Running training *****\n",
      "  Num examples = 7148\n",
      "  Num Epochs = 12\n",
      "  Instantaneous batch size per device = 16\n",
      "  Total train batch size (w. parallel, distributed & accumulation) = 16\n",
      "  Gradient Accumulation steps = 1\n",
      "  Total optimization steps = 5364\n",
      "  Number of trainable parameters = 15380\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "\n",
       "    <div>\n",
       "      \n",
       "      <progress value='5364' max='5364' style='width:300px; height:20px; vertical-align: middle;'></progress>\n",
       "      [5364/5364 6:20:29, Epoch 12/12]\n",
       "    </div>\n",
       "    <table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       " <tr style=\"text-align: left;\">\n",
       "      <th>Step</th>\n",
       "      <th>Training Loss</th>\n",
       "      <th>Validation Loss</th>\n",
       "      <th>Accuracy</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <td>50</td>\n",
       "      <td>2.837000</td>\n",
       "      <td>2.876852</td>\n",
       "      <td>0.113115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>100</td>\n",
       "      <td>2.663000</td>\n",
       "      <td>2.762153</td>\n",
       "      <td>0.163115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>150</td>\n",
       "      <td>2.508600</td>\n",
       "      <td>2.663036</td>\n",
       "      <td>0.204918</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>200</td>\n",
       "      <td>2.337300</td>\n",
       "      <td>2.568589</td>\n",
       "      <td>0.259836</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>250</td>\n",
       "      <td>2.224900</td>\n",
       "      <td>2.485153</td>\n",
       "      <td>0.336066</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>300</td>\n",
       "      <td>2.107300</td>\n",
       "      <td>2.410009</td>\n",
       "      <td>0.395902</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>350</td>\n",
       "      <td>1.993100</td>\n",
       "      <td>2.335044</td>\n",
       "      <td>0.444262</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>400</td>\n",
       "      <td>1.881200</td>\n",
       "      <td>2.268728</td>\n",
       "      <td>0.483607</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>450</td>\n",
       "      <td>1.787800</td>\n",
       "      <td>2.205790</td>\n",
       "      <td>0.501639</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>500</td>\n",
       "      <td>1.692900</td>\n",
       "      <td>2.146368</td>\n",
       "      <td>0.512295</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>550</td>\n",
       "      <td>1.667100</td>\n",
       "      <td>2.093621</td>\n",
       "      <td>0.528689</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>600</td>\n",
       "      <td>1.566000</td>\n",
       "      <td>2.042138</td>\n",
       "      <td>0.536885</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>650</td>\n",
       "      <td>1.502200</td>\n",
       "      <td>1.992899</td>\n",
       "      <td>0.545902</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>700</td>\n",
       "      <td>1.446600</td>\n",
       "      <td>1.948780</td>\n",
       "      <td>0.559836</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>750</td>\n",
       "      <td>1.370000</td>\n",
       "      <td>1.903027</td>\n",
       "      <td>0.575410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>800</td>\n",
       "      <td>1.313700</td>\n",
       "      <td>1.861789</td>\n",
       "      <td>0.585246</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>850</td>\n",
       "      <td>1.283100</td>\n",
       "      <td>1.826265</td>\n",
       "      <td>0.588525</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>900</td>\n",
       "      <td>1.250100</td>\n",
       "      <td>1.794728</td>\n",
       "      <td>0.592623</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>950</td>\n",
       "      <td>1.198700</td>\n",
       "      <td>1.762528</td>\n",
       "      <td>0.594262</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1000</td>\n",
       "      <td>1.145500</td>\n",
       "      <td>1.728721</td>\n",
       "      <td>0.604098</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1050</td>\n",
       "      <td>1.116600</td>\n",
       "      <td>1.703942</td>\n",
       "      <td>0.608197</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1100</td>\n",
       "      <td>1.071800</td>\n",
       "      <td>1.675672</td>\n",
       "      <td>0.611475</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1150</td>\n",
       "      <td>1.044300</td>\n",
       "      <td>1.647432</td>\n",
       "      <td>0.616393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1200</td>\n",
       "      <td>1.015400</td>\n",
       "      <td>1.620778</td>\n",
       "      <td>0.619672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1250</td>\n",
       "      <td>1.025200</td>\n",
       "      <td>1.598175</td>\n",
       "      <td>0.623770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1300</td>\n",
       "      <td>0.974100</td>\n",
       "      <td>1.579370</td>\n",
       "      <td>0.622131</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1350</td>\n",
       "      <td>0.915700</td>\n",
       "      <td>1.559178</td>\n",
       "      <td>0.617213</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1400</td>\n",
       "      <td>0.905900</td>\n",
       "      <td>1.541087</td>\n",
       "      <td>0.622131</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1450</td>\n",
       "      <td>0.874300</td>\n",
       "      <td>1.523209</td>\n",
       "      <td>0.625410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1500</td>\n",
       "      <td>0.881000</td>\n",
       "      <td>1.504008</td>\n",
       "      <td>0.626230</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1550</td>\n",
       "      <td>0.844600</td>\n",
       "      <td>1.485146</td>\n",
       "      <td>0.630328</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1600</td>\n",
       "      <td>0.857500</td>\n",
       "      <td>1.471036</td>\n",
       "      <td>0.640164</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1650</td>\n",
       "      <td>0.844800</td>\n",
       "      <td>1.455855</td>\n",
       "      <td>0.634426</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1700</td>\n",
       "      <td>0.805200</td>\n",
       "      <td>1.442334</td>\n",
       "      <td>0.631967</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1750</td>\n",
       "      <td>0.770300</td>\n",
       "      <td>1.429134</td>\n",
       "      <td>0.625410</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1800</td>\n",
       "      <td>0.800500</td>\n",
       "      <td>1.415704</td>\n",
       "      <td>0.638525</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1850</td>\n",
       "      <td>0.782800</td>\n",
       "      <td>1.400973</td>\n",
       "      <td>0.648361</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1900</td>\n",
       "      <td>0.733400</td>\n",
       "      <td>1.390197</td>\n",
       "      <td>0.645902</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>1950</td>\n",
       "      <td>0.714400</td>\n",
       "      <td>1.376707</td>\n",
       "      <td>0.651639</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2000</td>\n",
       "      <td>0.711600</td>\n",
       "      <td>1.367251</td>\n",
       "      <td>0.653279</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2050</td>\n",
       "      <td>0.718500</td>\n",
       "      <td>1.357147</td>\n",
       "      <td>0.654098</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2100</td>\n",
       "      <td>0.723200</td>\n",
       "      <td>1.350250</td>\n",
       "      <td>0.654918</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2150</td>\n",
       "      <td>0.697600</td>\n",
       "      <td>1.341044</td>\n",
       "      <td>0.654098</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2200</td>\n",
       "      <td>0.668700</td>\n",
       "      <td>1.333772</td>\n",
       "      <td>0.654098</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2250</td>\n",
       "      <td>0.652500</td>\n",
       "      <td>1.325303</td>\n",
       "      <td>0.654918</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2300</td>\n",
       "      <td>0.658700</td>\n",
       "      <td>1.317310</td>\n",
       "      <td>0.657377</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2350</td>\n",
       "      <td>0.646900</td>\n",
       "      <td>1.309569</td>\n",
       "      <td>0.658197</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2400</td>\n",
       "      <td>0.650900</td>\n",
       "      <td>1.301190</td>\n",
       "      <td>0.659016</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2450</td>\n",
       "      <td>0.618800</td>\n",
       "      <td>1.293555</td>\n",
       "      <td>0.660656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2500</td>\n",
       "      <td>0.633900</td>\n",
       "      <td>1.287310</td>\n",
       "      <td>0.660656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2550</td>\n",
       "      <td>0.661200</td>\n",
       "      <td>1.281279</td>\n",
       "      <td>0.662295</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2600</td>\n",
       "      <td>0.599000</td>\n",
       "      <td>1.276651</td>\n",
       "      <td>0.660656</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2650</td>\n",
       "      <td>0.576500</td>\n",
       "      <td>1.271700</td>\n",
       "      <td>0.663934</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2700</td>\n",
       "      <td>0.609400</td>\n",
       "      <td>1.264701</td>\n",
       "      <td>0.663934</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2750</td>\n",
       "      <td>0.584000</td>\n",
       "      <td>1.258952</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2800</td>\n",
       "      <td>0.617400</td>\n",
       "      <td>1.251137</td>\n",
       "      <td>0.663934</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2850</td>\n",
       "      <td>0.540000</td>\n",
       "      <td>1.246015</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2900</td>\n",
       "      <td>0.557700</td>\n",
       "      <td>1.242003</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>2950</td>\n",
       "      <td>0.566500</td>\n",
       "      <td>1.237994</td>\n",
       "      <td>0.663115</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3000</td>\n",
       "      <td>0.570100</td>\n",
       "      <td>1.233375</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3050</td>\n",
       "      <td>0.550400</td>\n",
       "      <td>1.229795</td>\n",
       "      <td>0.667213</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3100</td>\n",
       "      <td>0.596100</td>\n",
       "      <td>1.224787</td>\n",
       "      <td>0.666393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3150</td>\n",
       "      <td>0.562200</td>\n",
       "      <td>1.221752</td>\n",
       "      <td>0.667213</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3200</td>\n",
       "      <td>0.560600</td>\n",
       "      <td>1.216995</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3250</td>\n",
       "      <td>0.554600</td>\n",
       "      <td>1.212687</td>\n",
       "      <td>0.665574</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3300</td>\n",
       "      <td>0.555800</td>\n",
       "      <td>1.209369</td>\n",
       "      <td>0.666393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3350</td>\n",
       "      <td>0.546600</td>\n",
       "      <td>1.204417</td>\n",
       "      <td>0.668033</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3400</td>\n",
       "      <td>0.523800</td>\n",
       "      <td>1.202437</td>\n",
       "      <td>0.666393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3450</td>\n",
       "      <td>0.519800</td>\n",
       "      <td>1.199298</td>\n",
       "      <td>0.666393</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3500</td>\n",
       "      <td>0.508400</td>\n",
       "      <td>1.196413</td>\n",
       "      <td>0.667213</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3550</td>\n",
       "      <td>0.498200</td>\n",
       "      <td>1.193430</td>\n",
       "      <td>0.668033</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3600</td>\n",
       "      <td>0.523100</td>\n",
       "      <td>1.190551</td>\n",
       "      <td>0.669672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3650</td>\n",
       "      <td>0.510500</td>\n",
       "      <td>1.188173</td>\n",
       "      <td>0.671311</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3700</td>\n",
       "      <td>0.529900</td>\n",
       "      <td>1.185849</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3750</td>\n",
       "      <td>0.502900</td>\n",
       "      <td>1.183169</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3800</td>\n",
       "      <td>0.550000</td>\n",
       "      <td>1.180239</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3850</td>\n",
       "      <td>0.474500</td>\n",
       "      <td>1.178194</td>\n",
       "      <td>0.669672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3900</td>\n",
       "      <td>0.473800</td>\n",
       "      <td>1.175332</td>\n",
       "      <td>0.669672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>3950</td>\n",
       "      <td>0.486900</td>\n",
       "      <td>1.173587</td>\n",
       "      <td>0.669672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4000</td>\n",
       "      <td>0.502900</td>\n",
       "      <td>1.171529</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4050</td>\n",
       "      <td>0.492100</td>\n",
       "      <td>1.169754</td>\n",
       "      <td>0.669672</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4100</td>\n",
       "      <td>0.484000</td>\n",
       "      <td>1.167885</td>\n",
       "      <td>0.671311</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4150</td>\n",
       "      <td>0.502100</td>\n",
       "      <td>1.165997</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4200</td>\n",
       "      <td>0.464600</td>\n",
       "      <td>1.164243</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4250</td>\n",
       "      <td>0.469400</td>\n",
       "      <td>1.162437</td>\n",
       "      <td>0.670492</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4300</td>\n",
       "      <td>0.502500</td>\n",
       "      <td>1.160746</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4350</td>\n",
       "      <td>0.479900</td>\n",
       "      <td>1.159214</td>\n",
       "      <td>0.672951</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4400</td>\n",
       "      <td>0.443100</td>\n",
       "      <td>1.157657</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4450</td>\n",
       "      <td>0.485600</td>\n",
       "      <td>1.156358</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4500</td>\n",
       "      <td>0.523600</td>\n",
       "      <td>1.155100</td>\n",
       "      <td>0.672951</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4550</td>\n",
       "      <td>0.475300</td>\n",
       "      <td>1.153576</td>\n",
       "      <td>0.672951</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4600</td>\n",
       "      <td>0.465500</td>\n",
       "      <td>1.152331</td>\n",
       "      <td>0.672951</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4650</td>\n",
       "      <td>0.490900</td>\n",
       "      <td>1.151252</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4700</td>\n",
       "      <td>0.424200</td>\n",
       "      <td>1.150538</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4750</td>\n",
       "      <td>0.486100</td>\n",
       "      <td>1.150018</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4800</td>\n",
       "      <td>0.454000</td>\n",
       "      <td>1.148722</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4850</td>\n",
       "      <td>0.477300</td>\n",
       "      <td>1.147864</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4900</td>\n",
       "      <td>0.479700</td>\n",
       "      <td>1.147385</td>\n",
       "      <td>0.673770</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>4950</td>\n",
       "      <td>0.432800</td>\n",
       "      <td>1.147041</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5000</td>\n",
       "      <td>0.445600</td>\n",
       "      <td>1.146268</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5050</td>\n",
       "      <td>0.484600</td>\n",
       "      <td>1.145925</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5100</td>\n",
       "      <td>0.477700</td>\n",
       "      <td>1.145361</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5150</td>\n",
       "      <td>0.439200</td>\n",
       "      <td>1.145313</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5200</td>\n",
       "      <td>0.464700</td>\n",
       "      <td>1.144999</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5250</td>\n",
       "      <td>0.467800</td>\n",
       "      <td>1.144772</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5300</td>\n",
       "      <td>0.456900</td>\n",
       "      <td>1.144714</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <td>5350</td>\n",
       "      <td>0.498500</td>\n",
       "      <td>1.144672</td>\n",
       "      <td>0.674590</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table><p>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-50\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-50/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-50/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-50/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-50] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-400\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-400/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-400/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-400/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-150] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-450\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-450/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-450/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-450/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-500\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-500/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-500/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-500/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-550\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-550/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-550/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-550/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-600\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-600/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-600/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-600/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-650\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-650/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-650/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-650/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-400] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-700\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-700/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-700/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-700/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-450] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-750\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-750/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-750/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-750/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-500] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-800\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-800/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-800/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-800/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-550] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-850\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-850/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-850/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-850/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-600] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-900\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-900/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-900/pytorch_model.bin\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-900/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-650] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-950\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-950/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-950/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-950/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-700] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1000\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1000/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1000/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1000/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-750] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1050\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1050/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1050/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1050/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-800] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-850] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-900] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-950] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1000] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1050] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1400\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1400/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1400/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1400/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1150] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1450\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1450/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1450/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1450/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1500\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1500/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1500/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1500/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1550\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1550/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1550/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1550/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1600\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1600/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1600/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1600/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1650\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1650/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1650/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1650/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1400] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1700\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1700/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1700/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1700/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1450] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1750\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1750/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1750/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1750/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1500] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1800\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1800/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1800/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1800/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1550] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1850\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1850/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1850/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1850/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1600] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1900\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1900/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1900/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1900/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1650] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-1950\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-1950/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-1950/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-1950/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1700] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2000\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2000/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2000/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2000/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1750] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2050\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2050/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2050/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2050/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1800] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1850] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1900] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-1950] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2000] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2050] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2400\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2400/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2400/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2400/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2150] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2450\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2450/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2450/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2450/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2500\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2500/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2500/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2500/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2550\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2550/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2550/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2550/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2600\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2600/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2600/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2600/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2650\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2650/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2650/pytorch_model.bin\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2650/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2400] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2700\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2700/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2700/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2700/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2450] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2750\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2750/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2750/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2750/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2500] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2800\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2800/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2800/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2800/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2550] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2850\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2850/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2850/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2850/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2600] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2900\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2900/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2900/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2900/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2650] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-2950\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-2950/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-2950/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-2950/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2700] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3000\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3000/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3000/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3000/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2750] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3050\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3050/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3050/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3050/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2800] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2850] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2900] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-2950] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3000] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3050] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3400\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3400/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3400/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3400/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3150] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3450\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3450/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3450/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3450/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3500\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3500/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3500/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3500/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3550\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3550/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3550/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3550/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3600\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3600/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3600/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3600/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3650\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3650/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3650/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3650/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3400] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3700\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3700/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3700/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3700/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3450] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3750\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3750/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3750/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3750/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3500] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3800\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3800/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3800/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3800/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3550] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3850\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3850/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3850/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3850/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3600] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3900\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3900/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3900/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3900/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3650] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-3950\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-3950/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-3950/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-3950/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3700] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4000\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4000/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4000/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4000/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3750] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4050\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4050/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4050/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4050/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3800] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3850] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3900] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-3950] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4000] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4050] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4100] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4400\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4400/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4400/pytorch_model.bin\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4400/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4150] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4450\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4450/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4450/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4450/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4200] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4500\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4500/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4500/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4500/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4250] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4550\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4550/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4550/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4550/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4300] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4600\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4600/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4600/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4600/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4350] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4650\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4650/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4650/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4650/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4400] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4700\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4700/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4700/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4700/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4450] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4750\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4750/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4750/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4750/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4500] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4800\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4800/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4800/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4800/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4550] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4850\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4850/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4850/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4850/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4600] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4900\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4900/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4900/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4900/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4650] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-4950\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-4950/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-4950/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-4950/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4700] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5000\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5000/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5000/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5000/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4750] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5050\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5050/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5050/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5050/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4800] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5100\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5100/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5100/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5100/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4850] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5150\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5150/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5150/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5150/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4900] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5200\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5200/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5200/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5200/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-4950] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5250\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5250/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5250/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5250/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5000] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5300\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5300/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5300/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5300/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5050] due to args.save_total_limit\n",
      "***** Running Evaluation *****\n",
      "  Num examples = 1220\n",
      "  Batch size = 16\n",
      "Saving model checkpoint to ./videomae-icsr-heart/checkpoint-5350\n",
      "Configuration saved in ./videomae-icsr-heart/checkpoint-5350/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/checkpoint-5350/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/checkpoint-5350/preprocessor_config.json\n",
      "Deleting older checkpoint [videomae-icsr-heart/checkpoint-5100] due to args.save_total_limit\n",
      "\n",
      "\n",
      "Training completed. Do not forget to share your model on huggingface.co/models =)\n",
      "\n",
      "\n",
      "Loading best model from ./videomae-icsr-heart/checkpoint-5350 (score: 1.1446717977523804).\n"
     ]
    }
   ],
   "source": [
    "train_results = trainer.train()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 1433,
     "status": "ok",
     "timestamp": 1667579469478,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "sz6jG1Oi57xs",
    "outputId": "c0c43c9f-1371-4bcf-a8fd-ef3e26c79c59"
   },
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "Saving model checkpoint to ./videomae-icsr-heart\n",
      "Configuration saved in ./videomae-icsr-heart/config.json\n",
      "Model weights saved in ./videomae-icsr-heart/pytorch_model.bin\n",
      "Feature extractor saved in ./videomae-icsr-heart/preprocessor_config.json\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "***** train metrics *****\n",
      "  epoch                    =           4.0\n",
      "  total_flos               = 33186001607GF\n",
      "  train_loss               =         1.424\n",
      "  train_runtime            =    1:07:49.50\n",
      "  train_samples_per_second =         7.026\n",
      "  train_steps_per_second   =          0.22\n"
     ]
    }
   ],
   "source": [
    "trainer.save_model()\n",
    "trainer.log_metrics(\"train\", train_results.metrics)\n",
    "trainer.save_metrics(\"train\", train_results.metrics)\n",
    "trainer.save_state()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 211
    },
    "executionInfo": {
     "elapsed": 38754,
     "status": "ok",
     "timestamp": 1667579508228,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "UWK9TSk457xs",
    "outputId": "40156d0d-7f99-4068-b73b-801f5c039f2c"
   },
   "outputs": [],
   "source": [
    "metrics = trainer.evaluate(dataset_validation)\n",
    "trainer.log_metrics(\"eval\", metrics)\n",
    "trainer.save_metrics(\"eval\", metrics)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 187,
     "status": "ok",
     "timestamp": 1667426738132,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "AZXFxB-LQQ-7",
    "outputId": "5d2fa64a-bde2-4d04-cf87-eede2f5ad788"
   },
   "outputs": [
    {
     "ename": "NameError",
     "evalue": "name 'metrics' is not defined",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
      "Cell \u001b[0;32mIn [30], line 1\u001b[0m\n\u001b[0;32m----> 1\u001b[0m \u001b[43mmetrics\u001b[49m\n",
      "\u001b[0;31mNameError\u001b[0m: name 'metrics' is not defined"
     ]
    }
   ],
   "source": [
    "metrics"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {
    "executionInfo": {
     "elapsed": 1134,
     "status": "ok",
     "timestamp": 1667579509321,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "j4yIILWEt-1p"
   },
   "outputs": [],
   "source": [
    "kwargs = {\n",
    "    \"finetuned_from\": model.config._name_or_path,\n",
    "    \"tasks\": \"video-classification\",\n",
    "    \"dataset\": 'HEART-MET',\n",
    "    \"tags\": ['video-classification'],\n",
    "}\n",
    "\n",
    "trainer.create_model_card(**kwargs)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "executionInfo": {
     "elapsed": 15981,
     "status": "ok",
     "timestamp": 1667579525293,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "Ev4EBAIBAdZa"
   },
   "outputs": [],
   "source": [
    "#!cp -R /content/videomae-icsr-heart/ /content/drive/MyDrive/ICSR 2022 HEART-MET Activity Recognition Challenge/models\n",
    "# !cp -R /content/videomae-icsr-heart/ /content/drive/MyDrive/models/"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "3QjKR9fwlq5h"
   },
   "source": [
    "## testing"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 139,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 66,
     "referenced_widgets": [
      "e79a955f009e447ea03841ebd51f5475",
      "b56c2b116f4e43a89dcb1597f69deea2",
      "28828f3642a24b7984ed84748aa83c1d",
      "4a4bd6bca11747dab469e933548c31c8",
      "73578108cdb24b4586b123f9271e2fdf",
      "95889cc921824cfd90c53b7454175378",
      "35929e7e4214489b8559a583fd28d171",
      "cb03eff0750d46bca00a21f58e81f841",
      "dc0071c2fe704b7e8042069d1b6db79d",
      "03b78f48e2ba4253b34d0946d5b40e15",
      "ba01c404bddf435eba574cd35aa411e0"
     ]
    },
    "executionInfo": {
     "elapsed": 370,
     "status": "ok",
     "timestamp": 1667581438622,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "CiRrYrDBluLB",
    "outputId": "5e727387-d201-42b3-f0c9-0b50c478dea1"
   },
   "outputs": [],
   "source": [
    "# prepared_validation.to_json('/content/validation_set.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 66,
     "referenced_widgets": [
      "b9ecdecdc0af4ed5a8b14fe484eff014",
      "fa915a0ccb534634b3b580fb3cb09c16",
      "9024ea625a284800811b19d7a0e26079",
      "7b96d51d2819479c9adf009d0d1b6710",
      "a07073612892430e94915351ad1c32e2",
      "7121d94ad31140a5a9d6b88edd690aa9",
      "2436895f138e4ae59b4ab936287554ed",
      "bfbbfff4a70e4d7183742f5e5118f6bb",
      "c74dd5761ca349ed9eba8b7073484ae7",
      "e6b09c270dac4dc19263fe6596985c0c",
      "cae454ab61954479a24dad6620b3d937"
     ]
    },
    "executionInfo": {
     "elapsed": 8,
     "status": "ok",
     "timestamp": 1667581461835,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "SgvuAkrKmZ26",
    "outputId": "5aa31c01-1542-4625-b04e-0f4002627370"
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "846dc55c83574149a6febc7c3bcea0e0",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Creating json from Arrow format:   0%|          | 0/1 [00:00<?, ?ba/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "text/plain": [
       "56355"
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "prepared_train.to_json('/content/training_set.csv')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "jRYvXjTEoBfj"
   },
   "outputs": [],
   "source": [
    "data['pixel_values']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 141,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 51665,
     "status": "ok",
     "timestamp": 1667582462627,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "yQGkGkfqmm4q",
    "outputId": "d5778354-97ff-44ac-8802-1ea55fa5dce4"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "6 6\n",
      "4 4\n",
      "12 12\n",
      "8 8\n",
      "9 9\n",
      "15 15\n",
      "6 6\n",
      "0 0\n",
      "8 8\n",
      "18 18\n",
      "15 15\n",
      "8 8\n",
      "15 15\n",
      "17 17\n",
      "17 17\n",
      "6 6\n",
      "4 4\n",
      "4 4\n",
      "1 1\n",
      "8 8\n",
      "14 14\n",
      "12 12\n",
      "7 7\n",
      "12 12\n",
      "4 4\n",
      "4 4\n",
      "15 15\n",
      "17 17\n",
      "11 11\n",
      "12 12\n",
      "14 14\n",
      "18 18\n",
      "6 6\n",
      "19 19\n",
      "6 6\n",
      "14 14\n",
      "5 5\n",
      "15 15\n",
      "6 6\n",
      "6 6\n",
      "6 6\n",
      "1 1\n",
      "4 4\n",
      "12 12\n",
      "18 18\n",
      "7 7\n",
      "13 13\n",
      "0 0\n",
      "3 3\n",
      "6 6\n",
      "9 9\n",
      "15 15\n",
      "14 14\n",
      "17 17\n",
      "9 9\n",
      "6 6\n",
      "17 17\n"
     ]
    },
    {
     "ename": "KeyboardInterrupt",
     "evalue": "",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mKeyboardInterrupt\u001b[0m                         Traceback (most recent call last)",
      "Cell \u001b[0;32mIn [141], line 12\u001b[0m\n\u001b[1;32m     10\u001b[0m indices \u001b[38;5;241m=\u001b[39m np\u001b[38;5;241m.\u001b[39mlinspace(\u001b[38;5;241m0\u001b[39m, \u001b[38;5;28mlen\u001b[39m(videoreader), num\u001b[38;5;241m=\u001b[39m\u001b[38;5;241m128\u001b[39m)\n\u001b[1;32m     11\u001b[0m indices \u001b[38;5;241m=\u001b[39m np\u001b[38;5;241m.\u001b[39mclip(indices, \u001b[38;5;241m0\u001b[39m, \u001b[38;5;28mlen\u001b[39m(videoreader)\u001b[38;5;241m-\u001b[39m \u001b[38;5;241m1\u001b[39m)\u001b[38;5;241m.\u001b[39mastype(np\u001b[38;5;241m.\u001b[39mint64)\n\u001b[0;32m---> 12\u001b[0m pixel_values \u001b[38;5;241m=\u001b[39m \u001b[43mfeature_extractor\u001b[49m\u001b[43m(\u001b[49m\u001b[38;5;28;43mlist\u001b[39;49m\u001b[43m(\u001b[49m\u001b[43mvideoreader\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mget_batch\u001b[49m\u001b[43m(\u001b[49m\u001b[43mindices\u001b[49m\u001b[43m)\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43masnumpy\u001b[49m\u001b[43m(\u001b[49m\u001b[43m)\u001b[49m\u001b[43m)\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mreturn_tensors\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43mpt\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m)\u001b[49m\n\u001b[1;32m     13\u001b[0m pixel_values \u001b[38;5;241m=\u001b[39m pixel_values\u001b[38;5;241m.\u001b[39mto(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mcuda\u001b[39m\u001b[38;5;124m'\u001b[39m)\n\u001b[1;32m     14\u001b[0m \u001b[38;5;28;01mwith\u001b[39;00m torch\u001b[38;5;241m.\u001b[39mno_grad():\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/models/videomae/feature_extraction_videomae.py:166\u001b[0m, in \u001b[0;36mVideoMAEFeatureExtractor.__call__\u001b[0;34m(self, videos, return_tensors, **kwargs)\u001b[0m\n\u001b[1;32m    164\u001b[0m     videos \u001b[38;5;241m=\u001b[39m [\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mcrop_video(video, size\u001b[38;5;241m=\u001b[39m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39msize) \u001b[38;5;28;01mfor\u001b[39;00m video \u001b[38;5;129;01min\u001b[39;00m videos]\n\u001b[1;32m    165\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mdo_normalize:\n\u001b[0;32m--> 166\u001b[0m     videos \u001b[38;5;241m=\u001b[39m [\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mnormalize_video(video, mean\u001b[38;5;241m=\u001b[39m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mimage_mean, std\u001b[38;5;241m=\u001b[39m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mimage_std) \u001b[38;5;28;01mfor\u001b[39;00m video \u001b[38;5;129;01min\u001b[39;00m videos]\n\u001b[1;32m    168\u001b[0m \u001b[38;5;66;03m# return as BatchFeature\u001b[39;00m\n\u001b[1;32m    169\u001b[0m data \u001b[38;5;241m=\u001b[39m {\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mpixel_values\u001b[39m\u001b[38;5;124m\"\u001b[39m: videos}\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/models/videomae/feature_extraction_videomae.py:166\u001b[0m, in \u001b[0;36m<listcomp>\u001b[0;34m(.0)\u001b[0m\n\u001b[1;32m    164\u001b[0m     videos \u001b[38;5;241m=\u001b[39m [\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mcrop_video(video, size\u001b[38;5;241m=\u001b[39m\u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39msize) \u001b[38;5;28;01mfor\u001b[39;00m video \u001b[38;5;129;01min\u001b[39;00m videos]\n\u001b[1;32m    165\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39mdo_normalize:\n\u001b[0;32m--> 166\u001b[0m     videos \u001b[38;5;241m=\u001b[39m [\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mnormalize_video\u001b[49m\u001b[43m(\u001b[49m\u001b[43mvideo\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mmean\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mimage_mean\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mstd\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mimage_std\u001b[49m\u001b[43m)\u001b[49m \u001b[38;5;28;01mfor\u001b[39;00m video \u001b[38;5;129;01min\u001b[39;00m videos]\n\u001b[1;32m    168\u001b[0m \u001b[38;5;66;03m# return as BatchFeature\u001b[39;00m\n\u001b[1;32m    169\u001b[0m data \u001b[38;5;241m=\u001b[39m {\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mpixel_values\u001b[39m\u001b[38;5;124m\"\u001b[39m: videos}\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/transformers/models/videomae/feature_extraction_videomae.py:101\u001b[0m, in \u001b[0;36mVideoMAEFeatureExtractor.normalize_video\u001b[0;34m(self, video, mean, std)\u001b[0m\n\u001b[1;32m     98\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;129;01mnot\u001b[39;00m \u001b[38;5;28misinstance\u001b[39m(std, np\u001b[38;5;241m.\u001b[39mndarray):\n\u001b[1;32m     99\u001b[0m     std \u001b[38;5;241m=\u001b[39m np\u001b[38;5;241m.\u001b[39marray(std)\u001b[38;5;241m.\u001b[39mastype(video\u001b[38;5;241m.\u001b[39mdtype)\n\u001b[0;32m--> 101\u001b[0m \u001b[38;5;28;01mreturn\u001b[39;00m \u001b[43m(\u001b[49m\u001b[43mvideo\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m-\u001b[39;49m\u001b[43m \u001b[49m\u001b[43mmean\u001b[49m\u001b[43m[\u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43m:\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m]\u001b[49m\u001b[43m)\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m/\u001b[39;49m\u001b[43m \u001b[49m\u001b[43mstd\u001b[49m\u001b[43m[\u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43m:\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;28;43;01mNone\u001b[39;49;00m\u001b[43m]\u001b[49m\n",
      "\u001b[0;31mKeyboardInterrupt\u001b[0m: "
     ]
    }
   ],
   "source": [
    "i=0\n",
    "predicted=[]\n",
    "for data in all_set['validation']:\n",
    "  #if i==2:\n",
    "  #  break\n",
    "  i+=1\n",
    "  videoreader = VideoReader(data['file_name'], num_threads=1, ctx=cpu(0))\n",
    "  videoreader.seek(0)\n",
    "  #indices = sample_frame_indices(clip_len=16, frame_sample_rate=4, seg_len=len(videoreader))\n",
    "  indices = np.linspace(0, len(videoreader), num=16)\n",
    "  indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "  pixel_values = feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")\n",
    "  pixel_values = pixel_values.to('cuda')\n",
    "  with torch.no_grad():\n",
    "        outputs = model(**pixel_values)#\n",
    "        pred=outputs.logits.argmax(-1).item()\n",
    "        predicted.append([data['file_name'],data['labels'],data['description'],pred])\n",
    "        print(data['labels'],pred)\n",
    "  \n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 424
    },
    "executionInfo": {
     "elapsed": 370,
     "status": "ok",
     "timestamp": 1667582567088,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "xJwAm11IqFzd",
    "outputId": "e2cd5c3d-3d4f-479e-cbd7-e5caded5d79e"
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "\n",
       "  <div id=\"df-237a0df4-3ded-484b-be3b-f59cce00708a\">\n",
       "    <div class=\"colab-df-container\">\n",
       "      <div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>file</th>\n",
       "      <th>label</th>\n",
       "      <th>description</th>\n",
       "      <th>predicted</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>training_set/video0694.mp4</td>\n",
       "      <td>6</td>\n",
       "      <td>Eating food with a fork</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>training_set/video0528.mp4</td>\n",
       "      <td>4</td>\n",
       "      <td>Drinking water</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>training_set/video0598.mp4</td>\n",
       "      <td>12</td>\n",
       "      <td>Lying down</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>training_set/video0606.mp4</td>\n",
       "      <td>8</td>\n",
       "      <td>Wiping a table</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>training_set/video0120.mp4</td>\n",
       "      <td>9</td>\n",
       "      <td>Reading a book</td>\n",
       "      <td>9</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>154</th>\n",
       "      <td>training_set/video0433.mp4</td>\n",
       "      <td>15</td>\n",
       "      <td>Using a computer</td>\n",
       "      <td>15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>155</th>\n",
       "      <td>training_set/video0467.mp4</td>\n",
       "      <td>17</td>\n",
       "      <td>Brushing teeth</td>\n",
       "      <td>17</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>156</th>\n",
       "      <td>training_set/video0361.mp4</td>\n",
       "      <td>12</td>\n",
       "      <td>Lying down</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>157</th>\n",
       "      <td>training_set/video0079.mp4</td>\n",
       "      <td>1</td>\n",
       "      <td>Putting on a jacket</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>158</th>\n",
       "      <td>training_set/video0148.mp4</td>\n",
       "      <td>15</td>\n",
       "      <td>Using a computer</td>\n",
       "      <td>15</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>159 rows × 4 columns</p>\n",
       "</div>\n",
       "      <button class=\"colab-df-convert\" onclick=\"convertToInteractive('df-237a0df4-3ded-484b-be3b-f59cce00708a')\"\n",
       "              title=\"Convert this dataframe to an interactive table.\"\n",
       "              style=\"display:none;\">\n",
       "        \n",
       "  <svg xmlns=\"http://www.w3.org/2000/svg\" height=\"24px\"viewBox=\"0 0 24 24\"\n",
       "       width=\"24px\">\n",
       "    <path d=\"M0 0h24v24H0V0z\" fill=\"none\"/>\n",
       "    <path d=\"M18.56 5.44l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94zm-11 1L8.5 8.5l.94-2.06 2.06-.94-2.06-.94L8.5 2.5l-.94 2.06-2.06.94zm10 10l.94 2.06.94-2.06 2.06-.94-2.06-.94-.94-2.06-.94 2.06-2.06.94z\"/><path d=\"M17.41 7.96l-1.37-1.37c-.4-.4-.92-.59-1.43-.59-.52 0-1.04.2-1.43.59L10.3 9.45l-7.72 7.72c-.78.78-.78 2.05 0 2.83L4 21.41c.39.39.9.59 1.41.59.51 0 1.02-.2 1.41-.59l7.78-7.78 2.81-2.81c.8-.78.8-2.07 0-2.86zM5.41 20L4 18.59l7.72-7.72 1.47 1.35L5.41 20z\"/>\n",
       "  </svg>\n",
       "      </button>\n",
       "      \n",
       "  <style>\n",
       "    .colab-df-container {\n",
       "      display:flex;\n",
       "      flex-wrap:wrap;\n",
       "      gap: 12px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert {\n",
       "      background-color: #E8F0FE;\n",
       "      border: none;\n",
       "      border-radius: 50%;\n",
       "      cursor: pointer;\n",
       "      display: none;\n",
       "      fill: #1967D2;\n",
       "      height: 32px;\n",
       "      padding: 0 0 0 0;\n",
       "      width: 32px;\n",
       "    }\n",
       "\n",
       "    .colab-df-convert:hover {\n",
       "      background-color: #E2EBFA;\n",
       "      box-shadow: 0px 1px 2px rgba(60, 64, 67, 0.3), 0px 1px 3px 1px rgba(60, 64, 67, 0.15);\n",
       "      fill: #174EA6;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert {\n",
       "      background-color: #3B4455;\n",
       "      fill: #D2E3FC;\n",
       "    }\n",
       "\n",
       "    [theme=dark] .colab-df-convert:hover {\n",
       "      background-color: #434B5C;\n",
       "      box-shadow: 0px 1px 3px 1px rgba(0, 0, 0, 0.15);\n",
       "      filter: drop-shadow(0px 1px 2px rgba(0, 0, 0, 0.3));\n",
       "      fill: #FFFFFF;\n",
       "    }\n",
       "  </style>\n",
       "\n",
       "      <script>\n",
       "        const buttonEl =\n",
       "          document.querySelector('#df-237a0df4-3ded-484b-be3b-f59cce00708a button.colab-df-convert');\n",
       "        buttonEl.style.display =\n",
       "          google.colab.kernel.accessAllowed ? 'block' : 'none';\n",
       "\n",
       "        async function convertToInteractive(key) {\n",
       "          const element = document.querySelector('#df-237a0df4-3ded-484b-be3b-f59cce00708a');\n",
       "          const dataTable =\n",
       "            await google.colab.kernel.invokeFunction('convertToInteractive',\n",
       "                                                     [key], {});\n",
       "          if (!dataTable) return;\n",
       "\n",
       "          const docLinkHtml = 'Like what you see? Visit the ' +\n",
       "            '<a target=\"_blank\" href=https://colab.research.google.com/notebooks/data_table.ipynb>data table notebook</a>'\n",
       "            + ' to learn more about interactive tables.';\n",
       "          element.innerHTML = '';\n",
       "          dataTable['output_type'] = 'display_data';\n",
       "          await google.colab.output.renderOutput(dataTable, element);\n",
       "          const docLink = document.createElement('div');\n",
       "          docLink.innerHTML = docLinkHtml;\n",
       "          element.appendChild(docLink);\n",
       "        }\n",
       "      </script>\n",
       "    </div>\n",
       "  </div>\n",
       "  "
      ],
      "text/plain": [
       "                           file  label              description  predicted\n",
       "0    training_set/video0694.mp4      6  Eating food with a fork          6\n",
       "1    training_set/video0528.mp4      4           Drinking water          4\n",
       "2    training_set/video0598.mp4     12               Lying down         12\n",
       "3    training_set/video0606.mp4      8           Wiping a table          7\n",
       "4    training_set/video0120.mp4      9           Reading a book          9\n",
       "..                          ...    ...                      ...        ...\n",
       "154  training_set/video0433.mp4     15         Using a computer         15\n",
       "155  training_set/video0467.mp4     17           Brushing teeth         17\n",
       "156  training_set/video0361.mp4     12               Lying down         12\n",
       "157  training_set/video0079.mp4      1      Putting on a jacket          1\n",
       "158  training_set/video0148.mp4     15         Using a computer         15\n",
       "\n",
       "[159 rows x 4 columns]"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import pandas as pd\n",
    "df = pd.DataFrame(predicted,columns=['file','label','description','predicted'])\n",
    "\n",
    "df"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 357,
     "status": "ok",
     "timestamp": 1667582611044,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "9ekeTxX5qsQ6",
    "outputId": "50260d97-65d5-46b0-e325-22952daf0302"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "                                     precision    recall  f1-score   support\n",
      "\n",
      "Opening the door and walking in/out       1.00      1.00      1.00         7\n",
      "                Putting on a jacket       1.00      0.88      0.93         8\n",
      "             Touching a hot surface       0.75      1.00      0.86         3\n",
      "                 Opening the fridge       1.00      1.00      1.00         3\n",
      "                     Drinking water       1.00      1.00      1.00        15\n",
      "        Colliding against something       0.50      1.00      0.67         2\n",
      "            Eating food with a fork       0.94      0.84      0.89        19\n",
      "               Coughing or sneezing       0.50      1.00      0.67         4\n",
      "                     Wiping a table       1.00      0.83      0.91         6\n",
      "                     Reading a book       0.90      1.00      0.95         9\n",
      "                 Neck roll exercise       1.00      1.00      1.00         5\n",
      "                  Freehand exercise       1.00      1.00      1.00         4\n",
      "                         Lying down       0.75      1.00      0.86        12\n",
      "                            Limping       1.00      0.50      0.67         2\n",
      "               Talking on the phone       0.89      0.62      0.73        13\n",
      "                   Using a computer       0.87      0.87      0.87        15\n",
      "                       Falling down       1.00      0.75      0.86         4\n",
      "                     Brushing teeth       1.00      1.00      1.00        15\n",
      "                            Writing       0.91      0.91      0.91        11\n",
      "                   Unknown activity       0.00      0.00      0.00         2\n",
      "\n",
      "                           accuracy                           0.89       159\n",
      "                          macro avg       0.85      0.86      0.84       159\n",
      "                       weighted avg       0.90      0.89      0.89       159\n",
      "\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/usr/local/lib/python3.7/dist-packages/sklearn/metrics/_classification.py:1318: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.\n",
      "  _warn_prf(average, modifier, msg_start, len(result))\n",
      "/usr/local/lib/python3.7/dist-packages/sklearn/metrics/_classification.py:1318: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.\n",
      "  _warn_prf(average, modifier, msg_start, len(result))\n",
      "/usr/local/lib/python3.7/dist-packages/sklearn/metrics/_classification.py:1318: UndefinedMetricWarning: Precision and F-score are ill-defined and being set to 0.0 in labels with no predicted samples. Use `zero_division` parameter to control this behavior.\n",
      "  _warn_prf(average, modifier, msg_start, len(result))\n"
     ]
    }
   ],
   "source": [
    "from sklearn.metrics import classification_report\n",
    "\n",
    "print(classification_report(df['label'], df['predicted'], target_names=names))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/",
     "height": 473
    },
    "executionInfo": {
     "elapsed": 2996,
     "status": "ok",
     "timestamp": 1667582709066,
     "user": {
      "displayName": "Olmer Garcia",
      "userId": "02129671575696093186"
     },
     "user_tz": 300
    },
    "id": "9s-30mn9rE4c",
    "outputId": "6c7b766b-6ad7-4914-fc5a-43ec39eea6ef"
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<sklearn.metrics._plot.confusion_matrix.ConfusionMatrixDisplay at 0x7fc85069aa10>"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeMAAAG3CAYAAACHaD3ZAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjIsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+WH4yJAAAgAElEQVR4nOydeZwUxfn/35/lkFMOMUYRRIGgXKKAt/7AK9F4xAiaRBNRo+IZNWpMvDCaeMeoeOGFfjWeQUWNiBcBURREETzxAEUiHiCIIMLu8/ujaqAZ5uiZ3dnpHevta17s9Dxd9XTvOtXVXfUumRmBQCAQCATKR1W5EwgEAoFA4IdOaIwDgUAgECgzoTEOBAKBQKDMhMY4EAgEAoEyExrjQCAQCATKTGiMA4FAIBAoM6ExDgQCgUCgCCTdLulzSbPStp8s6R1Jb0q6PE5ZoTEOBAKBQKA4RgM/i26QNBg4ENjazHoBV8YpKDTGgUAgEAgUgZlNBBambT4euNTMVviYz+OU1biOcwsEfrA0atnSmrRtHyu26fxvS5xNIFCZfMOiL81sw2L3/+nglvbVwupYsa++seJN4LvIplFmNirPbj8BdpX0N7/vGWY2NV9doTEOBOqIJm3bs9lxp8eK7TzixRJnEwhUJs/YQ3Nrs/9XC6t55anOsWIbbTz7OzMbUGAVjYH2wA7AQOABSVtYHvd0uE0dCJSALm0WMeaXD6x+TR12K7/rPSNr/IBBS7h10jvcMfltDjlpQc6ySxFb7vorObbc9Vd6bKEYUBPzvyKZB4wxxytADdAh304la4wlbSrpUUmzJX0g6RpJTUtQz3BJv6ujsk6V1CLyfmldlOvLmiCp0CuskiNptKQhdVjeMEkjc5Ut6VZJPeuovlhdTEm/knROEeW3lXRCofvNWdyOX445hF+OOYQhDw9h+arGPDNni4yxVVXGiX//lHMP25xjBvVg8IFf07n7d/UWW+76Kzm23PVXemxxGNVWE+tVJI8AgwEk/QRoCnyZb6eSNMaSBIwBHjGz7rh76K2Av9V1XWZ2k5ndVUfFnQq0yBtVRiQ1KncOtcXMfm9mb9VRWTvFDN0HGFdEFW2BghvjKDts8imfLGnD/KWtM37eY5tlzJ/TlM8+Xo9VK6uY8Ghbdvzp4nqLLXf9lRxb7vorPbYYDFhFdaxXPiTdC7wE9JA0T9LRwO3AFn66033AEfluUUPpesa7A9+Z2R0AZlYNnAYcJamF7z096nuLsyVdkNpR0uGSXpH0uqSbU42PpKWS/iZphqQpkjby20dIOsP/PEHSZX7/9yTt6re3kPSApLckPSzp5fReqqRTgE2A5yU9H9meqc4NJf1b0lT/2jn9BEhqLuk+SW9LehhoHvns15JmSpol6bIY25dKukrSDGDHtHqO8TnM8Dm18NtHS7pW0ouSPkz1UOUYKeldSc8AP8qQ+48kvep/3lqSSers33/gz+f+/jy+JumZ1LnJhqSLfE6NoncJcvxeu/r3MyVdnO0uRWq7pEG+3Ifk5vfd4y8KUxeH/YDpktpLekTSG778vj5m9d+Rfz9LUhfgUqCr/3u8ItcxZmPfbu/zxAfdsn6+wY9X8sX8NTeNvvxfEzpsvLLeYstdfyXHlrv+So8tBsOotnivvGWZ/drMNjazJma2qZndZmbfm9nhZtbbzLY1s+fi5FWqxrgX8Gp0g5ktAT4GUt9K2wEHA32BoZIGSNoKOBTY2cz6AdXAYT6+JTDFzLYGJgLHZKm7sZlth+vlphr5E4BFZtYTOA/on76TmV0LzAcGm9ngPHVeA1xtZgP9MdyaIY/jgWVmtpXPoz+ApE2Ay3AXLP2AgZJ+kW17JI+XzWxrM3shrZ4xZjbQ5/g2cHTks42BXYD9cI0KwEFAD6An8DtgnZ6lH4rfTNL6wK7ANNzowM2Az81sGfACsIOZbYO7+jsrwznAH/MVwIbAkf7CLEquc3yNmfXBPYOJwza433tPYAtg58j2Gf7q9ELgNTPrC/wFyHdX5WzgAzPrZ2ZnZji2YyVNkzSt+tt1R0g3qapm983m8NSHXWMeQiAQKDU1WKxXfVLO0dRPm9lXAJLG4BqNVbhGa6rv1DQHUnO0vgce9z+/CuyVpdwxkZgu/uddcF/umNksSW/EzDFbnXsCPX2OAOtLamVm0d7bbsC1vs43InUOBCaY2RcAku7xsZZl+yO4i5J/Z8mxt6SLcbdTWwFPRT57xMxqgLciPdfdgHt9ozhfUrarthdxjdluwN9xE9sFTPKfbwrcL2lj3DORj7KUcx7uQuLYLJ9nO8c7AqmLkX8Rb+L8K2Y2D0DS67jf/ws+9yd9zC64CyjM7DlJG/iLjqLw0xxGATTr2Gmd/3t37fQxb33Zga+WZ3/68dVnTdhwk+9Xv++w8Uq+/F+Teostd/2VHFvu+is9thgMqK7nhjYOpeoZv0Va79N/4XUG3veb0s+G4b7s7/S9kH5m1sPMRvjPV0buu1eT/UJiRYyYuGSrswrXK0zl2TGtIa5rvsvQo0wxGjjJ9yAvBJpFPlsR+VkUxkRcr3gz4FFga1xDlmqMrwNG+nqPS6s3ylSgv6RsE3Dj/l7jED3eaFl7A+Pz7LuKtf9/yHY8BfHzbu/zxPvdc8a8+3oLOm7+PRt1WkHjJjUMOvBrpoxvU2+x5a6/kmPLXX+lxxbLD6ln/CxwqaTfmdldcs99rwJGm9ky36Pcy39BL8f1gI4ClgGPSrrazD73n7c2s1rNKwMmA4fgngf3BPpkifsGaE3+kW/jgZOBKwAk9TOz19NiJgK/AZ6T1Bt3Ox7gFeBaSR2ARcCvcQ1btu35aA38T1IT3C39T/PETwSOk3Qn7nnxYFzPM51JuAF3E82sRtJCYF/gz/7zNpG6jshR3zhcb/0JSXub2TcxjglgCq4Hez/wq5j7rIOkNrhHF1/5TZNw5+kiSYOAL81siaQ5uNv5SNoW2NzHp/4mCqZ545Xs1PETLpi4W864mmpx/Tkd+fu/PqSqEYy/rz1z38t8LVCK2HLXX8mx5a6/0mOLwYCVMZ4H1zeKMciruIKlTsANwJa4Hsd/cCaSFZKG4RrgNrjbnXeb2YV+v0NxX/hVwErgRDObImmpmbXyMUOA/cxsmKQRwFIzu1LSBF/HNN+oTTOzLpJaAnfiniW+g3ueONTMZqflfDJwEjDfzAbnqLMDcD2wFe6CZqKZDU8rqzlwB65H+TbQ0R/LNEm/xj2vFPCEmf3J75Nt++o8Mpzn43HPa78AXsZdvAyTNBp43MweipbhBzNdh7sd/LE/x7en4tLK/gS4yMxGSfoL8Cv/rBVJBwJX4y4cngMGmtkg/7sdYGYnRXOQdBTwW1yD/mTk95TtHHcH7sY9qhgHHGZmHTPkmDquQb7MVIM6EveseynQO3WHxV/g3Y77G1gGHOsfIzTH3QHo6M/jjsA+ZjZH0r9wF1NPZnpunKJZx04WpB+BQGl5xh561QoXcaym79ZN7In/5J32C0DnTT+rVV2FULLGOGelkS/seqqvEdDEzL6T1BV4BuhhZt/n2TVQJuRGhS83M5P0K+DXZnZgEeXcCtxqZlPqPMk01ld72157xIr9eETcGVmw+Y3v5w/yVC+IpcENBBostW6M+zaxsTEb48071V9j/EPRYbbA3aJugut1nhAa4sTTHxjpe/Jf4x5jFIyZ/b5OswoEAg0aZ+BKHmVpjM1sNG7gUX3V9w2QOPtVIDtmNgl3i7/BMmDQEoZfNJ9GVcaT97bngZGZp2J3abOIf+zx9Or3ndZfwnXTBnLXrHUP/9QL3mS73b7g64VNOWFo/t513BzixoXYwmPLXX+lxxaOqC54PGvpCW7qBo6kai+kmCXpQUV0nlni05Wff0n7vME8zFSRKlRJXZS2GHie+F+oQH1nIUq/QtSZzzy2CeeduG2d5pAErWGlxpa7/kqPLQYDaizeqz4JjXHDZ7mfXtUbN2d3eJ74dOXnWo2xxddLlh2rWxVqLn6BG/wXm2KVfvnUmbOmt+ObxfHmXAZlY/ljy11/pccWgwHfUxXrVZ+ExriymAR0k1NDpkQayOkvhylN+SnpUqC571nf42Pj6CX39dtelVNuPp6eiKRmku6Q01m+JiklTh8maYykcXIq1MszHYik8+U0n7MkjUrVnRYTVaFm04JuJKdAneFfO6WVsYXPb6CcgnOcP65Jkrb08QcAV/jzFEulVazSL586sxCCsrH8seWuv9Jji6XGFOtVn4TGuEKQ1Bi3GMLMbDHpyk8zO5s1PevDMuyyjl5SUjPgZty0n/44zWUmTnRVWh/cnOk7/b7gdJ+H4uZ7H+qnwaUz0ms+e+OmN+2X6/jJrgW9Fviv374t8GZqB0k9cGazYeYW/x4FnOyP6wzgBjN7ERgLnOnP0wfRShXRYa5cyzlSOEGdGQiUHmfgUqxXffJDGU1dyTSXUz+C6xnfRgbfdJFk0ksuBT40s5T+8l4gk+pyF7y0xMzekTQXt3oXwLNmttiX+xbO8vVJ2v6DJZ2Fu6XeHteIPpYj12xa0N1xDu7UgiWLJbXDXUQ8CvzSzN6S1Ap33h6MdMLXy1EfvszVOsz11X71U6ZilH5x1JmFEJSN5Y8td/2VHlsMhqhOYD80eRkFCiXVs+1nZif7KVt1pXbMppesLTnL9T3oG4Ahvmd9C/mPYTTZtaCZWIyTnuzi31cBX0fOZT9zi3wURTFKvzjqzFLkkAStYaXGlrv+So8tliTepg4948pkLm4hi/Vwt3j3wC2YAOsqP1dKamJmcR/KvItbq7OLmc3B3W7OREo7+ZzcAtud/b5xhgKnGtIvfY91CLCOISyNbFrQZ3EraP3Ty19SJrPvcStYPeUtXv+S9JGkoWb2oH9G3dfMZlCEErNQpV9cdeZZl7xB3/6LWL/tSu4aN5G7b+rK+EfWEZMVlEMStIaVGlvu+is9thhSt6mTRlkMXIG6Q1lUmX5g1EG41ZSWAmPNbLTWVX5ehhugNN3MDsunl/Rl7I/zcn+LWwiidfozZ9+7vRE3v3sVcLqZPZ9uX/ODv640swlp+1+Me9b8GfAeMNfWLBqSihkBfGNmVym7FnQj3G3kLXC98OOB/+E0nb0ltQWeBi7CPW+/Ebf0ZBPgPjP7q9x61bfgevRD0p8bpwgGrkCg9NTWwNWjbzMbNbZzrNhBm8+ubB1moGEjv1yk7z1eD8w2s6vLkMd1uIuIO+q77kwU0hgXQs3/2yZ2bNV/X6vz+gOBJFEXjfGNYzeLFbvH5u/VW2McnhkHiuEYP6DrTdxiHzfXdwKSLgK2x410TiQDBi3h1knvcMfktznkpAV1EtukySquu+hxbrr0UW654hF+NyR34xu33FLkGmKTUX+lxxaKmai2qliv+iQ0xvWI3EL2r/vXZ5I+jbxvmr+EnGVnXE9ZRVqqcmFmV/sBTj3N7DAzWxapb7Tc6kuxkLNh/aaIHM4zs+1szdKImcpeT9Iz/vxme7ZdEkplHFq5shFnXvxThp99IMPPPoABW3/KVt0y35oOlqjyx5a7/kqPLZYaFOuVD0m3S/pcGYx+kv4oyeRW+ctLaIzrETP7KjVSF7gJSDVq/Uq1cEU9WqqKpQtu3ec6xc+73gbAn9/767qOXJTOOCS+W+GmeTRuVEPjRjVYllGfwRJV/thy11/pscXgBnBVxXrFYDTws/SN3p2wN27GRixCY1xmJO3hDVAz/VXWen77nNQVlaQBcms1I6mV1pit3pB0cKSsv3nL1BQ/cCndUjVB0mWSXpH0nqRd/fYWkh6Q9Ja3Vb0saZ3nJIphxfLsJulFSR+meslyXOH3nRnpqV4K7Op7r6el1bexpIla495O5bs0EjNEbt3kVK/8Jkkv4wZt3Q0M9Pt3zZa/pG6+Bz1D0nR5y5akM338G5IujPs7hdIah6pUw02XPMqDN9/H9Jmb8M4Hmb0rwRJV/thy11/pscVgiJXWONYrb1lmE4GFGT66GjegNPagrNAYl5dmuCurQ/382Ma40b65OA9YbGZ9zKwv8Jzf3hKY4k1TE4Fjsuzf2My2w5m1LvDbTgAWmVlPX37/LPvGtWJtjJu/ux+usQX4Jc68tTWwJ04vuTFwNjDJ917TB4H9BnjK30nYGnid/GwK7GRmRwG/j5T9QY787wGu9+duJ9wUqb2B7sB2Pu/+knLPO6onaqyK4X8+kF+fOJQeXb+ky6aLyp1SINCgqDbFehWDpAOBT/20yNiExri8NAI+MrP3/Ps7gXxf+HviRjADYGapb+LvgZQj+lXc7d9MjMkQswtwny9vFvBGln0H+17zTJzZqleWuEfMrMbM3gJSa5/tAtxrZtVmtgD4LzAwy/4ppgJH+ilMffxSmPl40Ju2YuUvqTXQ0cweBjCz7/wz8L396zVgOrAlrnFeC2XRYdaHcejbZesx460fM2DrTzN+HixR5Y8td/2VHlsMKQNXzNvUHVL/f/tXJtvgauSc+H8Bzi80r9AYJ5eoRSvOjPeVtmaeWi5b1ooYMeugwqxYUcNW0bPr/S2g3XACj9GRgWjRWz/pOXybqawC8weX9yWRZ/rdzOy2DDmOMrMBZjagScSeWSrjUJvW39GyhTu9TZusYts+8/lkfrBEJTW23PVXemyx1FhVrBfwZer/b/8alaforsDmwAxJc3B36qZL+nG+nIKBq7xUA10kdTOz94Hf4nqMAHNwt4ufBA6O7PM0bhGGUwEktYv0jotlMnAIbjWnnrgFHNIpxooVZRJwnKQ7ca7p3YAzgY5ksVtJ2gyYZ2a3+Gfp2wJ3AQskbYUzeh2EM2TlI2P+ZvaNpHmSfmFmj/h6GuHc1hdJusfPqe6Iu+CJZdUolXGofbtlnHX8C1RVGZIxcUoXXn4t0zobwRKVhNhy11/pscWQGsBVCsxsJvCj1HvfIA8wsy+z7pSKDdKP8uBvvS7F3Qa9EndhNBU43sxW+MFKtwFLgAm4X+gg35Bcj2uoq4ELzWyMIiYuP2hqP2+gGgEsNbMr/SCwM8xsmh8cNs3MukhqibtF3hN4B2erGmpms9NyjmPFGo2zWz3k36eMXgIux60sZcDFZna/nL7yKWADYHT0ubGkI3AN9kp/rn5nZh/547sMZ9uaBrTyx5pe9yDWtohlzF9Sd9xc6Q6+rqFm9qGkP+CeO+PrPzybfQuC9CMQqA9qK/3YvE8r++uY3rFif/eTl3PWJeleYBDuu2MBcEH0DlpojAMFIedsbmJm3/mRxM8APUo13apSCY1xIFB6atsYd+ndys4f0y9W7NE9JtebgSvcpg6AW6bwed9LFXBCaIiTQyENbGi4A4F8xBN61DdhAFcAM/vGD07Y2sz6mtmT5c6pEii3KrAQdWa5c63k2HLXX+mxhWIQdJiBukXSppIelTRb0geSrlEttZpZ6qkzpaakU/3w/9T7jBrPAsq710s5TsvwWca85RSc6+jr6pIkqALjqjOTkGulxpa7/kqPLZY6NHDVGaExbqD4AVFjcHN6uwM/wa3V+7e6rquOlZqn4m6L1xo/XWCg781fnfZZ43KqQJOhCoynzkxCrpUaW+76Kz22GAxRY/Fe9UlojBsuuwPfpZYP9KKL04Cj5PSWw3yveYLvOadsW0g6XE6J+bqkm/0ALiQtVQmVmpJOATbBPZ9+PrI9U50bSvq3nI5yqtyawumMBzr649jV5/ZPSdOAP6Tl3d/XMQM3NSxVd9a8Je0t6SU5ReaDfiR7LJKiCoyjzkxCrpUaW+76Kz22WELPOFCX9MJZtFZjZktwYvJuftN2uDnKfYGhco7rrYBDgZ29ZrIaOMzHl1SpaWbXAvOBwWY2OE+d1+AW0hjoj+HWDHkcAHzgpRyT/Lam/vn3VWmxdwAn+3qiZMzbT/06F9jTzLbFTaE6Pcv5SCxBnRkIrI1zUzeK9apPwmjqyuZp80sMShqDU1KuwjU4U92dbpoDqQeJ6UrNvbKUm02peQ04paakbErNdLLVuSfQU2vWolhfUiszy/eMeZ3VmSS1Bdp6oxfA/+HmO+fKewfcvOvJPoemwEsZyj4WOBagWeTue9JUgVF15px57eql/hBb/vorPbYYDFJ2rUSRvIwCcXmLtN6npPWBzsD7flP6JHLDTV26M6J57BERd5RUqZmFbHVWATtE8uwYoyGGLDrMIhDuYiZVf08zOzo9qL51mKVQZyYh10qNLXf9lR5bLNUo1qs+CT3jhsuzwKWSfmdmd/nnvlfhLFbLfG9uL0ntgeXAL4CjgGXAo5KuNrPP/eetzWxuLfOJo9QEp65sDeQz0owHTgauAJDUz8zirNq0Dmb2taSvJe1iZi+w5rZ8rrynANfLq0q9payjrVnUIydJUAXGVWcmIddKjS13/ZUeWwxmSmTPOBi4GjByC1jfgFtRqAr4D07/uELSMFwD3AYnK7/bzC70+x0K/NnvsxI40cymqH6UmicDJwHzzWxwjjo74LSfW+EuGiea2fC0srrg9Je9/fvVufn30bz7A7fj7g6MB/Y1s9658pa0O067merynmtmY7P9Pkpl4CqEIP0IVDq1NXB17NXWjrs/3mqoF/R5rN4MXKExrlB8YzzAzE6qp/oapFKzLvMOjXEgUHpq2xhv0qudHX3foFixF/d9JOgwAw2OhqrUbKh5Z6SQBva6uZNjxZ28WaZZZYFAw8QN4EqeDjM0xhWKmY0GRtdjfd8A9XIFWZeUMu8Bg5Yw/KL5NKoynry3PQ+M3ChRsfec0Y1Zz7Wj9QYr+cvT7nH8f67uxIv3bkSrDdy8zv3P/DgRuTbk2HLXX+mxxVDfc4jjkLyMAmVDUrUXaLzpBRl/lJTxb0TSJpLyrmesDLrLuPuWEjkl5m9KVX4SVIH5Yrcf+jkn3PnWOvsNPno+Zz85g7OfnEGv3deel9wQjitJseWuv9JjiyEYuAINgeV+Gk8v3HzffVgj9ViNV03ON7MhxVRSm33rkC5AQY2xpNh3kpKgCswX2237JbRouyruITWY40pSbLnrr/TYYqmhKtarPgmNcSAjZvY5TmZxkhzDJI2V9BzwrCKLLfjPxkgaJ6fevDy9PEkdvFry53H3lXS0nHLzFUm3SBqZodyZktr6HL+SXxhC0l2S9vJ1TfJKy+mSdvK7Xgrs6u8EnCapkaQr5NSbb0g6zpczyO8/Fje3OxZJUAUWqxWceNfGXPLTftxzRjeWLV7bQpSEXBtSbLnrr/TYYjCDalOsV30SnhkHsmJmH/rRxj/ym7YF+prZQj+tKEo/YBucEORdSdeZ2ScAcr7psbipQU/H2RcnADnP1/kN8BwwI0Oak4GdgbnAh8CuwF3AjsDxuPEae/nR0t2Be3HPiM/GTYPaz+d4LLDYzAZKWg9n3hofOe7eZvZReuXZDFwNlV0O/4yfnfIJCJ64sjMPX7R5uVMKBOoUQ6yqqV/VZRxCzzhQCE+b2cIsnz1rZovN7DtcD3Izv70JTlBylpk9XcC+2wH/NbOFZrYSeDDLvpOA3fzrRqCPpI443/S3vv5bJM30ZfTMUs7ewO8kvQ68DGwAdPefvZKpIYbsBq4kqAKL0Qquv+FKqhpBVRXs9OsFzJ2x9toYSci1IcWWu/5Kjy2WJBq4QmMcyIqkLXA91JS7OpdqckXk56jWchXOOf3TIvaNw0Rcb3hXYALwBTAE10iDW8lqAbA1rkecbb1n4RaSSOkvNzezVM+4YMVmElSBxWgFFy9Y86U346kN2LjHssTl2pBiy11/pccWQ2pqU9IGcIXb1IGMSNoQuAkYaWYmFf2HaTgN54OS/mRml8XcbyrwT0ntcLepDwZmrlO42Sfe1tXU31Z/ATgDZ/kCZyCbZ2Y1ko4AUvenUlrOFE8Bx0t6zsxWSvoJ8Glhh7qGJKgC88XecfJPeP+lNixd1Jjzth/Avqd9zOwpbZj3VkskaL/pCn719/eZ/tiGsctMwnElKbbc9Vd6bHHUnQ5T0u3AfsDnERPgFcD+uEVwPgCONLOv85YVDFyBFJKqcQ1eE1yP9v+Af/iGbBgRo1dURZnhs8eBK81sQkp36Z/DjgUexWk74+x7LHAmsBCnqpxnZudkyPv/gEZm9hs/QOsFYEMz+8o/J/437qJgHE792cpLPp7C3Y4ejVu56WLc/0TC9bB/gXuWvfrZci6SYOAqhCD9CDREamvg2rBnBzvwrrz/OwNw28A7c9YlaTdgKXBXpDHeG3jOzFZJugzAzP6Ur67QGAcSi/ySiX5K0cPA7Wb2cLnzykZDa4zj0qhXj9ix1W++W8JMAoHaN8YdtupgP7/zwFixd21/e9660h35aZ8dBAwxs8PSP0sn3KYOJJkRkvYEmuEWd3ikzPkEAoEGTkr6EZMOkqZF3o8ys1EFVHcUGdZYz0QYwBVILGZ2hh9MtaWZnWIN7DbOgEFLuHXSO9wx+W0OOWlBomPjxnXYcBmXXPE8N906jhtvGceBB+VeUbLcx5WE2HLXX+mxxVCDYr2AL1OzJfwrdkMs6Rzc47574sSHxhiQ9GNJ90n6QNKrkv7jB/Bki49KKwb555xIOkDS2Vn2Wer/LbsKMhOSbpVbz7fQ/fpJ2rcUOdUmD0kjJJ2RJfbFUueTBFVgKZSN1dXi1pv7Mfz3P+P0U/ZgvwPep1PnzHakch9XEmLLXX+lxxZDfYym9mNh9gMOi9uJ+ME3xnLDhB8GJphZVzPrj1vrt2AzuZmNNbNL88QkQQW5Dmb2ezOLbZiK0A8oe2NMAXmY2U75o2pHElSBpVA2LlrYnA/ebwfA8uVN+Pjj9enQYXkijysJseWuv9Jji6XGqmK9ikHSz4CzgAPMbFm++BQ/+MYYGAysNLObUhvMbIaZTfKKxSskzfLaxUNzFeTVjiP9z5vL6R9nSro4ElOXKsjtfB2vSXpRUg+/vYWkByS9JelhSS9LGuA/u1HSNLnFIC6MlDUhErNU0t/kFouY4g1aSBrqz8UMSRMlNQX+Chwqp5U8NC2/Xj7/1+UUk9399tN9ObMknRo5L+9IGu2P+x5Je0qa7M/Ndj6upaTbfbmvSTowRx49/XF9KOmUSF6puxSD/OcP+brv8RdnSNrXb3tV0rWpux9xSYIqsBTKxig/2uhbunb7mnfe2aDecm1oseWuv9JjiyJmrzhOz7hToZgAACAASURBVFjSvcBLQA9J8yQdDYzETZt82n8f3ZSzEE8YwAW9cVKKTPwS1+PaGugATJU0MWa51wA3mtldkk7MEVcbFeQ7wK5+CP2ewN9x83FPwBmoekrqDbwe2eccr7NshHNM9zWzN9LKbQlMMbNz/AXCMbhpP+cDPzWzTyW1NbPvJZ1PZGpSGsOBa8zsHt9gNpLUHzgS2B43hehlSf8FFgHdgKG4QQ9TcQs57AIcAPwFN9XoHNy0gaMktQVeAZ7xuUWnSI0AtsRdbLX25/ZGb/OKsg3QC5iPV2vKDdi4GdjNzD7y/8NlRBWmw4xLs2YrOef8Fxl1Yz+WL6tbO1IgUEoMWFVH84zN7NcZNt9WTFmhZ5ybXYB7zazazBYA/wUGxtx3Z5wHGdx83WzURgXZBifTmAVcjWtUUnnfB2Bms4BoY3uIpOnAaz4+03Pi74FUT/BV3ApH4Bqr0ZKOYY08IxcvAX+R9CdgMzNb7nN72My+NbOlwBicPQvgIzObaWY1wJv+3Bhu7nMqh72Bs+W0lRNwI607Z6n/CTNbYWZf4iximR49vGJm83ydr/t6tgQ+jCgwszbGlaDDLFQ/2KhRDedc8CITnuvMiy9smjWu3MeVhNhy11/pscWQVANXaIzdl37/EpUd58F9bVSQFwHP+/lt++MapqxI2hxnp9rDzPoCT2TZZ2Vk0MHqnMxsOHAu0Al4VVLm+5MeM/sXrle7HPiPpN3zHE/0XNRE3tew5rwIODiirexsZm/HKC/bua3N+c9KElSBpVA2gnHqH6fyycfr8/C/c88/LvdxJSG23PVXemyxJLExDrep3S3gv0s6NjVsXVJfXK9zEnCcpDuB9rjFCM4kT6PnmQz8CrgbyDvhO41YKkifY0rZOCyt7kOA5+VGSPfx29fHeZYX++fA++B6l7GQ1NXMXsbdWt4H1yinayWj8VvgepjXSuoM9MW5pEdLuhTXsB4E/DZuDjhr1smSTvaazm3M7LVceRTBu8AWkrqY2Rwg51iBTCRBFVgKZWPPXl+yx15z+ejDNlx3k1N333l7H6a9snHijisJseWuv9Jji6HAecb1RjBw4aYbAf/E9ZC/A+YApwLvA5fjGi0DLjaz+7W2CnIQXpeoiNrR90L/BbTCKSBP9RrG6L6r430eBakgJe0I3IlrYJ8ADjezLpJa+u09/b5bAEPNbLak0cBOwCfAYmCsmY2WNMEfxzR5haWvYwiwn5kNkzQGt5KRcCsxnQq0wzWQTYBLzGz1BHe5aV6/BVYCnwG/8c+rT8c9Fwa41cz+GT0vft/R/v1Daeesuf9d7YS7s/ORP/fto3kAWwFLzexKX94sfxxztEbRufp352NGAtP8+dgfuMKf26lA63wWnWDgCgauQOmprYGrzZYb2U6jfhUrdtz/u7ZWdRVCaIwTimqhgvSDs5qYW8O3K26AUw8z+z7PrgFP5PwLuB6YbWZX59qnUhvjQnhq/uv5gzz7brN37NjqBZ/nD/oB0GijH+UPIhnnK26uUFi+tW6Me2xkO4zKNO5qXcYPuqbeGuNwmzq51EYF2QJ3i7oJrhd7QmiIC+YYuVWemuIGu91c5nwCgUAdYMCqmuQNlwqNcUIxs4z2qJj7foNbuzdQJL4XnLMnnI8Bg5Yw/KL5NKoynry3PQ+MzO6RKXdsXZV51WmdePmZ9WnbYRWjnl9zy/rR2zowdnQHqhoZ2++xhN+f9791yj31gjfZbrcv+HphU04YmtvLUu7zVUhsqepvSOerkFwLzaFQkvrMOHmXBxWOpGo/ETz1yqjPjMQP88+0U++L0lZmKfsUSW9LiuVOzVPWHLl1hQvdb/XxSPpLZPtqOUpdIOleOfHIaQXsM9o/My+YJKgCy6Fs3PvQhfztng/X2uf1ya148ak23PjMu9wy4V2GHP9FxrKfeWwTzjtx24yflfoclCq2lBrIhnS+4uZaaLnFYqZYr/okNMb1z/LItJx++fSZuFHSqxvjWmgrM3ECsFe+gUmlJO14/pIzuEgk/RgYaGZ98z33jexTq7tGSVAFlkPZ2GeHb2ndrnqtfR6/awMOPWkBTddz41PadliVsexZ09vxzeL880nLfb4KiS2lBrIhna+4uRZabrEUsFBEvREa44Qg6XxJU+UUkaPkGIK73XyP70U3VzxtZVf/fqaki+X1j2n13YQbZf2kpNMktZf0iO89TvHTu8ixfQNJ4+W0mrfCun+5cvrMf/if/yDpQ//zFpIm+58nSBrgpzo198eZ6qk3klOBvunrap6hjv3ldJ+vSXomdQ7SGA909GXvKreoxBR/TA/LTSFL5fJPOQPXH9Lqucj3lOPIThKhCiy3sjHFpx80Y9bLrTjl590545fdePf1dX6NBVHu81VIbBI0kOU+B6XMtxjMkjnPODTG9U+qwUm9UnNYR5rZQD+1pzluGs5DwDTcyh/9vMEqSkpbuTVu/u4xfvs1OA1lH2BepiS8wGM+MNj3Fi8EXvMykL8Ad/nQbNsvAF4ws1640d6ZLFiTWGPX2hX4SlJH//NaWlEzO5s1dw1SPfXuwPW+jq9x863TeQHYwcy2wVnHzsoQcwDwgS97kj+GP/ljmumPJUVTb9S6KrVB0hXAhsCRZrZWt0/SsXKu72kr1/KHBFJUV8M3Xzfimsdn8/vz5vO347oQJnEEyoeorqmK9apPwgCu+me5mfXLsH2wpLNwI6Hb48xgj+UpK11buZf/eUecxxncXOcrY+S1C76xM7PnfM93/Rzbd8O5uzGzJyQtSi/QzD6T1EpSa5wg5F9+v11xGsx8fGRmqbkyUS1nlE2B+yVtjBv5/FGGmNVIagO0NbP/+k13srZuNH0h8POAl83s2EzleVHMKHBTm1Lbk6AKLLeyMRqz876LkWDLbZZRVQWLF8a6wVDrHModmwQNZLnPQSnzLZb6fh4ch9AzTgCSmgE3AEN8b/YW4lm+MmorE8aLuIUh3mVNT3lHnCUsH3FUldfh7ir0AY4j3nnLxbdp76cC/eWkIrFJgiqw3MrGFDv9bDEzJrcCYN4H67Hye9GmfXXOfXJR7vNVSGwSNJDlPgelzLcYkuqmTuKX9w+RVAPypaRWwBDgIb+tGM3jFFxv9n6ckjMOk3DazovkzFRfmtkSSdm2T8StqnSxnBqzXY5y/+pfr+FWUVpuZplGZKyU1MTWXVkpF1El6BH5gs1ssaRFknb1t6x/i1sAJBvjcGavJyTt7aeN5SUJqsByKBsvOX4z3nipFYsXNuaw/j357R8/46e/Wsg/Tu/EsYN70KSJceY1H6MM33NnXfIGffsvYv22K7lr3ETuvqkr4x/pmLjzVUhsKTWQDel8xc21mPNQMEYiH5MEA1c9I6matT3T48zsbLk1j3+N00a+B8w1sxGSDsYtjbgc16N8kvzayu44J3ZzXGNymJmt85cvaQ5Ox/ml7/ndjhvUtQw41szeyLF9A9xqRh1xvd+9gf7mVkiK1tEVpxXtYWbvSRoPvGNmp/jPJ0SO5zLc893puKUSo3rMM4BWZjYirfwDcfOBF+E84wPNbFBaTJe0svoBN+EeCXyIexa8KJqLjxvNGiXnUbiGe98Mz+6BYOCCYOAqNcHAVXsDV8vuG9uW1x6VPxCYvu/fgw4zUDySWuB6nybpV8CvzezAcudV6YTGuDCWHbR97NgWD79cwkwCDYnaNsYtum9sW15zdKzY137+t6DDDNSK/sBIScKNQo53GRgIBAIVj6iuCQO4AvWAmU0ys6295GI3M3u/3Dn9EBkwaAm3TnqHOya/zSEnLUh0bLnrT1GlGm47+99cNnxcWXKo1HNbybHFEAxcgXWQ9GNJ90n6QNKrkv4j6Sd1XMcI/8w102cv1mVdDYH6OOYkKAjLrWwsRms4dPAs5n7WNmdMEvJtSOe2kmOLwazuGmNJt0v6XBF1rxclPS1ptv832+DWtQiNcRnxt5EfBiaYWVcz6w/8Gag7K3oezCy/tb2OUC0Vk3VFfRxzEhSE5VY2Fqo13LDtUnbs/TGPv7hl1pik5NuQzm0lxxZLHU5tGg38LG3b2cCzZtYdt+57zvUHUoTGuLwMxs0Vvim1wcxmmNkkOa6Q02POTJm6JA2SlBJ9IGmkpGH+530lveN72NdG44CeXvf4oaRTIvsvjZQ7QdJDvox7/MVCvnJT5TSTdIfP9TVJg/32YZLGSnoO94cZ3aelpCfkdJ6zIsc4R9KFkqb78raMxN8u6RVfx4F+eyN/rqbKKS6P89v/qjWms08l3VGXx5yLJCgIy61sLFRreMqQl7jh4e3zfgkmId+GdG4rObZYzOK98pdjE4GFaZsPxMmE8P/+ghgkoqfyA6Y3ziyViV8C/YCtgQ7AVLm5vRmRE4fcDOxmZh9JujctZEtc498aeFfSjRnm824D9MJpMicDO8t5mnOVm+JEwMysj288x0dut28L9DWz9D/anwHzzezn/hiiM/u/NLNtJZ0AnAH8Hjfd6TkzO0pSW+AVSc/g5kEvNrOBktYDJksab2bnA+f72EnAyAx51+aYkXQscCxAM1pkCwvkYafec1n0TXPe+2RD+nWfX+50AhVOAc+DO/jvgxSjvHUvFxuZWWqN0M+IeaczNMbJZRfgXu9CXiDpv8BAYEmW+C2BD80spYO8F99IeJ4wsxXACkmf4/5A0r3Vr5jZPABJr+P0k0vzlBvN9zoAM3tH0lwg1Rg/naEhBjff+iq5+cWPewlHipQu81W8dhM3l/mAyPPvZjgn9t5AX61Z7rANzmv9ke/p3g38w8wyXfjU5piDDrOOYvtssYCd+8xlh14f07RJNS2bfc95RzzHRXfunsh8G9K5reTYYihwPeMvazO1yU8vjTV/ONymLi9v4qYhFcIq1v69xVXTxFFLxokphnTFJABm9h6u1zwTZ/I6P0Mu0TwEHBxZfrKzmb3tt58c2b65mY33+4wA5pnZHVlyK8kxJ0FBWG5lYyGxN4/djoPPPYxDzv8NI27fg+nvdszYECcl34Z0bis5tijqcABXFhbIufLx/8YymoSecXl5Dvi7pGNTtz7klihsg7utepykO3ELR+wGnAk0wT3/XQ9n2NoDt3LRu8AWkrqY2Rzg0PTKiiRuuSlt5nP+9nRnv2/WFcUlbQIsNLO7JX2NuxWdi6eAkyWd7K84tzGz1/z24yU9Z2Yrff2fArsDe+JuzxdCrc9lEhSE5VY2lkprmIR8G9K5reTYoimt62osTs17qf/30Tg7BQNXmfEN0j9xPeTvgDnAqTiF5OXAPrg/nYvN7H6/z+XAQbgVipYCY81stKT9gStwPdGpQGszO0zSCGCpmV3p95+FU2fOkVdqynmnzzCz/XzMSGBarnLTjqMZcCNu/eVVwOlm9rwfXDbAzE7KcOw/9eXWACuB470Wcw5rNJ0DgCvNbJDcesb/BHbC3R34yMz2k1QFXAzsj+slf4EbNPEIsDlOfII/T+fX1TGnEwxchREMXIFiqK2Bq1nXjtbp0uNjxb5/yHk56/LjSQbhxvUswC3H+gjwAK5DMhc4JMtjurXLytYYS7qOHNcPKbdwIDlIamVmS/1z0uuB2ebWKk5kuUmmmGMOjXFhFOIu/mLfrrFj29/xUjHpBBoIddEYb3pJvMb4g0NzN8Z1Sa7b1NNyfBZIJsdIOgK3ru9ruBHBSS43yfwQjzkQqHjMwGqSN1wqa2NsZndG30tqYWbLSp9SoFh8z63Oe6ylKjfJ1MUxDxi0hOEXzadRlfHkve15YGT2GQ7lji13/QCnXvAm2+32BV8vbMoJQ3N7WR49426WrWhKjYlVNVUcccPB9Z5vQzq3lRxbDEl8Opv38kDSjpLeAt7x77eWdEPJMwuUBUlXSzo18v4pSbdG3l8l6XRJB0jKaZaRNEDStaXMN62+fpL2jRE3zD8fzvTZ0rrIJQmqwIakbAR45rFNOO/ErOP91mH4bftz2MihORvich9bueuv9NiisZiveiROX/2fwE+Br8AZonAjewOVyWTcACn8wKgOOClGip2AF81srJldmqsgM5tWz2ML+gF5G+P6IAmqwIakbASYNb0d3yyuu/mkpcy3IZ3bSo4tjnjTmhK5UISZfZK2qboEuQSSwYvAjv7nXsAs4BtJ7fx0qq2A6dHepaTRkm6SNE3Se5JSo5NXqzvlFqu4XZmVnOdJelfSC5LuVYZFLSTtL+llOQ3mM5I2Svu8KfBX4FA5/eWhkraT9JLf50VJPSK7dPK5zJZ0QaYTIelMrVFsXljISUyCKrAhKRsLxUyMPPIJ7jrhIQ4a+FbWuHIfW7nrr/TYoklgzzjOPONPJO0EmKQmwB+At0ubVqBcmNl8Saskdcb1gl8COuIa6MXATDP73g0yXosuwHZAV+B5Sd0yFL+OkhPXmz0Yp/1sAkwnsyL0BWAHP7/498BZwB8jeX/vpSGrp1FJWh/Y1cxWSdoT+LuvC59rb2AZTjX6hJmtHrQoaW+cxWs73HSpsZJ28y5aInFBh1kGjrnlQL5Y0op2LZcz8sjHmfNFW16bs0m50wo0BKwgHWa9EacxHg5cg/tCno8TLJxYyqQCZedFXEO8E/AP3O9+J1xjPDnLPg+YWQ0wW9KHuIY3nUxKzp2BR83sO+A7SY9lKX9T4H45o01T3BzrfLQB7pTUHXedG70H+rSZfQUgaQxO5xmdQbC3f73m37fCNc5rNcZBh1kereEXS1oBsOjb5kx4qwu9Nv08Y2Nc7mMrd/2VHls0CWyM896mNrMvzewwM9vIzDY0s8NTX2KBiiX13LgP7jb1FFzPeCdcQ52J9Js6mW7y1EY9eR0w0sz6AMcRTwN6EfC8mfXGCUGi++TLV8AlEcVmNzO7LW6ySVAFNiRlYyE0a7KSFk2/X/3zDt3m8cGC9vWab0M6t5UcWzQN8Ta1pC1wPeMdcOm9BJxmZh+WOLdA+XgRt1LSh36hioVyKx/1Ao7Jss9QOXXn5sAWOKXkDjHqmgzcLOkS3N/jfvieZhptcIpLcIq5THyDuwWeaZ9habF7SWoPLMfZuo5K+/wp4CJJ93j5R0fccpexPLNJUAU2JGUjwFmXvEHf/otYv+1K7ho3kbtv6sr4RzquE7dBq+VcfthTADSuqmHcG914aXbnes23IZ3bSo4tmgRObcqrw5Q0BWcgSi0j9yuclD++yy7QoJDUCFgEXGtm5/pto4EdzayHfz8M/3zWf/YdToW5Pk6F+XhUN5lHyTkC+A1OJ/c5MM7MbknL6UDcvN9FOKf3QDMblBbTHteINgEuAT7GrSf6LfAEcLiZdfG5/wLXWG8K3G1mF/oylppZK//zH1jjy17q9/8g23kLBq7CCAauQDHU1sC1XpdNbeML4k3ymHvUn+rNwBWnMX7DzPqmbZthZluXNLNAg8E3xo+b2UNF7p9ST7bAPZM91sym12WO9UFojJPBe7fH/+78yVFBNNjQqIvG+Mfnx2uMPz66/hrjrM+MJbX3PY0nJZ0tqYukzSSdBfynPpIL/GAYJbeW8HTg3w2xIc7EgEFLuHXSO9wx+W0OOWlBomPLXX8pY9s+vYDNzpvFZufOou34cG4rLbYoEvjMONcArldxo0sPwQ2YeR6YABxP3S3PFygzkqr9vNxZkh7zz4YLwsyGpfeKJc2R1MH/nG3QV2r/3/hBUlua2SWF1p9Wbxd/C7zWRI+hUJJgJwqWKGg6bzltJn7Bx+duxdwLe9Fyxtc0WRDObaXEFotqFOtVn2RtjP0C7Vv4f9NfW9RnkoGSstw3hL2BhZRg2pqZ5RYNVyBJsBMFSxQ0/d9yvtu8FbZeI2gklvdoTavpi+othyScg0qOLYq4veIE9YxXI6m3pEMk/S71KnVigbKQEnwgqaukcZJelTRJ0pZ+e0YTlqQNJI2X9Kacy3r1ZaW879kbuSZIekjSO5LukbeHSNrXb3tV0rXy5q4ovtc7SdJ0/8rWyDf2Zb/t62rh99/D5z1Tzga2Xq7tkXqbS3pSUraR5OuQBDtRsETB9x2b03z2N1QtXYVWVNNy5mIaLwzntlJii0NunnGcVz0SZ6GIC3BzPK/D2ZMuBw4ocV6BesaPoN4DGOs3jcKNmu+Pm+aUWhwkZcLaBrgPZ8ICt6j2C2bWC3gYt7B2JrYBTgV64qZA7SypGW6Jwn18fRtm2fdzYC8z2xb3qCTbIhQ9gBvMbCtgCXCCr2M0cKifq9wYOD7b9khZrYDHgHvTR3gHks/3mzRn4T4/ZtOr3qPj1bNZ0alF5DIx8IMlgT3jONKFIThV4WtmdqTvCd1d2rQC9UhzP3iqI05z+rSkVjjBx4MR7WWqt5jNhLUb8EsAM3tCUuZ7gfCKmc0D8PV2wU0b+tDMUmXdi1dMptEEGCmpH04a8pMsdXxiZilT2N3AKcDTwEdm9p7ffifulvzzWbb/079/FLjczO7JVFE2HWYS7ETBEuVYstuGLNnNXd9t8O95rGrXNGNcOLcNL7ZoEjjPOM5t6uVec7jKu34/BzqVNq1APbLczPoBm+H6DCfi/i6+jtin+vleJhRnwopSGwvXabi5yFvj5jRn/laNZwOLy2TgZ9K6Mm5wOkwzG2BmA5qw5u52EuxEwRLlaLTE3eJs/NUKWr/6Nd/sUH+2riScg0qOLQoDahTvVY/E+SKc5kfY3oIbYb0U92wxUEGY2TK5lZQewd2S/kjSUDN70DdEff3ymdlMWBNx4o6LJe0DtCug+neBLSR1MbM5ZB+t3waYZ2Y1ko4AGmWJ6yxpRzN7yef0gq+ji6RuZvY+8Fvgvzm2pzjfv64HToh7QEmwEwVLlGPj6z+g0dJV0EgsOLwzNS0yf+2Fc9vwYotFddgzlnQaTg5kwEzgSO/aLzCnPNKPtEq7AOub2RuFVhRIJlHjlH//GPAArgG7EdgYd3v4PjP7azYTlqQNcLeXO+J0mnsD/c3sy1QdUSOXr2skMM3MRkvaH7gCZ8uaCrQ2s8PScu0O/Bv3Rz8OODGau4/p4j+bBvQH3gJ+6y829gCuxF2ETgWON7MVObbPwfXAvwJuB74ws7PIQpB+JIMg/ahsai396NzJNjnz1Fixc045I2ddcprcF4CeZrZc0gPAf8xsdKF5Ze0ZS9o212eVImb4oZPemJnZ/pG3P8sQ/yjuOWr69q9wDXDWOsxsAm6uemr7SZGw581sS98Lv561V1BKxc8Goja4P2WImUPmFaMws2dxA8jibu8SeXtkpjIDgcAPnsa4sTcrgRa41Q2LKiQbV+X4zIDdi6kwEMjCMf7Wc1PcsoU3lzmfQAOlkN7uwiN3jB0bnNeVQwG3qTtIiv5BjTK3bCoAZvappCtxHvzlwHgzG19MTlkbYzMbXEyBgUAxmNnVuNvfFcOAQUsYftF8GlUZT97bngdGbpTY2HLXn5TYR8+4m2UrmlJjYlVNFUfccHCty03CcVVybFHEn0P8ZZ7b1O2AA3Gr1X2Nm4FyuJkVPOMolvQj0LCQZJKuirw/Q25lpGLKWlpHOa3WVHr5xzpSj/pE0iaSilrYIg5JUAUGZWNxasXht+3PYSOH5myIw7lNRmxRGFAT85WfPXFTI78ws5XAGNy00IIJjXFlsgL4ZbFe5WKRI1F/U5Iy3v0xs/lmNqRU9SZBFRiUjaVTK4Zzm4zYYpHFe8XgY2AHSS38eJc9cL6GgknUF2egzliFM2idlv6BpA0l/VvSVP/a2W9vJekOr4R8Q9LBaft1kPSSpJ+nbe8i6V1JdwGzgE6SrpBbeGKmpNiLikhq5Ped6nM4zm8/TdLt/uc+vuwWyq7sHC3pJkkvA5dL6ian7pwhp9HsmtZT7yXpFbkFM97wo7aRdHhk+81ylrJYJEEVGJSNhasVzcTII5/grhMe4qCBb2WNC+c2GbFFU0cGLjN7GXgIt+LcTFybOirnTlnIO8/Yt/aHAVv4qS2dgR+b2SvFVBioN64H3pB0edr2a4CrzewF/7t8CtgKOA9Y7GUeqWch+J83wmkyzzWzpzPU1R04wsym+Ea8H07M0QGYKmlizJyP9jkMlPNDT5Y03uc8QdJBwDnAcX6q0ihguJnNlrQ9bn50amDhpsBOZlbtG+VLzexhOf1lFRBd2X44cI2Z3SOpKdBI0la4+c47m9lKSTfg/j+4K+axBBogx9xyIF8saUW7lssZeeTjzPmiLa/N2aTcaQXqmjqcZ2xmF+B0wLUijvTjBtzd892BvwLf4OZ6Dqxt5YHSYWZLfG/1FNwovxR7Aj21Rii1vpz+ck/gV5H9UzrLJsCzuDm9URlGlLlmNsX/vAvO41wNLJD0X9zfSpy56XsDfSWlbh+3Abqb2UeShvkybjazycqt7AR40DfErYGOZvawP67vALS2UOsl4BxJmwJjfOO+B26e8lQf2xxnn1sLBR1mxcQCfLHEzfRb9G1zJrzVhV6bfp6xMQ7nNhmxxVDALeh6Jc5t6u3N7ETgO1j9JZ1NQxhIFv/E9TZbRrZV4RZ6SGkuO5pZrkFaq3DmtZ/miPm29qkCTsd5ciS3zSPTBLrj7G+pb8Zcys6CcjKzf+EWP1kO/EfS7j6XOyNl9zCzERn2DTrMColt1mQlLZp+v/rnHbrN44MFtVNnJuG4Kjm2aBqoDnOlf1Zm4J45EnecWaCsmNlCb4Q5GmeQAhgPnIyzXSGpn5m9jltI4UTcikpIaucvvAw4CtcD/ZOZXZan2knAcZLuBNrjFpA4k3gO66dwKyk9528N/wSn3myMW6FpN9xCEUPM7CFJ2ZSd0XPwjaR5kn5hZo/4299rPfuVtAVuoYpr/a37vv48PSrpajP7XFJ7nBVsbozjSIQqMCgbC4vdoNVyLj/sKQAaV9Uw7o1uvDQ78+Jj4dwmI7ZYktgzzqvDlHQY7tnZtrgVbYbgnh0+WPr0AsWgiOLSP+/9CLfy0Ag/wvp63HPixsBEMxvub/tej7s1Ww1caGZjtEZluR7uufGjZnZDpK4uwONm1tu/F26ZRGR6PwAAIABJREFUzX1wDfnFZnZ/NE5pWsxIWVXAxcD+uJ7pF8AvcPOPX/eNZSfcSks74Xr8mZSdo31dD/lyu+MkIh2AlcBQ3AVlKp+zcU7qlcBnwG/8hcyhwJ9xvfCVuFv1qdvx6xB0mA2PIP1oeNRWh9ls007W6cTTY8W+/5fTa1VXIcRyU/tRqnvgviCfNbOihm4HApVMaIwbHqExbnjUujHu2Mk6x2yMZ59Tf41xnNHUnYFluAXWV28zs49LmVggEAiUmkIa2GUHbR87tsXDLxeTTqC+SOBt6jgDuJ4AHvf/Pgt8CDxZyqQCgUpgwKAl3DrpHe6Y/DaHnLQg0bHlrr8hxlaphtvO/jeXDR+X+FwrObYo6miecV2StzE2sz5m1tf/2x3YjrCeceKQVO3lFKlXlzoos05UmBnKHSHpjFKUXUAOB/hnxSUhCarAoGwsrYZx6OBZzP2sbdbPk5JrJccWSx0auOqMgg1cfunE+PdrAvXF8rRpPnNSH8jxg7StZbNmmdlYM7u0VPUmQRUYlI2li92w7VJ27P0xj7+YcbXOROVaybFF0xB7xpJOj7zOkPQvilyvMVB/KLOm8kytUU1eGInNqn2U9DevkZziR2YjaX9JL0t6TU4zmdo+QtLtkiZI+lDSKZFyzpH0nqQXgB5Zcs6m6nxU0u/8z8dJusf/vLeconO6pAf9iHAkzZF0maTpwFBJP/MxMyQ962OGSRrpfx4qp9icIW8LUxY1Z1ySoAoMysbSxZ4y5CVueHh7avKs/pOEXCs5tihi9oqT2DNuHXmth3t2fGApkwoURfPILeqH/bbuwA1m1gvXAKYeM/QD+kvaTWtrH/vhpjUd5vdvCUwxs62BicAxfvsLOHHINsB9wFmRPLbECUK2Ay6Q1ERSf5zdqx+wL9ntbSlV50DgYOBWv/1Y4HxJuwJ/BE72U7TOBfY0s22BaUB0iORXfvuzwC3Awf44hmao93zgp/7zA/y21WpOn+8xkjbPknfgB8ROveey6JvmvPfJhuVOJVAsCewZ5xxN7XtIrc2srM/3ArFY7htTYPX836imcm//es2/b4VrnPuSXfv4PW7wHjgL117+502B+yVtjLOxfRTJ4wkzWwGskPQ5sBGwK/CwmS3zuY3NcgwZVZ1mtkDS+bj5xQf5OcD7AT1x/mp8HtGxDPf7f3fAzaX+CJwIJUO9k4HRcoKUMZHztY6aM+1Ygw7zBxjbZ4sF7NxnLjv0+pimTapp2ex7zjviOS66c/d1Ysuda6XHFk1DGk0tqbH3C+9cj/kE6paoElLAJZFnyt3M7DZyax9X2pqJ6NWsuXi7DhjpF5U4jrXtWisiP0f3iUMuVWcf4CvW6DAFPB2J7WlmR2c59pyY2XBcL7sT8KqkDcit5ozuG3SYP7DYm8dux8HnHsYh5/+GEbfvwfR3O2ZsiJOQa6XHFoNI5m3qXF+Ur+CsW6/7nsyDRL7gzGxMth0DieQp4CJJ95jZUkkdcVapZylc+9gGp6kEOCJG3RNxPc9LcH9z++OMWOlkVHVK2g5n9NoG+K/cSk5TgOsldTOz9yW1xC0I8V5amVOAGyRtbm7BifbpvWNJXc0thfaypH1wjXJGNaeZxWrkk6AKDMrG8msYk5BrJccWhYESKHTOauCSNN3MtpV0R2Sz4S4szMyOqo8EA/FQRIHp33choqn02/4A/N6/XQocbmYfKIv2UWtrNYcA+5nZMEkH4hSVi4DngIFmNkjSCGCpmV3p95nl95kj6Rxcw/05bkHu6am4SH7rqDqBP+AuDI80s+mSDsCt07w7MBi4jDWrNZ1rZmMlzQEGmNmXvtx9gL/74/vczPaSWwVqgJmdJGkM7ha0cBcnp/qf11FzmlnWYZ3BwFXZBOlHMqitgav5xp1s86PiGbje/nsCdJiS5gH/wDe+/t8UZmb/KH16gUDDITTGlU1ojJNBnTTGR8ZsjC9Jhg6zEW6QT6ax+wl8/B0IBAKlo5AGdpMprWPHzt/hm2LSCdSCJK7alKsx/p+Z/bXeMgkEKowBg5Yw/KL5NKoynry3PQ+M3CixseWuv9JiF128nBWTq6lqJ370L7ec+OLrvmPFC9XQGBpvWkXbc5tR1Vqxy0zCcSUxtigS2BjnmmdcvysrByoGxdRoShqeknnUcf2DJD2eP7J0JEEVGHSY5Ytt8fMmtL+6+Vr7rLddYza8pwU/uqcljTtVsfTO7wsqM8TWEX4AV5xXHCS1lfSQpHckvS0p/lJgEXI1xuHhV6CkmNlNZnZXufMoBUlQBQYdZvli19umMVXrr92fabZ9Y9TYbWvSu4rqz2sKKjPE1iF1K/24BhhnZlsCWwNFLTGctTHOIkcIBApCUpWk2ZI2jLx/36svVy8Y4RWal8lpOd/zti0ktZD0gKS3JD0sp+FcZ0CFV16+4xWYv4xsby/pEa+0nCKpr98+01/RStJXWqPbvEvSXl6XOUbSOJ//5YUcdxJUgUGHmYzYTCx7bCXr7bj2U8Ik5NrQYoulruYZ/3/2zjvcjqpq4783DUJCCF2QEjrSQgkdMaCoSFEpUoUAUgQpKij6iVSlqfTekSLSBFE6hARCSyCELkqRriAJCTVlfX+sPblz58ycO3PvObknN/t9nnnumT1r9t4z59xZs1d5l6T5gE2BSwDM7HMzm9iZOc2RxQMiZh3MbAZwFW0Um18DnjKz/+aI9zGz9fDUoqND24HAB2a2CnAUzhbWDpLmxikvtwnHv5A6fCzwpJmtAfwSSFbiD+GENqviZUG/HNo3BMaEz2viVKGrAztJWjJn7P0kjZU0dmo7vpOIiHxMvuwz1Ef0/2YVPpyIhqL8ynih5P87bPtleloGT3u8TM7Vf3HgPKiMqIwjZgUuBRLf8N7AZQVyCZHMOGBI+LwJzn+NmT0DTMg5b2XgFTN7KTCGXZU6tgnwx3D+fcCCkgYBo/E32k2B84DVAxHKBylij3vNbJKZfQo8ByydHbiIgasVqAIjHWZryKbx8W1T+fShaQw+dm5StK8tM9fZTbZTKKuIXRm/l/x/h+3CTG99cHKs8wJX/0dAp0qzRmUc0XSY2evAu5I2xwtI3F4gmiwtq9Jodgaj8NXwl4GR+NvtDriSzs6n8pxagSow0mG2hmyCTx+expSrPmeBU/vTa+7a+NhWmOvsJtsZqMJWAm8AbwQGP4AbcOVcGdFOEjGrcDG+Yv1j4Dwvi4eA7wH3S1oFNxln8QIwJNBa/gvYJXVsNG4iP17ScPxN90Pgw8D41c/MXpaXdjwc+FHVC8tDK1AFRjrM7pP94KhP+OyJ6cyYaLyzzRTm3bcfU678HPsc3j/kEwD6rdabwT+fu3SfrXBdrSbbWTSKDtPM3pH0uqSVzOxFPPD5uU7NqYiBKyKis5A0g/Y1r/+AF5d4H1jPzF4IcscQ6DMljQQON7OxQUmONbMhwf9yBV6h6QVgWWBHM3spM+Y3gdOBj3EFvJyZbR24ti8N530M7GdmE8I5fwR6m9mukjbCS0MubGbvp+kyg+xtwO/MbGTRdUcGrogEkfSjeegqA9c8iy5pK+xcjoFrwpkdM3BJWhNfbPTD40/2MrMPqs4rrowjGg4zq3F/hAjopxJFHOSOSX0envr8Hm0+409xDu1PJS0H3APUFLEwsztw33G2/X/Adwrm+f3U5zGk3DZmdjlweWp/67w+IiIiZkM0cA1qZuOBLlNmRmUc0XRIOhL4IW0R1VUwD26i7ou7cQ40s887OCeigei96CKlZae/+5+OheYAVFntxvs7i9EN5RHLIAZwRTQdZnaSmS1tZg924tzJIYpxqJmtYWZFwV8th2HDP+Ti0S9w2UPP870fvdvSslX6POzoZ7nm3pGce/2YunLNmuvsJhvvbXNlO4XGkn40BFEZR7Qc8ug0G0mdGXIBV2lEX0VoBarAZtBhAtzz18U56qCOA0a7+7paQTbe2+bKdhaNIv1oJKIyjpgt0EjqTDP7gZl1KuKxLFqBKrAZdJgAzzwxP5MndZz32d3X1Qqy8d42V7azaCQ3daMQlXHEbIEc6szTAiPO85LWDdSVL0k6IcgMCfSYVweZGyTNkzp/WPg8RdJvJD0V6DIXDe3Lhf2nJZ1QtvhFglagCmwGHWYVdPd1tYJsvLfNle0UqpF+zDJEZRwxu+LzkHJwPnALcBCwGjBC0oJBZiXgXDP7EvAhTq2ZxQDgETMbihOB7BvazwDOMLPV8cT+XEQ6zIiI2RBRGUdENAy3hr9PA8+a2dtm9hme55dwSL9uZg+Fz1fh1JhZfA4k5RbTNJwbAteHz9cUTWJOo8Osgu6+rlaQjfe2ubKdgYg+44iIRiJZhs6gPW3lDNpS9rL/Tnn/XlOtjfmmYTScrUAV2Aw6zCro7utqBdl4b5sr22m04Mo45hlH9GQsJWlDM3sY2BVn2CqLR4DtgeuAnasO3ApUgc2gwwT42YkTWGOdDxg0eCpX3jGKq85fjrv+8sWWu65WkI33trmynYKBZrReonGkw4xoORTQaQ4inzpzePi8dTh3JM4x/R5wBzAWL6v4HPB9M/s4c/4UMxsYzt0B2NrMRkhaATdt9w/97GZmtU/FFHoqHWYkpWgu4v2thq7SYQ5YaElbZdsfl5Ide9lPuzRWFcSVcUTLIY9OM3N8eOrzSLzqUrtjkoYA08xs9w7OH5j6fANedQXgTWADMzNJO+PBYBERET0BLbgGjco4IiIf6wBny4vOTsTrMM+RqLIai6s8x8ffXb+07Dw3P9qxUMA/T9uglNzyP36kdJ9zIiIdZkTELIKZvWpmq3Xh/NEpCs5NzeyfVftoBarAZlA2RnrH6rK9NINLjryRkw+4o2F9zjfybZY86SmWPPkpFr3yJTS1mKWiFe5BpMOsj6iMWwySFpQ0PmzvSHoztd8vI5slwqjxbUj6u6TBs2r+RZA0QtLiqf1XQ6nERo9TiZyjWWgFqsBmUDZGesfqsgA7bvYMr71T/9+wSp+9J37O4NHv8MZPVuf1nw+FGcbAJ99r2XvQUnSYJdOaYmrTHA4ze9/M1jSzNXFCi9OS/c5UKzKzb5nZxMbPtDJGAIt3JNRT0ApUgc2gbIz0jtVlFx48hQ1X+ze3jamp8NnpPgGYYb4anm70mjqDaYP65Yq1wj1oJTpMEekwIzoJSftKejxQNt6Y0DoWyPaSdHmKFvJVSQsFesjnJV0k6VlJd0nqH2TWlTQhrL5PlfRMTr9KjgWKyJ1C+/CwKr8hRT+pzLk74PU+rw5j9A+HDpb0ROhv5SA7QNKlkh6T9KSkb+fMZbikUZL+JulFSedL6pU6nkdvOUTSfeE675W0VGi/XNKZksZIejnMNenniHDfJ0g6tuTXBbQGVWAzKBsjvWN12UN2eJhzb16fGabc453pc/rgfkwcvhhDjnuCZY4ex4y5e/PJyvkr71a4B63wG2sHs3LbLERUxrMHbjKzdQNl4/PAPgVyfYCrgZfM7Fc5x1cAzjGzVfGgpO1D+2XA/mE1Pr2g7+2ANYGhwNeAUyUtFo6tBRwGrAIsC2ycPjFEKY/F04PWNLNPwqH3zGxt4Dw8HQng/4D7zGw9YLMwzoCc+awHHBzGXC7MD4rpLc8CrjCzNcI9OjPV12I4O9fWwEkAkr4e7td64brXkbRpdhKRDjOiHjZa7TU+mNyff7y+cEP77fXxNAY88wGvHrUWrxy7Nvp8BgPH/rehY/RkRDN1RGexmqTRkp4GdgNWLZC7AHjGzH5TcPwVMxsfPo8DhgR/8ryBGAOKqR83Aa41s+lm9i7wALBuOPaYmb1hZjOA8bRRSnaEm9JzCZ+/DhwpaTyesjQ3sFTOuY+Z2ctmNh24ljaqy3r0lsm1/ZH21Jh/MbMZoZLToql5fB14EngCWBlXzu0wp9FhRnrHarKrL/suG6/+Gn8+7hqO2fte1l7pTY7a874uj9//H5OYtuBczBjYF3r34qM1FqD/q/nhEt19D5op2ynEQhERXcDlwI9C0YJjcQWVhzHAZpKKjqeXbg2jfuxCv8l56XMEbJ/yky9lZs/nnFtEddkZesv0/JX6e2JqHsub2SUl+gJagyqwGZSNkd6xmuwFt67H9r/aje/9eleOufSrPPHiFzn+is27PP60+fsx16tT0OfTwYz+/5jE54v0z5Xt7nvQTNnOotE+Y0m9g1vtto6l8xHzjGcPzAu8LakvvjJ+s0DuEmBT4M+StjOzaR11bGYTJU2WtL6ZPUox9eNoYH9JVwALhHGOwFeMZTA5XEdHuBP3JR8cCDfWMrMnc+TWk7QM8BqwE3BhB/2Owa/tj/g9HF1iHsdLutrMpkj6Iq7oSyXHtgJVYDMoGyO9Y+fuQxlU6fOzpeflo6ELsOTvn8Z6ic++OIBJG+XneLfCPejue1uDxq96D8VdiIM620Gkw2xhSDoGmAJ8BPwM+C/wKG5WHpEcz6GIPBZYEVc6L+PBUwOB25Lc25ASNdDMjpG0PnARXmThAWCYmbXz+4agrFOALfGf8glmdp1q6SjPBsaa2eWZ87cHfgt8gpuMnw/jvBdSsn5nZsNDcNfpwEa45eaVpO9UX8OB43AFvzxwP3Cgmc1QMb3l0rhvfKFwH/cys39LujzclxvCOenzDwV+EIadAuxuZv8q+r56Kh1mFUTSD0ck/WgeukqHOXD+JW3oVw8tJTvmxiM6HEvSEsAVwG+An2SfV2URlXEEkgaa2ZTw+UhgMTMr92vtBmRfAFoFURlXQ7MUd3whgK9M+KRjoYAH1sg3b7cqGqGM19y83OPtoZtKKeMbgBNxy1+nn0vRZxwBsFVIOXoG+DJwQndPKCIiIqJpKB/AtVCSLRG2/dLdSNoa+I+ZjevqlKIyjsDMrgtBSquZ2VZm1tI5EmY2stVWxXloBarA7qbD7G7qzCp9Vp1vK9/bF3/dlzFfmZvHv9sW4f/K2X0Yu/1cjN1xLibs34/PCowCrfBbaCYdpqiU2vReki0RtmxsysbAtpJeBf4EbC7pqs7MKyrjHoZAbvFMpm0mbWbBOdsG8/QcBWUoOhuJVqAK7G46zFagzizbZ7Ourbvu7aLbTmf189rnvS85YhrDbvyMYdd/xgKbTue1C2rThVrht9B8OsyShB8lXLhm9gszW8LMhuABovflVYorg6iMIzCzW83spO6eRzdgBBUpOiWVykBoBarA7qbDbAXqzLJ9NuvauuveDh42g76ZbKA+A9s+z/gknw2sFX4LzabDhEiHGdECkHSIpOcCxeOfQtuIEAVdSA8pp9k8N1Be3i0vQLFDTv8dUndKGijpskCDOSFEWiNpl9D2jKSTU/JT5FScz0q6R9J6cgrOlyVtm7qGW0L7S5KODu3tLAWSDg+WghqKTknrSHpA0jhJdyYMY6HP0yWNxVMYOkQrUAV2Nx1mK1BnNqvf2fXevnJmHx7ZYi7e/VtvhhzUmvOdFXSYzWDg6qr7LCrjOQ9HAmsFWsgDCmRq6CFxuskhOP3k9/H0pDyUoe48CphkZquHedwXzMUnA5vj9JPrSvpOkB+Am39WxdOZTgC2AL6LpzglWA+n+FwD2FE5VawSZCk6gWk4ZeYOZrYOcCmeqpCgX/AZ/T7dT6TDjJidsMwh09jg7s9YdKvpvHXtHEozYcAMK7fNQkRl3PNQ9AtK2ifgq8HdcQWUhzx6yE2A60P7O3hubx7KUHd+DThn5sTMPsCpNUea2X8DWcnVOLEIOMVlUgj2aeABM5saPg9J9Xt3qHr1CU61maa87AgrAasBdwcqzl8BS6SOX5d3UqTDbG3qzGb1O7vf20W2ms5/7+ndkvNtOh0mRDrMiFmC94H5M20LAEmx061wRbg28HiBDzSPHrIsLqccdWcVpCkuZxDmF7iw0/PPo8icRvvfedF8BDybor9c3cy+njr+UZUJtwJVYHfTYbYCdWaz+p0d7+3Hr7X9K79/fy/mWaZW27TCfGcJHWYLFoqYQ+0UPReBuvFtSZub2X2SFgC+CZwhLzO4pJndL+lBPPpvYN0O2/AQsGegw1wYGE5+UYky1J13AwfhlZ6QND/wGHCmpIWAD4BdcLNxFWwRrvcT4DvA3sC7wCKSFsRZtLambZWdpuh8EVhY0oZm9nCY/4pm9mzFOQCtQRXY3XSYrUCdWbbPZl1bd93b537Wl0ljezN1Ijz8tbkZcuBU/je6Nx+/KtQL5lrMWPGo2vLorfBbmDV0mK1HdhUZuHogJK2Cr36TFfKpZnZ1UDD3A/PhK8GrzOwkSSNwasofFdFDBkV+Lq6EXw/nn2xmd2fG/iE51J0ZmYFhfuvgxRyONbObJO0C/DL0/Tcz+3l6DuHzMQQK0Mz8RuAKeD7cvHyVmR0bZA7BA6/exOlBXw00oFmKzpXw0orz4S+qp5vZRUpRjda775GBqxoiA1fzEBm4ijHvoCVs2AYHl5IdefeRXRqrCqIyjiiNhDYzrDIfAzYO/uNuR/qForvm0FOVcVRuPRszvrJWadleD+TVbJm16KoyHjRoCRu2frnHxP33/GKWKeNopo6ogtvk9Y/7Ace3iiKOiIiIqIRZnENcBjGAK6I0zGx4CG5aJVuVqbthZpd356o4D61AFdgMysZm0Fb2ZNnuHr+KbN++0zjr+Ns4/6RbuOjUv7DHDvVXwt09385CZqW2WYmojCM6DUnTA2FGsg2pI5tUhZpJwiFpmKQzmzS3Kc3otyxagSqwGZSN0Bzayp4q293jV5WdOrU3R5zwDQ448tsccOS2DBv6Jl9aPt/10Arz7RTKpjXF1KaI2QifpFKB1jSzV6ucbGZjzeyQJs2tW9EKVIHNoGyE5tBW9lTZ7h6/qiyITz/z77ZP7xn06T0Ds9alzuwcGsdN3UhEZRzRMASay3slPRFoLb/dgfxwSbeFz8dIujRFc3lISu4oSS9KelDStcopeiFpGUkPh3FPSLUrUGk+E47tFNrPSVFp3izp0vB5b0m/CSv45yVdFGg475JUOuy0FagCm0HZWAXdfV2tINvd41eVBeilGZx/4i1cf8GfeOLpxXnhXwu39Hw7A82wUtusRFTGEV1B/5SJ+mbgU+C7ZrY2sBnwe0lVSENWBr6B01oeLamvpHVxisuhwJY4n3QezgDOC2Qjb6fat8PpNYfizF+nBs7p0XjtZoAv4jSfhLZR4fMKwDmBhnNimEc7RDrMiJ6GGdaLA37xbXY5aEdWWu49hizxQXdPqbGwWCgiouchbab+Lp4f/FtJE4B7cCW3aN0e2uNvZvaZmb0H/CecuzFwi5l9amaTgb8WnLsxcG34/MdU+ybAtWY23czeBR7AqTdHA18OOdnPAe8GJb0hkEQmvWJm48PncbSn3gTmPDrMKuju62oF2e4ev6psGh99PBdPPfcFhg3N4+1pvflWQjRTR/Rw7Iazc60Tii+8SzU6zPTScjrVU+9K//eY2ZvAYJydbBSunL+HE4pM7up8WoEqsBmUjVXQ3dfVCrLdPX5V2fnm/ZQB8/jPvl/faay9+lu8/lbrzrfTaMEArphnHNFIzAf8x8ymStoMWLoBfT4EXCDpRPz3ujVwYYHczsBV+EtBgtHA/oHGcwG8+MQR4dgjOCXn5sCCwA1h6zJagSqwGZSN0Bzayp4q293jV5VdYP6P+dkPH6RXL0MyRj0yhEefXLJl59tZzOq0pTKIDFwRnUaapjLsL4SbkQfi5Qk3ALY0s1dTtJVDcLrN1SQNx2kmt86huXwG2DqcewywK77S/g9wh5ldlJnLMjhX9kDgFuCwMJ6AU3B/swEnmNl14Zx9cPKSxQNV6ETg+4Gac+Y8g+zhwEAzO6bofkQGrsjANTtijmPgGvBF22DV/UvJ3v340ZEOMyIiQYqGcx7cpLyfmT3R3fPKoqcq44iIBGe99lBp2YOX3rgpc+iqMp5vwOK2wSrllPFdY4+ZZco4+owjZgdcGGoMPwHc2IqKOA+twE7UE1miZjfZ7h6/kbJXH748v1h7XX67xZoz2/5+2pL8ar1hnLTlUE7acijP3pet4Nrc+XYKMYAropWRYtR6KuQKb9Sgfo/Jyw0OxzrkVDSzXUPE9spmdmJBP2tK+lYX5jhE0q6p/RGSzu5sf63ATtRTWaJmJ9nuHr/Rsuvv+B8OvOK5mvM22+ctjrz9KY68/SlW3bw2FaqlGLigYcpY0pKS7pf0XOAjOLSzU4rKOCKNJFVpKPALoEbxSWpo0J+ZNUTh47nEnVbGeNrSrh0JlUUrsBP1VJao2Um2u8dvtOzy63/IPIOn5Z5bDy3FwGV4oYgyW8eYBvzUzFbBY2QOCumSlRGVcUQRBgEfwEymrNGSbgWeS/NLh+OHhyArJB0S3hInSPpTqr9VCti1pqTGGCnpBkkvSLo6IQyR9K3QNk7SmQlrV6qPfsBxwE5hZb+TpAGB0esxSU8mbGCSegdGrsfDHBPn0Ul43vF4ST8ObYtLukPSS5JOqXLzWoGdqKeyRM1Ost09fjNl0xh15WKc+I01ufrw5fl4Uu9umUMVNKpQhJm9nbjNQkrk8zi/QmXE1KaINPoH3+zcwGJ4yk+CtYHVzOwV1SkIARwJLGNmn8nLLSZYGWflmhd4UdJ5Zpb9D1sLWBV4C09V2ljSWOACYNMw9rWZczCzzyX9mlQ9Y0m/Be4zs73DPB6TdA+e9jTJzNaVNBfwkKS7wrwPN7Otw/kj8NX2Wni+8YuSzjKz1+tce0TEHIdNdn+Hbx7yOgj+9ruluPn4Zdjtd//s7mnVgcGMxtNrhefiWsCjnTk/rowj0kjM1CvjZBhXpugsHzOzV0r0MQG4WtLuuAknQR67VhaPmdkbZjYDGI+bjlcGXk6NXaOMC/B14MjwcjESf8FYKrTvEdofxfOLVyjo414zm2Rmn+IsXTV500V0mK3ATtRTWaJmJ9nuHr+ZsgkGLTyVXr2hVy/YaJd3ee2pgTUyLcXAZVTxGS+U/H+Hbb+8LiUNBG7EUyo/7My0ojKOyIWZPQy6NgZjAAAgAElEQVQshDNqAXyUOjyN9r+ddEb+VsA5+Er68ZSPuQybVVcZuNIQsH2KrnMpM3s+tB+cal/GzO4q6KPD+RTRYbYCO1FPZYmanWS7e/xmyiaY9G6bonzqzgVZbKWPZ/kcKqO8z/i95P87bDWEQ4Gj4EbgajO7qbNTimbqiFxIWhnoDbyfc/hdYBFJCwJTcFasOyT1ApY0s/slPYgzYtW+JlfDi8CykoaEEo07FchNxk3gCe4EDpZ0sJmZpLXM7MnQ/kNJ9wWmsBWBN3PO7xJagZ2op7JEzU6y3T1+o2UvO3hF/vnwfEz5oA9HrT+Mb/3437z0yHy88dwAJFhgic/Y+be1JuqeysAVLIeXAM+b2R+6OKdI+hHhkDQdeDrZBX5pZn9LM2WlZA8BDsUV2cvAq8BvgPtxWkwBV5nZSR2wayXMXO3GCGlFY83scknbAKfiq/PHgXnNLE15iaQFcEXbF48CvxU4HdgIX8W/Epi+egEnANuEOf4X+A7wcTh/QeByPHgt7YO+DfidmY0sun+R9COip6NHkH70X8w2GjKilOwdL5xUdyxJm+CUu0/TFn/9SzP7e9V5RWUc0fJIMXAJN4G/ZGandfe8sojKOKKno0co47m/YBsttWcp2TteOmWWMXBFM3XE7IB9Je0J9AOexKOrIyIiCtAsPvEqCvaNG1ctLbvE9s+Wlm0IWnARGgO4IloeZnZaCLZaxcx2M7PaCJEWRKtTG7bS+D1ZtrvHBzjs6Ge55t6RnHt9h4R3DZvD/Oe8yWJ7vcCih7X5kDV5Ggsd+yqLHvQSCx37Kpoyvctz6BQiHWZERHVIOk3SYan9OyVdnNr/vaSfZM45QNIe4fMISYunjl3cWZacspgdqA1bZfyeLNvd4ye456+Lc9RBaxceb8YcPho+mPeOap8NOOjm9/hs9QG8e84KfLb6AAbd/N8uX1tlGDDDym2zEFEZR8wOeAgPxCIEYC2Ek4Mk2AiY+covqY+ZnW9mV4amEcBMZWxmPzCzWoLdBmJ2oDZslfF7smx3j5/gmSfmZ/KkjnN1GzmHz1cdwIyB7dm45n58Mh9t5lxAH202mLkfm9zla6sOA5tRbpuFiMo4YnbAGGDD8HlV4BlgsqT5A4vWl4A/SDo9MHYdqlCcQtIOwDCciGS8pP6BdnMYOB2npN/Ii2M8ImnR0L5c2H9a0gkJbWdZtAJdYaRs7H7Z7h6/Kpo9h94TpzFjfn8pmDG4D70n1vJczwo6zGimjojoBMzsLWCapKXwVfDDOHvWhriifRr4HOgXEvN/nzr3BmAssFvwO3+S6X4A8EgojjEK2De0nwGcYWarA2807+oiIuZQSJ5cOKthwPQZ5bZZiKiMI2YXjMEVcaKMH07tJ/kW13Wi38+BpPDEOJyCE1zRXx8+X1N0cqTDjLL1ZLt7/Kpo9hymD+5Drw98ldvrg6lMn682oafpdJgQV8YREV1A4jdeHTdTP4IrzLS/+KP8U+tiqrUl21em4Ix0mFG21e9tFTR7Dp8Om5cB908EYMD9E/l03VrSu+bTYZZUxLNYGcc844jZBWOAw/GiEdOB/4VqTKvipuWf1Dm3M1SXjwDb46vtnatOdnagNmyV8XuybHePn+BnJ05gjXU+YNDgqVx5xyiuOn857vpLbaW/Rs5hgT+8zlzPfkyvydP4wr4v8uFOizB5u4VY4PdvMM+9E5m+cF/e/+kSXb62yjCaUrWpq4gMXBGzBST1xikqzzSzX4W2y4ENzWwlSSNxOs2x4dgxBApOSdsDvwU+wVfTtyeyCR1nOGcHnKZzhKQVgKuA/sAduM+5bp3SyMAV0SpoFulHFTSL9KPLDFx9F7GNFtyhlOwd754XGbgiItIIq+FBmbYRqc/DM8eOSX2+Ea+qkmB46tjA1OcbgBvC7pvABqHIxM7ASl28hIiIiFZBCy5CozKOiMjHOsDZgQ97IrB3N8+nx6EVVm8RzcMsp7gsCzNsej7zV3ciBnBFROTAzEab2VAzW8PMNjWz2rpwHaAVaBAjZWP3y3b3+NBz722nERm4ImYVJA0JpQrTbcdIOryD80aE8oWzJST9MrNf9+kjaZikM8Pn4ZI2asQ8WoEGMVI2dr9sd4+foCfe2y6hBaOpozKO6Glop4zNrK5yNbOxZnZI2B1OoN3sKlqBBjFSNna/bHePn6An3ttOw8yjqctssxBRGc+hCJSQJ0t6TNI/JH05R2YrSQ9LWkjS5ZLOlDRG0ssh8hg5TpX0TKCO3Cm0nyNp2/D5ZkmXhs97B/rJIZKel3SRpGcl3SWpf84ctpH0qKQnJd2ToqscKOmyMOYESdtLOgnoH2gvrw5yU8LfP0naKtXv5ZJ2CKvh2yQNAQ4AfhzO/7KkVyT1DfKD0vsdoRVoECNlY/fLdvf4VdEK8410mBFzIvqY2XrAYcDR6QOSvgscCXzLzN4LzYsBmwBbAyeFtu2ANYGhwNeAUyUtBowGEgX/RSCpkvRlnHYSYAXgHDNbFQ+S2j5njg/iUc1rAX8CfhbajwImmdnqZrYGcJ+ZHQl8Emgvd8v0cx3wvXBt/YCvAn9LDprZq8D5QFKucTQwEkgU+M7ATWbW7qlQxMAVERHRqvAArjLbrERUxj0XRa916fabwt80DSTA5sDPga3M7INU+1/MbEaoeLRoaNsEuNbMppvZu8ADwLoEZRxKFT4HvBuU9Ia0MWa9YmbjC+aQYAngTklPA0fQVq3pa8A5My+q/TzzcDuwWSgssSUwKoenOouLgb3C572Ay7ICRQxcrUCDGCkbu1+2u8evilaYb9PpMGMJxYhZjPeB+TNtCwDvpfaTpVyWBvJfOGPVipnz00u/uhTvZvYmMBj4Jr4SHo2vTKeYWVI3Ld1fERXlWcDZoWDD/kCnqHjM7FN8pfsNYCdK8Fib2UPAEEnDgd5m9kwHp8xEK9AgRsrG7pft7vGrohXm23w6TFqyhGLMM+6hMLMpkt6WtLmZ3SdpAVwxnlHi9NfwVehNknY0s3oJg6OB/SVdgSv7TcO54JSSh+Er7QVxQo0b8jqpg/lwAg6APVPtdwMHhf6RNH9YHU+V1DdrTg64DvgBXulpRM7xyWSIRYAr8UIRx1eZdCvQIEbKxu6X7e7xE/TEe9tZGGANXPVKSp6rvYGLzeykDk7J7yfSYfZcBBPxObStkE81sySwaSRtlJALAWPNbIikEcAwM/uRpLWAq4FtcB/tbYGlioRGMpBinIKbfg04wcyuCzL7AMeb2eIh8Gki8H0zuykETN1mZqsF2cOBgWnmrND+beA0nArzPmBdMxsuaWC4tnXwVfWxod+TgW2BJ8xstwzdZV/gXeAWM9srtA0P92FrSSviLwszgIPNbLSkLwCvAIuZ2cR69zvSYVZDJP1oHnryve0qHeYgLWAb9Pl6Kdm7p11Xd6xA0/sPYAu81OrjwC7BlVcJURlHRNRBiBr/tpl9vyPZqIyroScrjO5GT763jVDG6/faotxYM/7ckTLeEDjGzL4R9n8BYGYnVp1XVMYREQWQdBa+4v+Wmf2jhPx/cRN/FgvR3ldfhLJyUbY1xu/Jst09fj3Zpc1s4ZJ91EDSHaHvMpgbSDOOXGhmF6b62gH4ppn9IOx/H1jfzH5UdV7RZxwRUQAzO7iifO4DQtLYMm/yZeWibGuM35Nlu3v8qrJVYGbfbHSfjUCMpo6IiIiIiOgc3gSWTO0vQVvAaSVEZRwREREREdE5PA6sIGmZQCa0M3BrZzqKZuqIiObjwo5FKslF2dYYvyfLdvf4VWW7BWY2TdKPgDvx1KZLO0gFLUQM4IqIiIiIiOhmRDN1RERERERENyMq44iIiIiIiG5GVMYREd0EScuUaZsdEZjZsm1z5clGNAeSekv6cXfPoywCm9Uci+gzjohoMCSdbGY/L9H2hJmtnWkbZ2brFPS7CbCCmV0maWGcPvSVHLl5gJ8CS5nZvpJWAFYys9sycr2BZ81s5ZLX9Vdqq4FNAsYCF4RiHInspWa2d2p/IE5DWkNRVrHfsvdgHzO7JNN2UiizmZUVsBuwrJkdJ2kp4Atm9ljBfVg6zOEeeQ3uPqniJ1nZLwJLkwqWNbNRebJVUOE+PBbKpHbU31x4CdMhmbkeVyDf8OuS9DJwI3BZZ+gkZ3fEaOqIiMZjC7wEZRpbJm2SVsZLQc4nabuUzCAKqlJJOhovcLESXsqxL3AVsHGO+GV4ScoNw/6bwPVAO2VsZtMlvShpKTP7d4nrehlYGLg27O+EF9dYEbgISFOGviHpXDM7UNL8eO3oi7rSb8V7sL2kT1Nc7OdQXPHrXJyPfHPguDD2jXgp0HaQtC+wH14UZTk8r/R8vD52VvbkcC3P4fzp4C8dXVVaVe7DQ5LOxoukfJQ0mtkTGblb8BegcVC/MHezrguvib4zcLGkXsClwJ/M7MMu9jt7wMziFre4NWADfgg8jT/0JqS2V4CrUnLfxh+i74e/yXYmsFFB3+PxspVPptomFMiODX/Tsk8VyI7Clc+9eH7krcCtBbKPF7XhK+zssVNwRfU4sH2d+1aq34r3oD9e2WsX4ArgjDrjP1Hhfo0H+mVkny6QfRGYq8LvZzLwYWZ7HbgZX7V35j7cn7PdlyP3TIV5NuW6Mud8BX+J/Ch8f8uXHW923eLKOCKicbgGuB04EUibQyeb2f+SHTO7BbhF0oZm9nDJvj83M5NkAJIG1JMN5tNEdjmKVztHlRwfYGB6FR3MuQOTMUNbeqX/aOj/McAkbWdmN3Wm3+RzR/cglApN8APgL8BDwLGSFkh/DylMDSb7pN+F8ZVyHj4zs88Tl7ikPtSa2BO8jK9a6640Uzgdr/xzDa5sd8ZX30/gq8ThQa70b8HMNis59hhJq5vZ0yVkm3Jd4TvYCtgLN5f/Hq8a92Xg79TWV+9RiMo4IqJBMLNJwCRJWRP1QEkDrdYU/L6ke4FFzWw1SWsA25rZCTnd/1nSBcDgYCrdm2Kz79HAHcCSkq7GzZcjCub8QMYHOg9OXpCHnwIPSvoX/lBdBjgwKIMrgsw2mXOexB/c2+BKK08Zl+m37D0YF8ZR6u9WYTNg2Zzxz8RXaYtI+g2wA/CrgnvwgKRfAv0lbQEcCPy1QPZjYHz4jmcqLjM7pEB+WzMbmtq/UNJ4M/t5GDNB6d+CpEWB3wKLm9mW8rKqG1rGnw5sAoyQ9EqYq3yqtkaqr7Pwe9is63oJX7mfamZjUu03SNq0oO8egxjAFRHRYEh6mjZFMDeuXF40s1Uzcg8AR+BBSmuFtmcs1HjO6XcL4Ouh3zvN7O46c1gQ2CDIPmJmuZVy0j5QM1suBHudbzmBVkF+LiAJ+HrRUsFVKZnewCFmdlrR/DrTb5ArfQ+qIPjxvxr6vdfMni+Q6wXsk54DXlC+5kEqac+8Pszsirx2SQ/jtbtvCE07AD8xsw2C8lozJVvqPki6HXeB/J+ZDQ0r+SfNbPWM3NIFc30tJZN7PW2idmVXrkvSJmb2YObcjc3soTrj9hhEZRwR0WRIWhs40EKZtVT742a2rqQnU8q43UM3JbsM8HaipIIZelEze7VgvCwmAa+Z2bSM7HhgPeDR1Byezj6sU/IbURtxW/MQLhvFW7XfCv31xX34yYpqJP7SMzVHdjngDTP7TNJwYA3gSjOb2MEYCwBLmNmEguNfBcaY2Scl57wscAYeeGfAI8CPcd/pOllFVbLPUr8xScfj8QNjzOyjvL5Ssoea2RkdtVW9LuVnF9S09VREM3VERJNhZk9IWj/n0HtBESS+vx2Atwu6uR7YKLU/PbTVRPzi0cFr48FjAlYDnsWjt39oZnelZEv7QCX9Eff1jad9FG2e0iwbxdthv5ImF8wpMaUOyjl2Hm4ePzfsfz+0/SBH9kZgmKTlgQvwILZrgG/lzHUksC3+7BwH/EfSGDPLy+fdAzhP0v+A0biye9DMPsiRxcxeptbMn2CmIg5++ZOBRfB7UO8+fBSsJMlvbAP8xSyLl/FgtzPD/R4NjArxDVnsiSvXNEbktJW6Lkkb4r/thSX9JHVsEMUukx6HqIwjIhqMzAOlF64Y38oRPQgnw19Z0pt41PVuBd32MbOZwUxBgfYrkH0L2McCYX3wEx4H/Az32aaVcRUf6DBglTyTbA6SlVc6T9Xw9KFK/ZrZvCXGy2LdjJ/yPklPFcjOMCf83w4428zOkvRkgex8ZvahpB/gq+ejJeWujM1sTwBJi+Om2XOAxSl47obAsX2ptRDsnRE9BdimyJSewU/wl4vlJD2Ep5DtmDPXy4DLJH0B+B5wOO6+mHnvJe0C7AosIyldmWheIC8wrux19cMD9vqkx8OjrncocY09AlEZR0Q0HukHyjQ8x/bGHLn5zexrIVCpl5lNlrQ18FqO7H8lbWtmtwJI+jaQ6wcGVrRU5Rgze07Symb2smqJsY7EfaBPA/sDfzezosCwZ4AvULx6n4kKUbyV+g0m+E1wxf6gmRUpzemSljOzf4XzlqVt1Z3F1KBo9qBtBde3QLaPpMVwhfV/Hcx1dzwSeHX8uzobX3EW4ZZw/J46cwV4t6QiBreIfAXPSRaellTDvCjpYmAV4N0whx3waOc0xuDf0UJ4pHOCybgVpgh1r8vMHsBfCi9P+6jnNERlHBHRYJjZsTCTdQozm1IgepGkPczsmSC/M+5Luy1H9gDg6mD6FZ6nuUdBv89KOg/4U9jfCXguBEllfaYHB1/fTAVcx/+3UOjnMdpH0W6bFZQ0Hx7VnfhsHwCOCxHnnepX0q/xVV0SkX25pOsLos+PAO6XszoJZ4vaK0eO0H4A8BszeyX45/9YIHscHrT1oJk9HpT8SwWypwP/wnOt78/z72cwj2VY2gowVtJ1eNpW+n7lRao/HHyuM1/OJD2BW2vSWBA3CU/EV7nvZeMLgqJ8DdhQtSxk/XGlXPm6JJ1uZocBZyuka2XGrfl99UTEAK6IiAZD0mr4wzzJeX0P2DNRuim5ZfEI013xFdQewNYFCis5pyMFnwR3HYivIMHzbM8FPsUfjFNSsnlBMzODfTLtX8kbL6xssrI34iveJHL4+8BQM9suR7ZUv5JeDH2kg9jGm9lKeeeHl4/k2ItmVjYvtmGQtCr+QrIJsEKYx/cLZE/AA6j+3kGfl+U0m7WnH/0C8EWcmWtX/IUE3A97vhVQoEr6EvAN/KWwt5ktkSNTNQK/7nVJWsfMxlX5ffVERGUcEdFgSBqDp5LcH/aHA781s41yZFfEVzj/Br5bL/JW0lY4jeZMWkcr4A4uMcfE/7cJ7U2n8+I+1NwHa4X+8yJ2cyPFK/R5P36PJob9wcBNZlbjhy4TTS3pz2b2PbWlos08RG2O7c/M7BS15dq2g+Xk2EoahOd4fwV/2VoITzPLTREKgVMD8NXu1NQ88gKz6kKehjQC98ePTR2aDFyeXUUH98iX8fs1GI94Hm1ml+b0XTUCv9R1BZ/937rjpakVEM3UERGNx4BEEQOY2UilWJJyHv4L4CbCRyWRVgKpc84H5gE2Ay7GfXqPZWSy/bZDpt/S/j9JD5rZJjlRzfWUxSdK5Y1K2hho96JRtt+UApyEm+DvDvtbZO9BCmWiqQ8Nf7cu6CONxEc7tq5UezyY2s42szfqCZcNVJO0BHAWbVzUo4FD0/2b5zJfIWl7M8uLV8jim6GfM8wsL9gwjSosZFUC8LYBTpM0Co/CvyNrKu/JiCvjiIgGQ9LNePBL4nfcHc+n/G44nkuwkCAviEXSBDNbI/V3IHC7mX05JZP0e1D4mx7fLKdiUbMgaSiemjRfaPoAN9XXC/Qp6qse2UQuiYakpzLR1Lltob10Dndn0JFrIQTXvaD8/PCadLDwMnIN7b/f3cxsi5y+jyZ/JV9jUZGzdSWpco+Z2X8K5nsK7lveAzgYd4k8Z2b/l5GrdF3hnL54UZWdcKvN3ZbJz++xsBYgyI5b3HrSBsyPUyw+geeino5HTmflNgDmTe0PAtYv6POx8PcRPD1mLuCfBbJP5rQ9USC7AV7IYQrOAz0d+LDOtfUO4y+VbJnjh4a/G6euaVAH9+sSYM1M2zFd/A6eAJZL7S9b5x6MBfql9vuRU7wiHLsbGJz5ru8skF0NpwN9DXdDjANWy5G7MPwtW9RhfJm20P7T1PZ/wMPApTlyO4Z5XoG/RL0C7FDQZy88Vel6POZhX8LCrivXlTovoU+9CQ8k6/b/6VmxdfsE4ha3nrIBvwDWqiD/ZPohFh5yRQrjKNyXtz3wDm5iPq5AdnyiDMP+RnUe1mOB5cNceuORxScWyB6MB6M9i6dCPU2mWlAyTtF1FPT7BvAUvnKm6Hw8AOoGvHTfy8lW0OdXgwIciUdyvwpsVnS/ctoKqzblfY8FsmPSY+IFEcY04Hd2L74a7h223XEKzzLnzgWMzLteYJHU/sJF9yAc74/XyC4z5twl27YELg/f1eU46Uqfrt6v2WWLPuOIiMbhZeDQYKJ9Cq/gdJcVMC7hinimCdHMZgT/W5uAtKOZXY+XYJwI3CjpNvxhVhR1vQ9waUgvEm4izhJHzISZ/VNSbzObjhM/PIm/WGRxKP4Afr+oL+B5SS8Bi6s9GUZNUFQK/8F94VdJWi+MU5MQjXMsH43zHG+GvzjU5MyGa7o3RPmWiaauksM9Xe0rTC1Nsb+0buxAFpLmpi0K3nAf7vlWy9O9N+4zPi3IjaE4bSuLefAazFn0svZm6fcpuLeStgVOxS0Iy0haE38xLEpBGkNtKlVe2x64r3j/Ot9Vj0VUxhERDYKZXYc/TJC0Fh4Uc5O8cMI9eEBKOuDoZUmH4IFF4A/ilzPd/gI3B95IeHiFB1Xhw8rMxgFDgzKmjtIG+FjO5DU++ALfpuAhjOc21+sLM9slpNXcidNGloHCHLeRdAy+mp0vR65/ULIy96sfI2kc8OuaDnMUm6Q8xQbtc7jBV+q56UfAL3EKxwfwF4Yv42k+eXhZ0lG09+1mv980rsQD6M4K+7uGc9sxZoVrL3VvM0F9vfEVb14E/h2S7gSuDfs74WUL83A0Hk09MsxnfPC7Z8dO0qv6h/+HdHrVPFl5M9ulxCX1WMQAroiIJiOkuGwBfMPM9ku1L4L7ljfHH5j3AoelVyipyOH1cG7jdkivRiTtbmZXqT0dZ1r2DzlzWxpnXeqH55bOB5xrZv9MyST9rYqvNP9Ge7KJmn6rQNKxZnZ0an8b4MeWSVkKKWOb4Kbq+/BCAydZTp6xpD/jiu2q0LQr7uvdMSPXGzjZzA4vEWjVC49ivw/3tUP9iljzA8fSlu89GveF51pKJD1nZquUaCtLm5kNFpyGs3flRihL2p5UhLaZ3Vwg94h5xaV08YkJWatH2fSqTkbr9zhEZRwR0QSoQVWIwqp1bXyFVBNVailCBEn7m9kFIYK2BhaYwTL9d1hZqKi/tm47l+ucGSPN6DQPTjgxOSOzLp5iNBg4Hl9hnWJmj+b0V0qxhfZHzGyDbHvBPMea2bDSF1YBkq7CU6AeCfvrAweZ2R4ZuTG4Yh9Hil7SClKYVJ5CtOw8L8FfHI/EYxgOAfqa2QEF8mXTq+ZoRGUcEdFgqKAKkWWIIYIpdR9qiTz2zsj1xgkrOkzxUMVawpKuwEvbdVhZKOW/rttWFSrJ6FRl/LKKLRw7DzenXk/7ClM19JKSTsL9ydlqVP9LyfyV+nm3uSZmSc/jlod/h6alcC7paaT87apAnqJaCtHvADMpRHNWo9m51qxKw8vS/+H1lMFdEsdn/bwpS81P88bIWlQk/dEy7GR5bT0VURlHRDQY4aHaYXUjSdcDL+Am1OPwik3Pm9mhObIPm9mGJcevVEs4nJNUFjocWNzMauJJ1KR6syrJ6FRm/JSPtC9tis1wbuoXClbGHdJLpmRfKZBdNiXzlfBxO7wARmIq3wU3E+eVWyydf66StJlBthSFqLye8du4BUb4b3ExM8vzx5d6Kapqqcn5Lvvg0fo131lPRAzgiohoPMpWIVrezHaU9G0zu0LSNRRX9RkvL1vX4eqNarWEO6wsJGlLPM3ki5LOTB0ahK/aahD8mj/HKwGlV/15JRTrMjpVHL8Mm1Y7mFnZSGTMrCZQKUfmAQBJv8+YtP8qqZDBy8xeC37mJWnv3ngi9JesYgX8UtLntBX+KPKtvoXf/yRwbS7c157FttaeEOU8ecnJGmVMW1Bh3bagiHvjeeuFlhpJv8AD4/pL+jBpxvPeLyw6r6chKuOIiMajbHWj5EE6UV5c4h28YHwe5sbTTdLKzGgzP6ZRpZZwmcpCb+EBONvifsoEk/Ggrzxcjb8MbIVHK+8J/LdA9gHVr6lcenzrRAk+OT/4eTjr1mqS1sCVU001qGCi/QlOdrJfMKmvZGZ5lbYGSFrWzF4O5y6DczQXzeN4PODpX7S9jMz83qxzdZ1zKUSTl5qU6+QjSbvhlb4MX8V/lO6oMy9lZjZdzoNeqIzN7ETgREknmlleSt0cgWimjohoMFS+CtEP8JSlNfAc2oHAr83s/E6Oe6iZnaEUJ3TJ80pVFpJTFfbBFdGLHfQ5zszWSUfZSnrczNbNke2F+86/jq+I7gQuzpr5JfW1VKGHRkGepnQE7pdPzOTPmNlqObLX4S8EewTFPQ9uMq7x4Ur6Jr6yS5dx3M/M7iqYx4vA6mb2eYk5b0cqbcvM/lIgV4pKVNIQ4Aw8mtrwSl+HpV/O5Pnza+IveekV82T8Ra4oSvw03G1Q11Ij6bs4M9eksD8YGF50bT0NURlHRMwGCH7NvCCYdNm88Wa2ZhU/ripUFpKnHP0Op45cRnXIHtSW/nInnr71FnCDmS1XMI/+lFDyzUDykqD2qTq5QVIK0dQZ2VzO63BsLiApV/hCNsgpI3sj8EMr4IROyZ2Ls6alc4L/ZWYHFZ/VOJR9KZJ0GE7u8Qfc5DzzEG5Wz6au5VX6yi3n2RMRzdQREQ2CylchqpcPbHhk862ZlUbaDDo38F1cwaXRGfarKp+6wn0AACAASURBVJWFjqEE2UPACXLSkZ/iJBaDKDBpqzqjU6PxnqTlCN+ZpB0o9vd/Hl4cEtnlqE/A8hnOxlYGJwJPSnqG+u6NzYEvJZYDeUT8s3kdyksjHo+vyvtA13N3K1gnlsDdIF/CqVMfCtsYS0Wfp5BHNjPH6Kg55kIjIpoNM9sk/O3It5f4DYvklsFr8c7MfbVMnqaka3EFmh6/MvtVgYIuwlQzm5QEWiVdFPSbvDxMwqkr66EUo1MVSNoAfwn4Eq7kewMfFSihg3Bz8sqS3sSLJOxe0PUxwB3AkpKuxq0KpQPAOsAVwMm44ppRR+6feNpT4h9fMrTl4XQ8qvvprNm/2TCzw4EkV34YzpG+F3ChpIk5UdJjJf0BOCfsH0T7GIEejaiMIyJmMczsgvC3hoQjgaSOiDRWICfYy8zeAXJNpg3As5J2BXqHwKVDcDNkV1FKyVeM0D4b2BmP8B2G8x6vWDD+W2b2NTlvdC8zmyxpoTxBM7tLTsG5Ab7KPNQKGLg6gY/N7MyOxZgXt4I8Rhs729gQbZ9dSb8OPDOrFXEG/XHLyHxhewt/4cjiYLwgynVh/27ayoH2eESfcUTEbIAc0/c7wC+yK+YmzyFN9pAEWh1v+XzPVfotxegk6S78QX04qQhtM/t5Tp+JbzcdQJbrf5TnJu9rbQQh2+OVq2qUt5zQ5UepIKOl8ZKEX82RzfPbTwJesxxKyrAq/Ay4lfZm6mygU26AYEo+zcq2Lm6mfoA6FKYFLpNJwDgzG5+RzSM1mYRHvF9gbTnNF+KENpOBR/Hyn48UBXrN6YjKOCIioltRVslXjNAeBXwNuJi2kpMj8gKtJK0OXIqbyRcHFgR+kOc/l7Q/7vv+Cc7adQTwUzP7a47sIziV6YRwXavhvt358ECtuzLy92f7ICfQqQrCC8wUMqbvrFVGnuM+jLaUsq3DvIfgjF2npGTPwAtOpAPIPsQV9KAkEl/SHXhA4DO4BeVh6qzSg+XjZ9Qy0nX6+mcnRGUcETEbQNLGOHPSR3KijrWBM6xOXq2keczs4w76zTOLTgLGmtktGdlhODnDENqTUtT4nUMU8fY5sp3msa4Soa0SBTAy8t/B2acmA5sWyQXZTYD7cZKUtYJrIE/uJuAoM3s27K+CpwX9DLgpL1q70ShK0cqRGwV8y0KRDHnRjL/hlcfGpf27eS9AqYj0Z81s1VS7cOW6UdhWwwMUH7ZUcZAgW9ry0RMRfcYREQ1GjkkZ2sx4P7VAAhFkt6J2JZCnsM7DyyIOxSOUL8ZL7tWYLOVFKi7G85aXCufsb2YH5vQ7N556k7AnbY8HMA2VtJmZHZaSvRpfCXYUYARwS7jmcdSJNg7zXRF/AA+hveLOrohKR2inXlI+xSsn1Rv/EpxLfA3cr3ybpLPM7Jwc2e/jfs09gvzfJe1lZnkR0ysmijjM6TlJK5vZy2n/eAfR9V2tivV3SV/PrsJzsAjtv6epOAnKJ5Ky399Ata/pvBT+W4P2KUyEVfAzkibiv4dJ+Kp7PTxwL40FzewSeb78AzgZzOMlr3O2R1TGERGNx+l4TdxrcPPkzvjD/gncHDocQNL5eF3XzXDluQPwWG13AEwzM5MXvj87PLT2KZA9DfgG7nvEzJ6StGmB7BrAxmY2PczpPJwOcxNqg2z+a2a31rnuNJYws2+WlL0eZwC7mFQVoiwqRmhXwdO4WdqAV+RFJYoU4PbAJua5wNdKuhmPgs5b5T4b7uefwv5OODPbXLSxr0H96Poik27ZvOwfAoerY+rMq4FHJSXWkG2Aa0JQ23MZ2Z/iNZ3/hf++lwEODLJXpOZ4CG0r4qm4qXoM/j+QF8CVzO/t8JL6FrBAB9fXc2BmcYtb3Bq4AU/ltI3PHsNJ8NN/B+JsSnl9PoDz//4D573uhaer5Mk+Gv4+WW9Oof1FYL7U/nw4A1e788P+V3GFuQueLrMdsF1BvxfibFJl7te4FvjOlga+Fj73B+btQH6e1Od+BTL9ccV1c9gOx1++egEDS87rsJy2bcL39krYXxPPS+/qPVgXODRswzqQnQuP2h8KzF0g8wf85WWxkuNvHX5/q+FugHE4LWm3/jZm1RZXxhERjcfHkr4H3BD2d6CNqD+90vkkJb84zj29WEGfO+HVnfYxs3eCafDUAtnXg6na5BSWh+J1gPNwCl6EYiS+ytkU+G1Y5dyTkd0LN2n3pc1M3Y4fW21Vk/oAe0l6GTd/1iMe+aukA3GFlY74zSOGaDiUKuGIWzCWwFfqeRHSGwKXkHEB4Hza7WBeI/r3YctiSsnp/QS3tKRxDBXysuWkKollZKTl82iDW27eJFhM06boHKxDm1thqCQsU6/bzHLN7kWw5lk+ZgvEAK6IiAZD0rI4z++GuGJ6BPdtvgmsY4E3WtJRuO/zqzjRgQEXWU7ZuorjLxTG/xquBO/C82HfL5BfDH+4AzxuZllmr0TuRcuU3suRKVUGMHNOh2UJq6Js+k2QLVXCMbQ/ir9c3Wod81hvjCvOhP0qubDS1yXpdTNbMtOWBLKlKTkn5L3oyOsvr4ubocGtGmMtU5BB0sG4D/dd3FVQ+PKkkvW6I6ohrowjIhoM8wCtbQoOP5iSOz58vFHSbbi5b1IDxn8Pr0dbFr3wikp9gOUlLW9mo3LkxkhaxcyyPsT02EnN3dxC8UBNAQorUZYwnF86FxYvzpBNv5mMB2hdlJlH3RKOOfN9Xe0JSor83JfgL2Hj6sh0hLx5VCFf+RawppnNgJnUmU/iLo80DsWrT+W+sGUwjBL1uiOqISrjiIgGI+RL7kttdHBNsfrUsc/oIOq4GeNLOhlXVM/S3vScp4w3wE3ar9Cx6XnV9I68ru06BfPdEbjDnPnqV3ja1vFm9mRGdBj5ubAHSGqXCwtsZO3Tb/6aTr/J9PuA6pdwTKOKC2CSmd1ecGwmCqLvwe9v/5z2g/G87M/wl407cWKPIgzG04nAfbJ5eB1/sSmDsvW6IyogmqkjIhoMSWPwiOR2KyLrAltWSPc4o6O2quPLy/atYXWqCaVkc03QadOzUoXigSTHeWah+Kx5NJwzwczWCPm7J+C+8F+b2foZuSq5sM8D37D26Td3mtmXlGHiUskSjkG2tAsgmIh74z71QkatZkJeS/gkPCAqiQk40syuy8hdAqyE389Cpq4gez8eNNZRve6qc214bvrshKiMIyIaDBWU3+tinzVlEbNKpTPjS7od2DFRcCXkh+KlFsEjv3MrEqlCofjkOiSdiEeIX5N3bZJewCO0p4b9ufAo8ZVzFOy38CCsduk3eNDTvmaWDYpqONQERq3Qb9m87ER+MdxvDPCY5ZCUSMrm/CZ91uRoq2S97qqQM3Yluenpl8i8ALgeh6iMIyIaDEkn4GXi/l5C9ovUBviMSh3fBY+i3gRf7SaYF5hh+ZzIVca/EU9PuZf2q5yaYBxJh+Lm7yR6+rv4aveslMzKZvaC8nmZc1eFwV/+JrAFbqL+BFcaQzNyR4Ux07mwt+LRyhea2W4Z+XQt4RetixzarQJJT+EvGlmlVVPhSNJ3gfusjUt7MDDczP4yi6ZbGkWBcHMKojKOiGgwgg9wAK7cpkJ+DdmUv/Y52kelbpuSWRpf1Z2IF1JIMBnPT56Wkk18jyozfjhnz7xrMLMrcmQnABua2UdhfwBOa7hGSuZCM9uvyqpQzk39TXxV/FJYya1uOaxR8sIHG4Xdh8xsbN78g+xG1K4eryySbxTUXEYtFDi6S8rWWEkyUdinm9lhBdHnZH6Lpep1dxbywhJnmVkeIUiPRwzgiohoMKzjesYJvoNHsNYrTv8aXrd2Q0mL0mZufN4ylX8qjJs+p0bp1oFoHxWcpMCk+9sv/C2dJ2rOn31Tav9tioODSuXCFqXf4BSizUZH9ao7BUkJG1WVvOxeOW3p5/4fw9/fdTS+la/X3VlsAowoGSDY4xBXxhERDUJVE20Vf22IOP4d7vMU7rc9wsxuyJG9N2u+zrZJ+rOZfU9tJB3Zuebll/4EJ++/Oczh28Dlef5XSQ/irGGj8RXs5I6usSNUzIV9ng7Sb4pWgwkyq8K6BBYFgU4L5gV2dRZBSSWWj5wp1OYvS7oUmIjnsYPXB17AzEZ0cS69gUVpb3UoIggp22eHAYI9GVEZR0Q0CFVNtBX9tU8BW5hzIifpS/ek/aqS5sZXZffh/NfJQ3sQnjq0ckp2MTN7u+oDMLxobBJ2R1tt+lEitwz+wvBlPCXqsyCfW9ihDCT9E1i/jIKTdD1wSFhlF8lUqQucBDithFsnEo7ubXD/9u45/b+Er8wvA26v92JQBZLmzvq/89pC+wC8sMXXcEV+N/CblKsh92UsQcGLTvqlaEabaNdWsJKOx1PqxiTzm5MQlXFERIMhqZcFkoVUW94DtIq/th0jVEjHeSrTdihwGF6T903alPGHOLPX2Tn9bmmZXFhJB5jZ+TmyywFvmNlnkjYDVgeuNLOJedcRfL9fwRXyZsC/LVM8Iqyw7ilj1g4vOVtkzfN1ZJuRfjMK2CpZ6UuaF/ibmdUU4pAkXAnujSvwP+OWhH90cQ55kfU1bSX76gxjWumXoopz2Qv/rWyIx0SMBkZZppRnT0VUxhERDYakSy1FsBFWJ7dmTcfhWD+cFQo84ndqVibInYpXWEozSk2wnFqvkg62VIRzB3MdA/zKzO4L+z8DNjOzLXNkx+OkG0PwfNRbgVXN7Fs5sv/C6/1egz9Ux2dfUFKy9+IFJ+qSTqhaLmyH6Td1VoX1zN/t8rJDxPYE65gmdDPgKpzTejye6/twvXNy+vgC8MXQz660t3ycn7Z8NBNVXoo62f8XgO/h6VvzN9FH3VKIAVwREY3Hm5LONbMDJc2PK4+LskKShuMl517FH6xLStrTcqgozewISdsDG4emC83s5rzByyrigG3x+r1H4BHNK+O+4DzMMLNpkrbDyzieJSnXTA2ciZuzdwHWwlmuRpnZv3JkpwBPS7obmGmezDHX/zts/cJWCCuX87p1CZksrgQek5dOBA/Cyw2Ck7QgsDtOvfkuzpx1K75ivx6Pkq+CbwAj8EIWv6e95eOXFftK5liP/atdhHTKb/4yMFJShy9FFedyMbAKfq9G4xzgs4wgpbsRV8YREU2ApFPwFcs6wEmWz341DtjVQk1aOZnDtVYybaWBc10Er9A0Dti7yLcpL5JwOk7FuI2ZvaIOckPlLFl74aucJcysd45MaXN9iWvpVPpNJlL9scQ3XyC7Dm1+81F1/Ob/wKOVLzOzN0LbYWZ2uqSfm9nJlS6urd/t835PzYYKiEESWA5BSMX+b8ZdLM/hwX+jzHne5whEZRwR0SCEFePMXTxw5jHgDgAzuykjX1NpJ68t1ffJwCKh7y7lduYoq37AtNCW26+kVYAD8Nzia0OQ1vfylIqk3+MKayBexOBBPIAr9+Faz1yvCrmwnYG83OWplIhUD/KlIoklKftiI+nfZrZUV+ZbBSGobx+cK3zupN0KeNLDi1larm6EdIhdGGhmHzZkwt7nl3ArwI+B3ma2RKP6bmVEZRwR0SBIuqzOYcs+AEPayQzcBwheaal33oMyBM1sY2ZFRQnSsnmBPJOA15rl58uZww648n23hOxwMuZ6YKa5XtI6ZjaupB94gTyZlGxNLm6ZSPWUbOn0qjwopyRiMxGiyl/AfczH4b+x583s0Izctrjpe3HgPzgr3PNmtioZSLoGfymbDjyOW4DOMLOi+tpl57o1/iK0KV7c4hH8N3RpV/qdXRCVcURENyEE/xxEKlUIONdySEAkPWRmG2fbC/p9BKeVnIAri9XwqkzzAT+0DLOVOqDkbDaqmOvDCnplfIX8opl9njmezsVdCvggfB6MR3PX+GnLRKqnjnUpkrgbVsYJ73dSjKMvruA2yMg9BWyOv4SsFQLOdjezfXL6HG9ma0raDf+dHYkX6uhqatPZ+P/AaCuoqd2TEQO4IiIaBEln1jueDUgKSvcPYSvqMzF9j5V0HfAX2gfN3JRz2lvAPmb2bOhjFXxV9DOc6WqmMlYBJSf5JRSbhb6JIgYws38EpdEOkrYiU/xB0v6WSs1KlK2ki4CbLfBzS9oSD7bKwx2S7qR9pHoRr3eHpQY7CIrKK4lYGSpP9ZmY+ydKWg14B3d11MiZ2fuSeslT8+6XVFRMo2/4fr6DB/JNldTlVZ2Z/Sjx3QfrTl3ffU9DVMYREY1DDVF/A7BN6vPHeJm/BEaKRjKFFRNFDGBmz8nZwV6WasibOqTkTCBpRzO7vqO2TmBsiKRNm+vzOKd/j6dd/TOMvRweqZ5XM3gDM9s32TGz20NQXTvIb8iZePBWYqEojFSnRCRxs1NxVI3q88IQ0f8rPJJ7IB7LkMXEEGw3Crha0n9IRbZncAHuUngKGCXPVe6yz1i1LHNnSSr03fc0RDN1REQPQ1hB/w/4U2jaCVgIT7F50MzWTclWoeTskGyikz7bUuZ6SY9n5i589bQuGYSV7mjaK/hNzewbObLtzNT1UBRR3NVI4ipQCarPCn0tZWb/lufCf4JzWe+GuzSuLmuOl9Snq/EIVXz3PRFRGUdENBjhIfJzPGcyHZnapTq2Fcbvj9fuTZTbQ8C5wKfAPGnFqxKUnMHE+y2ciCFdlH4QrhTWS8lW9tlWuK7zcN/2n8MYO+J5x/eEOd+Ukl0AD7RKmLFGAccWvAxcgZtbH+/s3GYlVILqs0JfM1+mJN1oZtuXOOfXee1mdlwX51Lad98TEc3UERGNx9W40toKjzrdE/hvVqggVWcSbqK9wDpZf9fMPsFNunlF2bMr4Ftp41kuwlthTtvS3hQ/GU8/+f/27jxMrrLM+/j3l4AkBAJGMOMCAoIsImFHI3AByjig4yuCOgqisooKuOA2bggM+oK+LqjI4oLiMiIggsoOEoIIJKwJOMyAviCIDmpAYVjCPX88T9GnT5/qquo61ae78/tcV67uOnXq1NOdpO7zbPddfO+xzNl2awZpFXNrVfWfSHOw/0xpyD4H3SPLF2hjB2BfSb8jDc2OloFrbdLce3mr0LjcaGVrAUsl1ZHqszhvMaLQRBvF4esZpOQpHVf5d6GXufspxz1js5op15tVYc9weYg1H/sSsDbDP3weIgWW2RHx1jG+/8uBoxm5QrrbD9t211058v7fPA+5TkTc0ubcEUO/vQwH96uXoKkeimVIuph0o3UUhRutqEhLOijdbPHq4VrFnvFY81uvAlwUEbv0+tqKaxWzzC0YZe5+ynHP2Kx+rRWs9+cVwPcBVXOp80sB+vxW0Ja0pHxyvlY5uFQNDX6D1GNdxPD6w8Vr9VxCEbgk70ddKV/7j5KuiepKTPdJ+jjD52zHtF1F0oci4gRJJ7Vp64gqVwyNTryGUUYn8ut7KdH3rIj4hqQjc/D7paRxHd6OiF+qy4xhGp6IpmUZcGt+zTxJD5FXeufvgZ6SyqxKStHZt0iZxcY9u9hE4GBsVr/jJK0BfAA4iTS3WhWwVmstoIG0mIa02hWgvH/266QPvV2B00l5e69r8/7LolSJqUJrCLeX/MxrRMRDkg4iVWv6lKTKnjEpJ/WnSLWPIc3ZvrnqxE7D9QwNgVatsG5nUEGz2xutgdHIjGGjrTo+kFQFqVXWcxfSjdT6ko6JivSkXbx/8QZuOml0p6/54nzdWrPMTTYOxmb1uzTP9y4jBc92PgBcrVThSMD6wLvyytZyXub5OWnDLRHxaaV0k+0C7hVKVZ7OYfic4uLC9/crpXX8dnRRvjBbSaks4htJ+anbas3ZKpUYjA6rte9i5HD9w6T0mKcBiyRtT1rd2+2K3UEFzW5vtAbpY8B25VXHQFUwXgnYNHImtNyj/g5pnvwqUu7sXhVv4J4EHuh3JXV2Al1mmZuKHIzN6nebpFblmQWk7UQjEkVExM8lbUTKKAUpo1Rr0VY54cKj+esjkp4LPAg8p83775C/blt8O1KGpeL7L5f0lKQ1qtpX4RjgovzzXC9pA+DOqhMlvYT0oT8nP/5vUorL2ypO7zRc/wDp97FJ7pUtJOW7vqZqdXTWddBUDzWdI+KC/G2nG61BmlYaln6QtCWpyjoxPCXpH/OxP0uqLNc5mnwDd1EMplzjAytqIAYHY7PaRcSGech5J9KK6q9K+mtEbFlx+jYMZVKaJ6ldJqULJK1JGp5cTAquI8oy5vfvJUh0W76QSMk9zio8vgtotxXmFOD9EXEF0Mo/fSowv+LcUYfrI+KofPwZpBuM+aRKUKfm3+tmFW3tJWh+QtJjUarpTMr2NUzuhR7MyOxXlYUXBqSXVcdXSrqAob+3vfOxWcBfe33jfAP3m+LfV416yTI35TgYm9VM0vNJK0J3Iu3hXUKqWlQ+r+tMShFxbP727PzhOqPcm5W0X0ScqaG6s+VrVKXdPIfqLF5VP1cvgWhWKxDnc1oBoEq3w/UzST3cNfKf+4Bb27T1RcDJwNyI2FzSFsBrI+K4itN7qel8Hmm041LaLI4btEi1rV9PdxnD3k0KwK0Vyt8Bzo60jWasPftnAkvy1qriDVxf1bNIf7fdZpmbcry1yaxmkp4iVbM5PiLOG+W82jIp5esdGhGnqMcsUTnIEhGVq40L511DCkTDVmlHda3mc0k9+Nac5H7ANhGxV5trr0L1cD2STiWtIn8Y+DWpms+1EfGXUdr6S+CDpP3aW+VjbWsvq/uazje1GeFYYdS5tap03TnlaQdJ60fE3f1cd7JwMDarmaR5pF7LzqQsVHcCv4yIb5TOqy2T0hjaKNJq5/eQ5htFWoxzUpvtUj0FIqV9yJ9meIrLo9sFUI1S+EDShaREF7eR5op/Bdw22k1MYc75xkIwHtZ+DRV0UP7aTU3n40hz1ZMiGcWgVyhLWgt4sI4bSkkLgT0i10ZWqmt8VrsbqKnGwdhsAJSS7u9IGqreDyAiXlA65wpgS9IWpX4zKRWv23E4OQ9l7wEc0up55AVZJwMXRsQXKq7bcyDqZjV1u+H6GJ6SU6Te8fz8Z3NS/u1fRcSIkQClnNvvIX2Yb61UX/nAiNij27aXrlcM3LNIW88eZ4Jvv1EPdbC7uNZLgc+Sfu/HkkY91iLdzO0fERf2ef1XkxK1vBrYmDSkvm9E3NTPdScLB2Ozmkm6AViF1Itr1WetyubU9XCfUkm5smXA78rbSroZTpZ0Iykp/3+XXrs2cHGrN1l67mFSIHqMtHWobSAqr6YG2q6m7mW4vjAfP5+0xeZZEbFmxXkbMLRg7C/A3aQP9qq/h72Ay1tz8Hmh3C4R8ZNO7Zno1EMd7C6udQPwr6T5+lNJvdhrJW1Cqj894t/MGN7jdaSAvDqwd0T8R7/XnCwcjM1qJmntTvOvY7jmtaRC7reQguDmpIVhawCHRUSxRnHH4eQO86dtn+uhvdcAHyutpj4+Ikaspu40XC/pCIZ6xE+QtzXlP7dGxFOjtGMWqef2CPAvEfG9inNG/L6Kw9ul4yJlE1s/Io6VtA7wnIhol4CldqrOmtZKknJcFCotKaVc/QdqWKFc/D1Juj0iNi08V/n76vK65cxqryDVrP5tbmtVhrUpx6upzWrWxUKoqyNiR40sQj/akOd9pGHWJfkam5H2/X6ItNr04sK5F0jas8Nw8uPdPqdUC/mONr3zYclECnpZTd2p8MF6pK057+s0vy5pNmkF8fNIK58vzY8/QLqRGRGMqd6j2+6z8WvAU6Q928eStoZ9laHUlOPhF6QRj+/nx/9Cys72B+DbDK+BXecK5eJNz6Ol5/rp1ZUzqw2iLviE556x2SRQ1VttHWuzMGnUeU1Jy6kuHi/StqmVC+eeGhGH5Dnusojq4gtdr6auc3WupPNIw9K/IvWwWguXjmw39yjpm6Q9t1/Nh94NzImIt1ecuzjPQRcXht0c41hzV6PUldYAi3EU/s2ItM3skdZTlP7NWO/cMzZriKTvRqkyU9WxbIlSPd8f5sdvIvUmV2Eo9SMAEbF6p/eOHnISR8Qh+Wsv+1IPIK2mPofUa1qQj1Vdv68tMSUbtIKRpNOB+4F1Y/RylIcDnyAVlgjgElJArvKEUhaqyO+xNsN7jONhuqTtW0PjkrYj5YiGtBocja24xqh6+TczFhpZbax1E9lXtbHJwsHYrCaqrpDztIp5uheXXr8SKSNXlbcD7wLemx8vJJXxe4JS8oZBzmtK2hzYjOGVo75TeL51M7F/pw/8MQ7Xd/L0jUmkbFH3dgjERMTfgY9ImpW/H82XScUv5kr6N1LBjo+PoZ39OAj4Zl6xL1LZzYPyNMBn8jljKa7RtI7VxqYyD1Ob1UTSt/K3zyYtNro8P96VtCXoNfm8j5JWpZaH+h4HTouIj/TZjpPJ85oRsWne83txlOopj+G6nyJV/dmMlH5xD1Ke6n0K5ywFXkma19wFhhWvbxWQGJjS8HtxOHW0ld/zSZWwVouIdZX2iR8aEe9q8x6bkIbABVxWx7ahsVDKvU10l1ccSdNIP+NDHU9ugKRfR8QOnc+cmhyMzWqmVID+ba3FRkqVjr4dEa8qnfeZiPhol9csD+EBUDWEN6h5zbyKdx5wY0TMU6oAdGZE7F445wjgMGAD4PcMD8Zthxzz0O/c0s9Wd+7jSpJ+Terh/jS6y9a1I7BRRHwrD1OvFuOYJSpPTezNyH3kI5K1SPo+qZ7zclJWuNnAlyLixHFpbA8kfZY03N622thU5mFqs/qtU1r1+wApE1fZ9uUDki6LiFdUnNvLEN6g5jUfjYinJD2ZVy3/EVineEJEfBn4sqSTI+Kwbi4q6XBSNrAHCu0MYIsa2tyViLgnje4/rfJ3nEcHtiUlpfgWsDJwJkO5n8fDeaStTIsoBK02NotUg3pf0mjFR/LrJlwwpstqY1OVg7FZ/S7TyKo6l7aelDSDtNp5rTyE3IoCs0lbcqosi1KZv1EMal7zhpwQ4zTSB/rfSKuWR+g2EGdHAhsX98eOs3vyUHVIWjm3p93QWwrhXQAAFM9JREFU817AVqSV4kTEfUpZxsbT8yPin7o8d+X8M70O+EpEPCFpQg6H9rhAcMpxMDarWUS8Jy/m2ikfKlfVOZS0EOu55A/17CHgK20ue4WkE+liCC8ividpEWleE+B1dcxrFuZQv66UL3p2RNzS73WBe0g9vaa8E/gS6Ubo96Q92+1WUz8eEdEKaKPsnR6kayS9JCIqK1aVnEJKnnEzcJWkF5D+nU0YGlllLEgZ264ez+H/pnnO2Kwhkg6PiJO6PLfrPb75/K1JubEDWFjHvFubpB+VKTm7vF7rQ/jFpGHfnzH8RqOq5GOjJB0FbATsTlq5fADw/W7/Hmtqw1JgQ1KKz8cYWpzWcVg/r7SfPpa/r0FRdZWxOcCrSMVFfljx/JTjYGxWM3VZKUfS/lWvL24VGuP7fxJ4A3B2fu/XkQomVNXy7eW6Xafk7PJ6laUeW6JNyce65N/TKG//dA3p1vkCnk8q9fiPpN/BRRFxyeBaOVLu3Y4QhbzbU6G3KWkOcGk5wclU5WBsVjN1WSknJ2RomUEaVl5c2iq0X0ScWfHhClT3HiX9BpjX2l8raSZwU0Rs3PtPM+y65wCfiDYpOaO6PGFRK3/yByLirn7aUgdJH6g4PAs4kFSAYrWK1wwsw1UnkmbnxVhzqp4vbhubKr1N9ZHzerLxnLFZ/R7oZo42Ig4vPs6Lo8ofkq05yV4WCd1HCu6tZBerkOZC+/WiViAGiIilSnmr7yqtRAb4InAvKX+ySPmTX0iaI/8maQ8yAJLOp33gPqVT0o6xiojPF9qwOmnh1jtIfwefb/OyxZK2i4jrB9GmDr5PqlS1iKFyji1B2k6WHrQZVWj1Nhn572zCkbQrKbXpCsE9Y7OaaYyVcvKq19tq6MH+hFS44BLSh/TupJrJ9+Z2jKkKjqR/J9WyLabkXAt4K2n4c7vCuSP2NSvn0C4/l39fazN89flDue2zozo9aC1ycHo/KWPZGaQ9uG0DgKQ7SHPGv2UoT3NX87WDJEnR5Yf5ROttqroK1RzSTeX+EXHH+Ldq/LlnbFa/rirllHqE00iZrX5UdcG8V/hgRiZ6qMr3fG7+03JlL40fxdvpMiUn8IikNwI/zo/3YainXv7gnV/KDna+pOsjYjtJSxiQvDr99aTavC+JiL+Ncu66OQnJq9qdM14kHRMRnyw8nkYqyLFvF6+diL3N15QeB/BgdE5NOqW4Z2zWEA2vVvQkaVXyvW3OvYZUbGFY0o+IOLvi3Bmk1bYA/zmoYd7RSNqAtF3oZaQP12tJSUt+T6redHXh3NuBV7Uybklal7QwatNB9uIkPUUauXiSDrmxVaiUJOnsiNh7EG3qhlLa1f+IiM/kbFw/ImVFO7pwjnubk4yDsVnNcjA8kLRlp1hQ4YDC8+8kBcxbgW902mqiUpnENuesBBxP2m7zO1JQWYeUKepjEfHEKC/vSNJGpO085UIRfVXVkbQn8HVSQXkB65N64FcCB0fEF/u5fh00PLVoo8O8eVX390j/dnYFfl7+HVWsuF4he5uTiYepzer3XeAO0pDmMaThw+KCrjNIQ7sLSMUWNiMtHhrNBZL2jIifj3LOiaSFXutHxMOQVuACn8t/Or1HJ98ipa38AikIvIM0vD5CL8PqEfHzHOg3yYd+U+jNNx6Is2jz/bgp7fP+Eimhx0JSMo+ti3vJi9ucbHJwz9isZq2ek6RbImKLvDBrQUS8ND//9PaY3Ju9rt1eysIWIZFWVj9GCuRVQ6l3klY8R+ka04E7ImKjPn+uRRGxTan9iyJiRNnHHofVB7Lfuk4aqgZVrAQFbfaQD6gNVYlfWtomgLHJwT1js/q1hoP/qlT/9w+kBCDl54mIJyu2BVF4vpctTVG1ojZSXd867rofy4uF7pT0HtL874i9uNmqEfHhLq9bXLz19H5rYMIE44iYPgHasELnbp7qHIzN6neqUgGIjwM/JQWsTxSenyeplR9YwMz8eLSau3sBl0euXZv3JO8SET8pnLZU0v7lHqWk/UjD5v06ElgVOAI4ljRU/bY253YzrA50vd96hdcu8UtLVQIYmzw8TG02CVQt4CovJJL0PNL2qUdJw8OQytHNBPaKiDoSf3Tb3ofpMKw+ymtr2W891TSdPtQGyz1js8mhaqHUsP+/OdjuIGk30kpuSCttLxt048p6GV4v7beeDmxKm/3WKzIH26nNPWOzSUDSN4G/Al/Nh94NzImItzfWqAo5PeYdqq7wVFnysZf91tZ565xNTg7GZjXKC5xeGhHX1HzdWaR551fmQ5cAx020faOSTo2IQ9qs/G274lfSXIYWcl0XEX8cWCMnOUlnkdYAvIXC1rmI6HfrmjXIwdisZk0nhRgUSV+uOLwMuCEiziudO6Oc+avqWD7+RtIe6StJc8s7AR+MiB+Xz12RSVopr74fdeucTU6eMzar32WS9iaVFazlbjf3NKu2LY3n3tIZpMQcZ+XHe5MK3M+TtGtEvLdw7jWk2sd0OAbwMWC7Vm84Jwy5lKG81pZcR/r9ddo6Z5OQg7FZ/Q4lVQJaLulR6kkMcVTh+xmkQDhqCs0B2AJ4eUQsB5B0Mimxx46k1IxI+gfgeaTtWlsxVOZvNmlbVJVppWHpB2mT2cuAzlvnbBJyMDarWY+JOrq95qLSoYWSrqv7fTp4JumDf1l+PIu0iGy5pFapyFeRqjs9Hyjue30Y+Nc2171Q0kUML6H4ixrbPVU8u7DX+B35a2tB36yK820ScTA2GwBJrwV2zg+vjIgL+rzenMLDacA2wBr9XHMMTgBuknQlqce7M3B8Xlx2KUBEnAGcIWnvqtSXVSLig5JeT+phA5waEeeO9poV1HTSzVBVyjYv/pnkvIDLrGaSPktaGfy9fOjNpEVOH+3jmnczlKP6SdJc7THFUoTjQdJzgO3zw+sj4r5Rzn01I7ffHFN4fkNgbkQsLL1uR+D+iPivOts+2RXLONrU456xWf32BLaMiKcAJJ0B3AiMORhHxPo1ta1f04A/kT47NpS0YURcVT5J0tdJc8S7AqcD+5AWIBV9kerfybL83D/X2O6poH0Sc5v0HIzNBmNN4M/5+76Hk/P2lcMoDH0Dp/Rbo7jHNvxf0nzuEuCpfDiAEcEYmJ+33dwSEZ+W9HlGzgPPjYhbyy+MiFslrVdfy6eMVzTdABscB2Oz+n0GuDFvR2rNrX6kz2ueDKwMfC0/fms+dlCf1+3F64CNI+Kxjmem/NgAj0h6LmmF9HNK56w5yutnjqF9U1pE/LnzWTZZORib1SwifpAXObUySn04Iv4wlmu1Ej2Q9uHOKzx1uaSb+2xqr+4i3RB0E4wvyNWXTiSVQwzScHXRDZIOjojTigclHcRQoQuzFYIXcJkNQGk19S8j4vwxXmdxRGwtaTHwhtaiJkkbAD8ezwU9ks4G5gGXUQjIEXFEh9etAsxolX8sHJ8LnAs8zvAqU88gVZka0w2M2WTknrFZzSpWUx8h6WUR0W6f7aiXy1+PAq6QdFd+vB5De03Hy0/zn7YkfSgiTsjfvyEizsrD2o9JOr74O4iIB4D5knYFNs+HfxYRlw+o/WYTlnvGZjWTdAvDV1NPB26MiC3GcK17GUqeMZO01xRgOfDoRCsoX9x+U96K4605Zu25Z2w2GHWtpm6X6GEloPZMX1Uk/Sgi3ijpVqrzYxdvMtTm+6rHZpY5GJvVr87V1PcXE2U0pFWa7zVdnBttvq96bGaZh6nNBiBnqirW5x3raupJVY5R0nLg76SbkJnAI62nSIu4Vm6qbWYTmYOxWU0kjTofGhGLx3DNOU3vL5X0MKP0avusRmVmeJjarE6fz19nkLbo3EzqEW4B3AC8rNcLNh2IcxtWB5B0LHA/8F3Sz7UvIxN5mNkYuGdsVjNJ5wCfaqV6zAXgj46IfZptWX8k3VxKPFJ5zMx65wLeZvXbuJhzOSJuAzZtsD11+bukfSVNlzRN0r6k+WEz65N7xmY1k/QDUpA6Mx/aF1gtIt7cXKv6l4s3fAl4OWkOeSHw3oj4bXOtMpsaHIzNaiZpBsMrLF0FnBwR/9Ncq8xsInMwNrNRtVJcSjqJ6qQfo+amNrPOvJrazDq5PX+9odFWmE1h7hmbmZk1zD1jswGRtGpEPNL5zIlN0vmMnvTjtePYHLMpycHYrGaS5gOnkwo8rCtpHnBoRLyr2ZaN2eeaboDZVOdharOaSfo1sA/w01ZeaUm3RcTmo7/SzFZU7hmbDUBE3CMNqxi4vKm29Ktd6URSSswYS51mMxvOwdisfvfkoeqQtDKpBOHtHV4zkXVTOtHM+uBharOaSVqLlKnqlaTe48XAkRHxYKMNq4GkuQwvDfnHJttjNlU4GJtZVyS9ETgRuJJ0k7ET8MGI+HGT7TKbChyMzWomaW3gYGA9ClNBEXFAU22qg6Sbgd1bveH8c17qqk1m/fOcsVn9zgMWAJcyiRduVZhWGpZ+EFd+M6uFg7FZ/VaNiA833YgBuFDSRcAP8uM3Ab9osD1mU4aHqc1qJuk44JqI+HnTbambpNcDO+aHCyLi3CbbYzZVOBib1UTSw6T9uAJmAY8BTzC0H3d2g80bM0kbAnMjYmHp+I7A/RHxX820zGzq8HyPWU0iYvWImJ2/TouImYXHkzIQZ18EHqo4viw/Z2Z9cjA2q5mky7o5NonMjYhbywfzsfXGvzlmU48XcJnVRNIM0vD0WpKeSRqeBpgNPK+xhvVvzVGemzlurTCbwhyMzepzKPBe4LnAIoaC8UPAV5pqVA1ukHRwRJxWPCjpINLPaWZ98gIus5pJOjwiTmq6HXXJKTDPBR5nKPhuCzwD2Csi/tBU28ymCgdjM+uKpF2BVhnIJRFxeZPtMZtKHIzNzMwa5tXUZmZmDfMCLrOaSdq64vAy4HcR8eR4t8fMJj4PU5vVTNK1wNbALaQV1ZsDS4A1gMMi4uIGm2dmE5CHqc3qdx+wVURsGxHbAFsBdwG7Ayc02jIzm5AcjM3q96KIWNJ6EBFLgU0i4q4G22RmE5jnjM3qt0TSycAP8+M3AUslrUIqHGFmNoznjM1qJmkm8C6GSg0uBL4G/A+p1vHfmmqbmU1MDsZmZmYN8zC1Wc0kvRw4GngBhf9jEbFBU20ys4nNPWOzmkm6A3gfKY/z8tbxiHiwsUaZ2YTmnrFZ/ZZFxC+aboSZTR7uGZvVTNJngenAOcBjreMRsbixRpnZhOZgbFYzSVdUHI6I2G3cG2Nmk4KDsZmZWcM8Z2xWE0n7RcSZkt5f9XxE/L/xbpOZTQ4Oxmb1mZW/rt5oK8xs0vEwtZmZWcPcMzarmaS1gYOB9Rie9OOAptpkZhObg7FZ/c4DFgCXUkj6YWbWjoepzWom6aaI2LLpdpjZ5OF6xmb1u0DSnk03wswmD/eMzWom6WHSyurH8x+Rkn7MbrRhZjZhORibmZk1zMPUZjVTsp+kT+TH60javul2mdnE5Z6xWc0knQw8BewWEZtKeiZwcURs13DTzGyC8tYms/rtEBFbS7oRICL+IukZTTfKzCYuD1Ob1e8JSdOBgKeTgDzVbJPMbCJzMDar35eBc4G5kv4NuBo4vtkmmdlE5jljswGQtAnwivzw8oi4vcn2mNnE5jljs8FYFWgNVc9suC1mNsF5mNqsZpI+CZwBzAHWAr4l6ePNtsrMJjIPU5vVTNJvgHkR8T/58UzgpojYuNmWmdlE5Z6xWf3uA2YUHq8C/L6htpjZJOCesVnNJP0E2A64hDRnvDtwHXAvQEQc0VzrzGwicjA2q5mkt432fEScMV5tMbPJwcHYrGaSZgAb5of/2Zo7NjNrx3PGZjWRtJKkE0jD0WcA3wHukXSCpJWbbZ2ZTWQOxmb1OZG0nWn9iNgmIrYGXgisCXyu0ZaZ2YTmYWqzmki6E3hRlP5T5TzVd0TERs20zMwmOveMzeoT5UCcDy4nF40wM6viYGxWn6WS9i8flLQfcEcD7TGzScLD1GY1kfQ84BzgUWBRPrwtKTf1XhHhxB9mVsnB2KxmknYDXpwfLo2Iy5psj5lNfA7GZmZmDfOcsZmZWcMcjM3MzBrmYGxm40bSckk3SbpN0lmSVu3jWt+WtE/+/nRJm41y7i6S5o/hPX4raa1uj5fO+VuP73W0pKN6baNNDQ7GZjaeHo2ILSNic+Bx4J3FJyWtNJaLRsRBEbF0lFN2AXoOxmbjxcHYzJqyANgw91oXSPopaa/2dEknSrpe0i2SDgVQ8hVJv5F0KfDs1oUkXSlp2/z9P0laLOlmSZdJWo8U9N+Xe+U7SVpb0tn5Pa6X9PL82mdJuljSEkmnA+r0Q0j6iaRF+TWHlJ77Qj5+maS187EXSrowv2aBpE3q+GXa5Damu1Azs37kHvAewIX50NbA5hFxdw5oyyJiO0mrAAslXQxsBWwMbAbMBZYC3yxdd23gNGDnfK05EfFnSV8H/hYRn8vnfR/4QkRcLWld4CJgU+BTwNURcYykVwMHdvHjHJDfYyZwvaSzI+JBYBZwQ0S8T9In87XfA5wKvDMi7pS0A/A1YLcx/BptCnEwNrPxNFPSTfn7BcA3SMPH10XE3fn4PwJbtOaDgTWAjYCdgR/k9KL3Sbq84vovBa5qXSsi/tymHa8ENpOe7vjOlrRafo/X59f+TNJfuviZjpC0V/5+ndzWB4GngH/Px88EzsnvMR84q/Deq3TxHjbFORib2Xh6NCK2LB7IQenvxUPA4RFxUem8PWtsxzTgpeVa04UA2RVJu5AC+8si4hFJVwIz2pwe+X3/Wv4dmHnO2MwmmouAw1o1oCW9SNIs4CrgTXlO+TnArhWvvRbYWdL6+bVz8vGHgdUL510MHN56IKkVHK8C3pKP7QE8s0Nb1wD+kgPxJqSeecs0oNW7fwtp+Psh4G5Jb8jvIUnzOryHrQAcjM1sojmdNB+8WNJtwCmkUbxzgTvzc98BflV+YUT8CTiENCR8M0PDxOcDe7UWcAFHANvmBWJLGVrV/WlSMF9CGq7+/x3aeiGwkqTbgc+SbgZa/g5sn3+G3YBj8vF9gQNz+5YA/6eL34lNcU6HaWZm1jD3jM3MzBrmYGxmZtYwB2MzM7OGORibmZk1zMHYzMysYQ7GZmZmDXMwNjMza9j/AplL2X+TUmhXAAAAAElFTkSuQmCC",
      "text/plain": [
       "<Figure size 432x288 with 2 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "from sklearn.metrics import confusion_matrix, ConfusionMatrixDisplay,ConfusionMatrixDisplay\n",
    "cm = confusion_matrix(df['label'], df['predicted'])\n",
    "disp = ConfusionMatrixDisplay(confusion_matrix=cm,display_labels=names)\n",
    "disp.plot(xticks_rotation='vertical')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [],
   "source": [
    "from os import listdir\n",
    "from os.path import isfile, join\n",
    "validation_path = \"test_set\"\n",
    "onlyfiles = [f for f in listdir(validation_path) if isfile(join(validation_path, f))]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "['video0029.mp4',\n",
       " 'video0023.mp4',\n",
       " 'video0054.mp4',\n",
       " 'video0050.mp4',\n",
       " 'video0179.mp4',\n",
       " 'video0209.mp4',\n",
       " 'video0038.mp4',\n",
       " 'video0169.mp4',\n",
       " 'video0141.mp4',\n",
       " 'video0233.mp4',\n",
       " 'video0154.mp4',\n",
       " 'video0090.mp4',\n",
       " 'video0092.mp4',\n",
       " 'video0063.mp4',\n",
       " 'video0110.mp4',\n",
       " 'video0022.mp4',\n",
       " 'video0188.mp4',\n",
       " 'video0117.mp4',\n",
       " 'video0077.mp4',\n",
       " 'video0087.mp4',\n",
       " 'video0032.mp4',\n",
       " 'video0145.mp4',\n",
       " 'video0088.mp4',\n",
       " 'video0098.mp4',\n",
       " 'video0198.mp4',\n",
       " 'video0005.mp4',\n",
       " 'video0189.mp4',\n",
       " 'video0210.mp4',\n",
       " 'video0224.mp4',\n",
       " 'video0159.mp4',\n",
       " 'video0046.mp4',\n",
       " 'video0089.mp4',\n",
       " 'video0195.mp4',\n",
       " 'video0231.mp4',\n",
       " 'video0218.mp4',\n",
       " 'video0144.mp4',\n",
       " 'video0119.mp4',\n",
       " 'video0105.mp4',\n",
       " 'video0151.mp4',\n",
       " 'video0150.mp4',\n",
       " 'video0086.mp4',\n",
       " 'video0148.mp4',\n",
       " 'video0125.mp4',\n",
       " 'video0237.mp4',\n",
       " 'video0216.mp4',\n",
       " 'video0001.mp4',\n",
       " 'video0134.mp4',\n",
       " 'video0011.mp4',\n",
       " 'video0017.mp4',\n",
       " 'video0109.mp4',\n",
       " 'video0043.mp4',\n",
       " 'video0149.mp4',\n",
       " 'video0031.mp4',\n",
       " 'video0018.mp4',\n",
       " 'video0239.mp4',\n",
       " 'video0168.mp4',\n",
       " 'video0115.mp4',\n",
       " 'video0245.mp4',\n",
       " 'video0121.mp4',\n",
       " 'video0006.mp4',\n",
       " 'video0083.mp4',\n",
       " 'video0009.mp4',\n",
       " 'video0111.mp4',\n",
       " 'video0003.mp4',\n",
       " 'video0202.mp4',\n",
       " 'video0177.mp4',\n",
       " 'video0107.mp4',\n",
       " 'video0213.mp4',\n",
       " 'video0118.mp4',\n",
       " 'video0024.mp4',\n",
       " 'video0030.mp4',\n",
       " 'video0173.mp4',\n",
       " 'video0019.mp4',\n",
       " 'video0249.mp4',\n",
       " 'video0008.mp4',\n",
       " 'video0065.mp4',\n",
       " 'video0200.mp4',\n",
       " 'video0164.mp4',\n",
       " 'video0037.mp4',\n",
       " 'video0058.mp4',\n",
       " 'video0126.mp4',\n",
       " 'video0175.mp4',\n",
       " 'video0163.mp4',\n",
       " 'video0114.mp4',\n",
       " 'video0240.mp4',\n",
       " 'video0162.mp4',\n",
       " 'video0062.mp4',\n",
       " 'video0170.mp4',\n",
       " 'video0156.mp4',\n",
       " 'video0000.mp4',\n",
       " 'video0066.mp4',\n",
       " 'video0093.mp4',\n",
       " 'video0044.mp4',\n",
       " 'video0215.mp4',\n",
       " 'video0079.mp4',\n",
       " 'video0039.mp4',\n",
       " 'video0113.mp4',\n",
       " 'video0247.mp4',\n",
       " 'video0016.mp4',\n",
       " 'video0020.mp4',\n",
       " 'video0219.mp4',\n",
       " 'video0203.mp4',\n",
       " 'video0128.mp4',\n",
       " 'video0230.mp4',\n",
       " 'video0069.mp4',\n",
       " 'video0160.mp4',\n",
       " 'video0232.mp4',\n",
       " 'video0080.mp4',\n",
       " 'video0204.mp4',\n",
       " 'video0047.mp4',\n",
       " 'video0186.mp4',\n",
       " 'video0045.mp4',\n",
       " 'video0197.mp4',\n",
       " 'video0034.mp4',\n",
       " 'video0212.mp4',\n",
       " 'video0201.mp4',\n",
       " 'video0180.mp4',\n",
       " 'video0059.mp4',\n",
       " 'video0120.mp4',\n",
       " 'video0130.mp4',\n",
       " 'video0060.mp4',\n",
       " 'video0085.mp4',\n",
       " 'video0102.mp4',\n",
       " 'video0028.mp4',\n",
       " 'video0132.mp4',\n",
       " 'video0099.mp4',\n",
       " 'video0191.mp4',\n",
       " 'video0176.mp4',\n",
       " 'video0007.mp4',\n",
       " 'video0167.mp4',\n",
       " 'video0127.mp4',\n",
       " 'video0187.mp4',\n",
       " 'video0161.mp4',\n",
       " 'video0040.mp4',\n",
       " 'video0138.mp4',\n",
       " 'video0035.mp4',\n",
       " 'video0053.mp4',\n",
       " 'video0075.mp4',\n",
       " 'video0221.mp4',\n",
       " 'video0027.mp4',\n",
       " 'video0076.mp4',\n",
       " 'video0112.mp4',\n",
       " 'video0012.mp4',\n",
       " 'video0205.mp4',\n",
       " 'video0081.mp4',\n",
       " 'video0241.mp4',\n",
       " 'video0143.mp4',\n",
       " 'video0068.mp4',\n",
       " 'video0036.mp4',\n",
       " 'video0025.mp4',\n",
       " 'video0190.mp4',\n",
       " 'video0071.mp4',\n",
       " 'video0135.mp4',\n",
       " 'video0222.mp4',\n",
       " 'video0136.mp4',\n",
       " 'video0026.mp4',\n",
       " 'video0211.mp4',\n",
       " 'video0082.mp4',\n",
       " 'video0055.mp4',\n",
       " 'video0182.mp4',\n",
       " 'video0184.mp4',\n",
       " 'video0052.mp4',\n",
       " 'video0228.mp4',\n",
       " 'video0033.mp4',\n",
       " 'video0183.mp4',\n",
       " 'video0129.mp4',\n",
       " 'video0051.mp4',\n",
       " 'video0157.mp4',\n",
       " 'video0048.mp4',\n",
       " 'video0181.mp4',\n",
       " 'video0155.mp4',\n",
       " 'video0133.mp4',\n",
       " 'video0049.mp4',\n",
       " 'video0021.mp4',\n",
       " 'video0091.mp4',\n",
       " 'video0116.mp4',\n",
       " 'video0139.mp4',\n",
       " 'video0172.mp4',\n",
       " 'video0225.mp4',\n",
       " 'video0199.mp4',\n",
       " 'video0056.mp4',\n",
       " 'video0152.mp4',\n",
       " 'video0246.mp4',\n",
       " 'video0101.mp4',\n",
       " 'video0207.mp4',\n",
       " 'video0103.mp4',\n",
       " 'video0010.mp4',\n",
       " 'video0073.mp4',\n",
       " 'video0067.mp4',\n",
       " 'video0214.mp4',\n",
       " 'video0146.mp4',\n",
       " 'video0014.mp4',\n",
       " 'video0131.mp4',\n",
       " 'video0235.mp4',\n",
       " 'video0074.mp4',\n",
       " 'video0196.mp4',\n",
       " 'video0072.mp4',\n",
       " 'video0070.mp4',\n",
       " 'video0229.mp4',\n",
       " 'video0178.mp4',\n",
       " 'video0042.mp4',\n",
       " 'video0064.mp4',\n",
       " 'video0004.mp4',\n",
       " 'video0100.mp4',\n",
       " 'video0238.mp4',\n",
       " 'video0227.mp4',\n",
       " 'video0041.mp4',\n",
       " 'video0217.mp4',\n",
       " 'video0094.mp4',\n",
       " 'video0248.mp4',\n",
       " 'video0123.mp4',\n",
       " 'video0171.mp4',\n",
       " 'video0095.mp4',\n",
       " 'video0244.mp4',\n",
       " 'video0206.mp4',\n",
       " 'video0243.mp4',\n",
       " 'video0147.mp4',\n",
       " 'video0097.mp4',\n",
       " 'video0193.mp4',\n",
       " 'video0140.mp4',\n",
       " 'video0015.mp4',\n",
       " 'video0165.mp4',\n",
       " 'video0057.mp4',\n",
       " 'video0124.mp4',\n",
       " 'video0166.mp4',\n",
       " 'video0220.mp4',\n",
       " 'video0137.mp4',\n",
       " 'video0078.mp4',\n",
       " 'video0084.mp4',\n",
       " 'video0096.mp4',\n",
       " 'video0223.mp4',\n",
       " 'video0226.mp4',\n",
       " 'video0104.mp4',\n",
       " 'video0194.mp4',\n",
       " 'video0142.mp4',\n",
       " 'video0236.mp4',\n",
       " 'video0158.mp4',\n",
       " 'video0208.mp4',\n",
       " 'video0192.mp4',\n",
       " 'video0106.mp4',\n",
       " 'video0122.mp4',\n",
       " 'video0002.mp4',\n",
       " 'video0242.mp4',\n",
       " 'video0108.mp4',\n",
       " 'video0153.mp4',\n",
       " 'video0234.mp4',\n",
       " 'video0174.mp4',\n",
       " 'video0185.mp4',\n",
       " 'video0061.mp4',\n",
       " 'video0013.mp4']"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "onlyfiles"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [],
   "source": [
    "# model.load_state_dict(torch.load('videomae-icsr-heart/checkpoint-5000/pytorch_model.bin'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [],
   "source": [
    "# eval_results = {}\n",
    "# for video in onlyfiles:\n",
    "#     videoreader = VideoReader(validation_path + \"/\" + video, num_threads=1, ctx=cpu(0))\n",
    "#     videoreader.seek(0)\n",
    "#     indices = np.linspace(0, len(videoreader), num=128)\n",
    "#     indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "#     inputs = []\n",
    "#     inputs.append(feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0])\n",
    "#     inputs = torch.stack(inputs)\n",
    "# #     print(inputs)\n",
    "#     output = model(inputs.to(device='cuda'))\n",
    "# #     print(names[torch.argmax(output['logits']).item()])\n",
    "#     eval_results[video] = torch.argmax(output['logits']).item()\n",
    "# eval_results\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "1cf2ac75288e4d87bbeafea3cf2954db",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "  0%|          | 0/250 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "ename": "DECORDError",
     "evalue": "[11:27:42] /github/workspace/src/video/video_reader.cc:151: Check failed: st_nb >= 0 (-1381258232 vs. 0) ERROR cannot find video stream with wanted index: -1",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mDECORDError\u001b[0m                               Traceback (most recent call last)",
      "Cell \u001b[0;32mIn [49], line 6\u001b[0m\n\u001b[1;32m      4\u001b[0m \u001b[38;5;28;01mfor\u001b[39;00m video \u001b[38;5;129;01min\u001b[39;00m tqdm(onlyfiles):\n\u001b[1;32m      5\u001b[0m     eval_estimations[video] \u001b[38;5;241m=\u001b[39m []\n\u001b[0;32m----> 6\u001b[0m     videoreader \u001b[38;5;241m=\u001b[39m \u001b[43mVideoReader\u001b[49m\u001b[43m(\u001b[49m\u001b[43mvalidation_path\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m+\u001b[39;49m\u001b[43m \u001b[49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[38;5;124;43m/\u001b[39;49m\u001b[38;5;124;43m\"\u001b[39;49m\u001b[43m \u001b[49m\u001b[38;5;241;43m+\u001b[39;49m\u001b[43m \u001b[49m\u001b[43mvideo\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mnum_threads\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[38;5;241;43m1\u001b[39;49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mctx\u001b[49m\u001b[38;5;241;43m=\u001b[39;49m\u001b[43mcpu\u001b[49m\u001b[43m(\u001b[49m\u001b[38;5;241;43m0\u001b[39;49m\u001b[43m)\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m      7\u001b[0m     videoreader\u001b[38;5;241m.\u001b[39mseek(\u001b[38;5;241m0\u001b[39m)\n\u001b[1;32m      8\u001b[0m     file_size \u001b[38;5;241m=\u001b[39m \u001b[38;5;28mlen\u001b[39m(videoreader)\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/decord/video_reader.py:54\u001b[0m, in \u001b[0;36mVideoReader.__init__\u001b[0;34m(self, uri, ctx, width, height, num_threads, fault_tol)\u001b[0m\n\u001b[1;32m     51\u001b[0m     \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_handle \u001b[38;5;241m=\u001b[39m _CAPI_VideoReaderGetVideoReader(\n\u001b[1;32m     52\u001b[0m         ba, ctx\u001b[38;5;241m.\u001b[39mdevice_type, ctx\u001b[38;5;241m.\u001b[39mdevice_id, width, height, num_threads, \u001b[38;5;241m2\u001b[39m, fault_tol)\n\u001b[1;32m     53\u001b[0m \u001b[38;5;28;01melse\u001b[39;00m:\n\u001b[0;32m---> 54\u001b[0m     \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_handle \u001b[38;5;241m=\u001b[39m \u001b[43m_CAPI_VideoReaderGetVideoReader\u001b[49m\u001b[43m(\u001b[49m\n\u001b[1;32m     55\u001b[0m \u001b[43m        \u001b[49m\u001b[43muri\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mctx\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdevice_type\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mctx\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mdevice_id\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mwidth\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mheight\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mnum_threads\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[38;5;241;43m0\u001b[39;49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mfault_tol\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m     56\u001b[0m \u001b[38;5;28;01mif\u001b[39;00m \u001b[38;5;28mself\u001b[39m\u001b[38;5;241m.\u001b[39m_handle \u001b[38;5;129;01mis\u001b[39;00m \u001b[38;5;28;01mNone\u001b[39;00m:\n\u001b[1;32m     57\u001b[0m     \u001b[38;5;28;01mraise\u001b[39;00m \u001b[38;5;167;01mRuntimeError\u001b[39;00m(\u001b[38;5;124m\"\u001b[39m\u001b[38;5;124mError reading \u001b[39m\u001b[38;5;124m\"\u001b[39m \u001b[38;5;241m+\u001b[39m uri \u001b[38;5;241m+\u001b[39m \u001b[38;5;124m\"\u001b[39m\u001b[38;5;124m...\u001b[39m\u001b[38;5;124m\"\u001b[39m)\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/decord/_ffi/_ctypes/function.py:173\u001b[0m, in \u001b[0;36mFunctionBase.__call__\u001b[0;34m(self, *args)\u001b[0m\n\u001b[1;32m    171\u001b[0m ret_val \u001b[38;5;241m=\u001b[39m DECORDValue()\n\u001b[1;32m    172\u001b[0m ret_tcode \u001b[38;5;241m=\u001b[39m ctypes\u001b[38;5;241m.\u001b[39mc_int()\n\u001b[0;32m--> 173\u001b[0m \u001b[43mcheck_call\u001b[49m\u001b[43m(\u001b[49m\u001b[43m_LIB\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mDECORDFuncCall\u001b[49m\u001b[43m(\u001b[49m\n\u001b[1;32m    174\u001b[0m \u001b[43m    \u001b[49m\u001b[38;5;28;43mself\u001b[39;49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mhandle\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mvalues\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mtcodes\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mctypes\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mc_int\u001b[49m\u001b[43m(\u001b[49m\u001b[43mnum_args\u001b[49m\u001b[43m)\u001b[49m\u001b[43m,\u001b[49m\n\u001b[1;32m    175\u001b[0m \u001b[43m    \u001b[49m\u001b[43mctypes\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mbyref\u001b[49m\u001b[43m(\u001b[49m\u001b[43mret_val\u001b[49m\u001b[43m)\u001b[49m\u001b[43m,\u001b[49m\u001b[43m \u001b[49m\u001b[43mctypes\u001b[49m\u001b[38;5;241;43m.\u001b[39;49m\u001b[43mbyref\u001b[49m\u001b[43m(\u001b[49m\u001b[43mret_tcode\u001b[49m\u001b[43m)\u001b[49m\u001b[43m)\u001b[49m\u001b[43m)\u001b[49m\n\u001b[1;32m    176\u001b[0m _ \u001b[38;5;241m=\u001b[39m temp_args\n\u001b[1;32m    177\u001b[0m _ \u001b[38;5;241m=\u001b[39m args\n",
      "File \u001b[0;32m~/.local/lib/python3.8/site-packages/decord/_ffi/base.py:78\u001b[0m, in \u001b[0;36mcheck_call\u001b[0;34m(ret)\u001b[0m\n\u001b[1;32m     76\u001b[0m         err_str \u001b[38;5;241m=\u001b[39m err_str\u001b[38;5;241m.\u001b[39msplit(\u001b[38;5;124m'\u001b[39m\u001b[38;5;124mStack trace\u001b[39m\u001b[38;5;124m'\u001b[39m)[\u001b[38;5;241m0\u001b[39m]\u001b[38;5;241m.\u001b[39mstrip()\n\u001b[1;32m     77\u001b[0m     \u001b[38;5;28;01mraise\u001b[39;00m DECORDLimitReachedError(err_str)\n\u001b[0;32m---> 78\u001b[0m \u001b[38;5;28;01mraise\u001b[39;00m DECORDError(err_str)\n",
      "\u001b[0;31mDECORDError\u001b[0m: [11:27:42] /github/workspace/src/video/video_reader.cc:151: Check failed: st_nb >= 0 (-1381258232 vs. 0) ERROR cannot find video stream with wanted index: -1"
     ]
    }
   ],
   "source": [
    "eval_results = {}\n",
    "eval_labels = {}\n",
    "eval_estimations = {}\n",
    "for video in tqdm(onlyfiles):\n",
    "    eval_estimations[video] = []\n",
    "    videoreader = VideoReader(validation_path + \"/\" + video, num_threads=1, ctx=cpu(0))\n",
    "    videoreader.seek(0)\n",
    "    file_size = len(videoreader)\n",
    "    batches = int(file_size/16)\n",
    "    input_list = []\n",
    "    for i in range(batches):\n",
    "        indices = np.linspace(i, len(videoreader)-batches+i, num=16)\n",
    "        indices = np.clip(indices, 0, len(videoreader)- 1).astype(np.int64)\n",
    "        inputs = []\n",
    "        inputs.append(feature_extractor(list(videoreader.get_batch(indices).asnumpy()), return_tensors=\"pt\")['pixel_values'][0])\n",
    "        input_list.append(torch.stack(inputs))\n",
    "#     print(len(input_list))\n",
    "    results = []\n",
    "    for frame_seq in input_list:\n",
    "        output = model(frame_seq.to(device='cuda'))\n",
    "        eval_estimations[video].append(output['logits'])\n",
    "        output = torch.argmax(output['logits']).item()\n",
    "        results.append(output)\n",
    "#     print(np.bincount(results).argmax())\n",
    "    eval_results[video] = [np.bincount(results).argmax()]\n",
    "    eval_labels[video] = results\n",
    "#     print(names[torch.argmax(output['logits']).item()])\n",
    "    \n",
    "eval_results\n",
    "    "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "video0000.mp4, predicted Writing vs real Wiping a table, 18 vs 8, Posible cases: [8, 18, 8, 18, 8, 18, 18, 18, 18]\n",
      "video0003.mp4, predicted Freehand exercise vs real Coughing or sneezing, 11 vs 7, Posible cases: [1, 1, 1, 1, 11, 11, 11, 11, 11]\n",
      "video0009.mp4, predicted Touching a hot surface vs real Unknown activity, 2 vs 19, Posible cases: [2, 2, 2, 2, 2, 2, 2, 2, 2]\n",
      "video0011.mp4, predicted Brushing teeth vs real Freehand exercise, 17 vs 11, Posible cases: [17, 17, 17, 17, 17, 17, 17, 17, 17]\n",
      "video0014.mp4, predicted Eating food with a fork vs real Talking on the phone, 6 vs 14, Posible cases: [6, 6, 6, 6, 6, 6, 6, 6, 6]\n",
      "video0015.mp4, predicted Limping vs real Colliding against something, 13 vs 5, Posible cases: [13, 13, 13, 13, 13, 13, 13, 13, 13]\n",
      "video0019.mp4, predicted Lying down vs real Falling down, 12 vs 16, Posible cases: [12, 12, 12, 12, 12, 12, 12, 12, 12]\n",
      "video0022.mp4, predicted Opening the door and walking in/out vs real Colliding against something, 0 vs 5, Posible cases: [0, 0, 0, 0, 0, 0, 16, 16, 0]\n",
      "video0025.mp4, predicted Falling down vs real Colliding against something, 16 vs 5, Posible cases: [16, 16, 16, 16, 16, 16, 16, 16, 16]\n",
      "video0026.mp4, predicted Coughing or sneezing vs real Eating food with a fork, 7 vs 6, Posible cases: [7, 7, 15, 15, 7, 7, 7, 7, 7, 15]\n",
      "video0027.mp4, predicted Using a computer vs real Writing, 15 vs 18, Posible cases: [15, 15, 15, 15, 15, 15, 15, 15]\n",
      "video0030.mp4, predicted Brushing teeth vs real Talking on the phone, 17 vs 14, Posible cases: [17, 17, 17, 17, 17, 17, 17, 17, 17]\n",
      "video0031.mp4, predicted Coughing or sneezing vs real Limping, 7 vs 13, Posible cases: [7, 7, 7, 7, 7, 12, 12, 12, 12]\n",
      "video0034.mp4, predicted Lying down vs real Colliding against something, 12 vs 5, Posible cases: [16, 12, 12, 12, 12, 12, 12, 12, 12]\n",
      "video0035.mp4, predicted Talking on the phone vs real Reading a book, 14 vs 9, Posible cases: [15, 14, 14, 14, 14, 14, 14, 14, 14, 15, 14, 14, 14]\n",
      "video0041.mp4, predicted Writing vs real Wiping a table, 18 vs 8, Posible cases: [18, 18, 17, 18, 18, 18, 17, 17, 17]\n",
      "video0043.mp4, predicted Putting on a jacket vs real Freehand exercise, 1 vs 11, Posible cases: [1, 1, 1, 1, 1, 1, 1, 1, 1]\n",
      "video0044.mp4, predicted Brushing teeth vs real Neck roll exercise, 17 vs 10, Posible cases: [17, 17, 17, 17, 17, 17, 17, 17, 17]\n",
      "video0046.mp4, predicted Limping vs real Coughing or sneezing, 13 vs 7, Posible cases: [13, 13, 13, 13, 4, 4, 4, 4, 13]\n",
      "video0048.mp4, predicted Talking on the phone vs real Reading a book, 14 vs 9, Posible cases: [14, 14, 14, 14, 14, 14, 14, 14, 14]\n",
      "video0050.mp4, predicted Writing vs real Coughing or sneezing, 18 vs 7, Posible cases: [18, 18, 18, 18, 18, 18, 12, 17, 17]\n",
      "video0053.mp4, predicted Limping vs real Using a computer, 13 vs 15, Posible cases: [13, 9, 15, 15, 13, 13, 13, 9, 13, 13]\n",
      "video0057.mp4, predicted Lying down vs real Talking on the phone, 12 vs 14, Posible cases: [12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12]\n",
      "video0059.mp4, predicted Brushing teeth vs real Freehand exercise, 17 vs 11, Posible cases: [17, 17, 17, 17, 17, 17, 17, 17, 17]\n",
      "video0060.mp4, predicted Drinking water vs real Freehand exercise, 4 vs 11, Posible cases: [4, 4, 4, 4, 4, 4, 4, 4, 4]\n",
      "video0066.mp4, predicted Opening the fridge vs real Touching a hot surface, 3 vs 2, Posible cases: [3, 3, 3, 3, 3, 3, 3, 3, 3]\n",
      "video0075.mp4, predicted Touching a hot surface vs real Unknown activity, 2 vs 19, Posible cases: [2, 2, 2, 2, 2, 2, 2]\n",
      "video0079.mp4, predicted Brushing teeth vs real Neck roll exercise, 17 vs 10, Posible cases: [17, 17, 17, 17, 10, 17, 17, 17, 17]\n",
      "video0082.mp4, predicted Putting on a jacket vs real Coughing or sneezing, 1 vs 7, Posible cases: [1, 1, 1, 1, 1, 1, 1, 1, 1]\n",
      "video0088.mp4, predicted Eating food with a fork vs real Wiping a table, 6 vs 8, Posible cases: [6, 6, 6, 6, 6, 6, 6, 6, 6]\n",
      "video0089.mp4, predicted Touching a hot surface vs real Wiping a table, 2 vs 8, Posible cases: [2, 2, 2, 2, 2, 2, 2, 2, 2]\n",
      "video0091.mp4, predicted Falling down vs real Coughing or sneezing, 16 vs 7, Posible cases: [16, 16, 16, 16, 16, 16, 16, 16, 16]\n",
      "video0093.mp4, predicted Opening the fridge vs real Touching a hot surface, 3 vs 2, Posible cases: [3, 3, 3, 3, 3, 3, 3, 3, 3]\n",
      "video0094.mp4, predicted Lying down vs real Limping, 12 vs 13, Posible cases: [12, 12, 12, 12, 12, 12, 12, 17, 12]\n",
      "video0096.mp4, predicted Limping vs real Colliding against something, 13 vs 5, Posible cases: [13, 13, 13, 13, 13, 13, 16, 16, 13]\n",
      "video0097.mp4, predicted Limping vs real Colliding against something, 13 vs 5, Posible cases: [13, 13, 13, 13, 13, 13, 13, 13, 13]\n",
      "video0102.mp4, predicted Eating food with a fork vs real Drinking water, 6 vs 4, Posible cases: [6, 6, 6, 6, 6, 6, 6, 6]\n",
      "video0107.mp4, predicted Limping vs real Unknown activity, 13 vs 19, Posible cases: [13, 13, 13, 13, 13, 13, 13]\n",
      "video0109.mp4, predicted Limping vs real Colliding against something, 13 vs 5, Posible cases: [13, 13, 13, 13, 13, 13, 13, 13, 13]\n",
      "video0110.mp4, predicted Coughing or sneezing vs real Eating food with a fork, 7 vs 6, Posible cases: [7, 7, 7, 7, 7, 7, 7, 7, 7, 7]\n",
      "video0112.mp4, predicted Eating food with a fork vs real Lying down, 6 vs 12, Posible cases: [16, 16, 12, 12, 12, 6, 6, 6, 6]\n",
      "video0114.mp4, predicted Drinking water vs real Freehand exercise, 4 vs 11, Posible cases: [4, 4, 4, 4, 4, 4, 4, 4, 4]\n",
      "video0117.mp4, predicted Brushing teeth vs real Freehand exercise, 17 vs 11, Posible cases: [17, 17, 17, 17, 17, 17, 17, 17, 17]\n",
      "video0118.mp4, predicted Lying down vs real Talking on the phone, 12 vs 14, Posible cases: [12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12, 12]\n",
      "video0119.mp4, predicted Eating food with a fork vs real Talking on the phone, 6 vs 14, Posible cases: [6, 6, 6, 6, 6, 6, 14, 6, 6]\n",
      "video0121.mp4, predicted Opening the fridge vs real Touching a hot surface, 3 vs 2, Posible cases: [3, 3, 3, 3, 3, 3, 3, 3, 3]\n",
      "video0125.mp4, predicted Colliding against something vs real Unknown activity, 5 vs 19, Posible cases: [5, 5, 5, 1, 1, 5, 5]\n",
      "video0129.mp4, predicted Opening the door and walking in/out vs real Limping, 0 vs 13, Posible cases: [0, 0, 0, 0, 0, 0, 0, 0, 0]\n",
      "video0131.mp4, predicted Drinking water vs real Neck roll exercise, 4 vs 10, Posible cases: [4, 4, 4, 4, 4, 4, 4, 13, 13]\n",
      "video0135.mp4, predicted Lying down vs real Limping, 12 vs 13, Posible cases: [12, 12, 12, 12, 12, 12, 12, 12, 12]\n"
     ]
    }
   ],
   "source": [
    "for x in dict(sorted(eval_results.items(), key=lambda item: item)).keys():\n",
    "    if eval_results[x] != validation_labels[x][0]:\n",
    "        print(f'{x}, predicted {names[eval_results[x]]} vs real {names[validation_labels[x][0]]}, {eval_results[x]} vs {validation_labels[x][0]}, Posible cases: {eval_labels[x]}')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "tensor([[ -7.1302, -15.0484, -12.1665,  -9.0507,  -1.7132,  -7.9959,   4.8482,\n",
       "          -6.6244,  10.4697,  -7.1200,  -3.9928,  -7.8140,  -0.8858,  -8.7205,\n",
       "           4.7883,   7.2673,  -8.6436,  -4.5161,  10.7741, -11.0969]],\n",
       "       device='cuda:0', grad_fn=<SumBackward1>)"
      ]
     },
     "execution_count": 85,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "torch.stack(eval_estimations['video0000.mp4'], dim=0).sum(dim=0)\n",
    "# for result in range(len(eval_estimations['video0000.mp4'])):\n",
    "#     print(eval_estimations['video0000.mp4'][result] ,eval_labels['video0000.mp4'][result])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [],
   "source": [
    "for x in eval_results.keys():\n",
    "    eval_results[x] = \"[\" + str(eval_results[x]) + \"]\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'video0029.mp4': '[9]',\n",
       " 'video0023.mp4': '[15]',\n",
       " 'video0054.mp4': '[17]',\n",
       " 'video0050.mp4': '[11]',\n",
       " 'video0038.mp4': '[18]',\n",
       " 'video0090.mp4': '[2]',\n",
       " 'video0092.mp4': '[16]',\n",
       " 'video0063.mp4': '[3]',\n",
       " 'video0110.mp4': '[7]',\n",
       " 'video0022.mp4': '[5]',\n",
       " 'video0117.mp4': '[7]',\n",
       " 'video0077.mp4': '[6]',\n",
       " 'video0087.mp4': '[3]',\n",
       " 'video0032.mp4': '[0]',\n",
       " 'video0088.mp4': '[6]',\n",
       " 'video0098.mp4': '[4]',\n",
       " 'video0005.mp4': '[16]',\n",
       " 'video0046.mp4': '[5]',\n",
       " 'video0089.mp4': '[19]',\n",
       " 'video0119.mp4': '[14]',\n",
       " 'video0105.mp4': '[16]',\n",
       " 'video0086.mp4': '[17]',\n",
       " 'video0125.mp4': '[1]',\n",
       " 'video0001.mp4': '[18]',\n",
       " 'video0134.mp4': '[9]',\n",
       " 'video0011.mp4': '[19]',\n",
       " 'video0017.mp4': '[8]',\n",
       " 'video0109.mp4': '[5]',\n",
       " 'video0043.mp4': '[7]',\n",
       " 'video0031.mp4': '[7]',\n",
       " 'video0018.mp4': '[15]',\n",
       " 'video0115.mp4': '[1]',\n",
       " 'video0121.mp4': '[3]',\n",
       " 'video0006.mp4': '[4]',\n",
       " 'video0083.mp4': '[0]',\n",
       " 'video0009.mp4': '[2]',\n",
       " 'video0111.mp4': '[10]',\n",
       " 'video0003.mp4': '[11]',\n",
       " 'video0107.mp4': '[0]',\n",
       " 'video0118.mp4': '[12]',\n",
       " 'video0024.mp4': '[3]',\n",
       " 'video0030.mp4': '[14]',\n",
       " 'video0019.mp4': '[16]',\n",
       " 'video0008.mp4': '[1]',\n",
       " 'video0065.mp4': '[17]',\n",
       " 'video0037.mp4': '[1]',\n",
       " 'video0058.mp4': '[17]',\n",
       " 'video0126.mp4': '[4]',\n",
       " 'video0114.mp4': '[4]',\n",
       " 'video0062.mp4': '[6]',\n",
       " 'video0000.mp4': '[8]',\n",
       " 'video0066.mp4': '[3]',\n",
       " 'video0093.mp4': '[3]',\n",
       " 'video0044.mp4': '[10]',\n",
       " 'video0079.mp4': '[10]',\n",
       " 'video0039.mp4': '[9]',\n",
       " 'video0113.mp4': '[17]',\n",
       " 'video0016.mp4': '[3]',\n",
       " 'video0020.mp4': '[15]',\n",
       " 'video0128.mp4': '[6]',\n",
       " 'video0069.mp4': '[3]',\n",
       " 'video0080.mp4': '[4]',\n",
       " 'video0047.mp4': '[10]',\n",
       " 'video0045.mp4': '[2]',\n",
       " 'video0034.mp4': '[5]',\n",
       " 'video0059.mp4': '[19]',\n",
       " 'video0120.mp4': '[7]',\n",
       " 'video0130.mp4': '[0]',\n",
       " 'video0060.mp4': '[4]',\n",
       " 'video0085.mp4': '[3]',\n",
       " 'video0102.mp4': '[4]',\n",
       " 'video0028.mp4': '[16]',\n",
       " 'video0132.mp4': '[14]',\n",
       " 'video0099.mp4': '[18]',\n",
       " 'video0007.mp4': '[15]',\n",
       " 'video0127.mp4': '[4]',\n",
       " 'video0040.mp4': '[6]',\n",
       " 'video0035.mp4': '[6]',\n",
       " 'video0053.mp4': '[15]',\n",
       " 'video0075.mp4': '[2]',\n",
       " 'video0027.mp4': '[15]',\n",
       " 'video0076.mp4': '[4]',\n",
       " 'video0112.mp4': '[16]',\n",
       " 'video0012.mp4': '[4]',\n",
       " 'video0081.mp4': '[16]',\n",
       " 'video0068.mp4': '[18]',\n",
       " 'video0036.mp4': '[12]',\n",
       " 'video0025.mp4': '[16]',\n",
       " 'video0071.mp4': '[12]',\n",
       " 'video0135.mp4': '[7]',\n",
       " 'video0026.mp4': '[6]',\n",
       " 'video0082.mp4': '[7]',\n",
       " 'video0055.mp4': '[4]',\n",
       " 'video0052.mp4': '[13]',\n",
       " 'video0033.mp4': '[6]',\n",
       " 'video0129.mp4': '[0]',\n",
       " 'video0051.mp4': '[5]',\n",
       " 'video0048.mp4': '[10]',\n",
       " 'video0133.mp4': '[2]',\n",
       " 'video0049.mp4': '[4]',\n",
       " 'video0021.mp4': '[1]',\n",
       " 'video0091.mp4': '[16]',\n",
       " 'video0116.mp4': '[8]',\n",
       " 'video0056.mp4': '[14]',\n",
       " 'video0101.mp4': '[1]',\n",
       " 'video0103.mp4': '[10]',\n",
       " 'video0010.mp4': '[14]',\n",
       " 'video0073.mp4': '[15]',\n",
       " 'video0067.mp4': '[15]',\n",
       " 'video0014.mp4': '[6]',\n",
       " 'video0131.mp4': '[4]',\n",
       " 'video0074.mp4': '[17]',\n",
       " 'video0072.mp4': '[17]',\n",
       " 'video0070.mp4': '[13]',\n",
       " 'video0042.mp4': '[11]',\n",
       " 'video0064.mp4': '[18]',\n",
       " 'video0004.mp4': '[18]',\n",
       " 'video0100.mp4': '[4]',\n",
       " 'video0041.mp4': '[6]',\n",
       " 'video0094.mp4': '[13]',\n",
       " 'video0123.mp4': '[17]',\n",
       " 'video0095.mp4': '[16]',\n",
       " 'video0097.mp4': '[5]',\n",
       " 'video0015.mp4': '[13]',\n",
       " 'video0057.mp4': '[12]',\n",
       " 'video0124.mp4': '[0]',\n",
       " 'video0078.mp4': '[9]',\n",
       " 'video0084.mp4': '[0]',\n",
       " 'video0096.mp4': '[5]',\n",
       " 'video0104.mp4': '[9]',\n",
       " 'video0106.mp4': '[15]',\n",
       " 'video0122.mp4': '[18]',\n",
       " 'video0002.mp4': '[10]',\n",
       " 'video0108.mp4': '[6]',\n",
       " 'video0061.mp4': '[9]',\n",
       " 'video0013.mp4': '[0]'}"
      ]
     },
     "execution_count": 61,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "eval_results"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "collapsed_sections": [],
   "provenance": []
  },
  "gpuClass": "standard",
  "kernelspec": {
   "display_name": "Python 3.8.10 64-bit",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.10"
  },
  "vscode": {
   "interpreter": {
    "hash": "916dbcbb3f70747c44a77c7bcd40155683ae19c65e1c03b4aa3499c5328201f1"
   }
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "017e3f0a45c942e29b0fc432dca2ffc8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_55742a800669463d81d67456044285cb",
      "placeholder": "​",
      "style": "IPY_MODEL_77d5ea8f038c4dd48d16cd885b00629a",
      "value": "Downloading: 100%"
     }
    },
    "028465bf497d4737a5384f6f7c58200a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_462f437cc6144a7982a6dc89bd6f2a90",
      "placeholder": "​",
      "style": "IPY_MODEL_21e17f19d8c84ababf07dd94864f53e5",
      "value": "Downloading data files: 100%"
     }
    },
    "03b78f48e2ba4253b34d0946d5b40e15": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "045cd9695f3e479fb21048b39abfc18b": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "08301e86bd1745f28af465f1b9f9d050": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "09e0443823d54f578af5cf635b7b3715": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_ae9b118bc353457ab8e6c21208a8d57b",
       "IPY_MODEL_bfe6a0d505be48b888ea13cdc0d56447",
       "IPY_MODEL_bcea670e5b234125a4d801fafe8928f7"
      ],
      "layout": "IPY_MODEL_045cd9695f3e479fb21048b39abfc18b"
     }
    },
    "0dd258e5733e4584a0031bfa3a1e9392": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "0e8d7313d9f24c49821bb81bb013a925": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5100f2875c724d10b1801c55084c33ab",
      "placeholder": "​",
      "style": "IPY_MODEL_32ea79387ae845cea889c436ffabd9e1",
      "value": " 1/1 [00:00&lt;00:00, 17.77it/s]"
     }
    },
    "107b16ef81554781856cd67a6ae038da": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1144746deacc4c07aa06c81906f6ce77": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_4a2741e1b02749f5887bf798ee8e21d6",
      "placeholder": "​",
      "style": "IPY_MODEL_52e6c6ed71eb427b88df2e3fbf5b87c1",
      "value": ""
     }
    },
    "13d7e978cba64a3cbb9bd0e9bb50ecbc": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1649a5747b8c48e58c4508a9906fea8f": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_0dd258e5733e4584a0031bfa3a1e9392",
      "placeholder": "​",
      "style": "IPY_MODEL_7e251276f132481e886901a9c0fa5562",
      "value": "Downloading data files: 100%"
     }
    },
    "17b6f0610cee47e1a33f2b54edc3631e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_1a8775c21a7f466c944c790277a34326",
      "placeholder": "​",
      "style": "IPY_MODEL_9b00cff2e12c4886b3f6cf1e6879d725",
      "value": " 22.9k/22.9k [00:00&lt;00:00, 62.7kB/s]"
     }
    },
    "1a8775c21a7f466c944c790277a34326": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1af7e067011a4854a1e5f97624b230cd": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "1f6a6b3791e54b56bb5b7f2f0ba812d9": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_1649a5747b8c48e58c4508a9906fea8f",
       "IPY_MODEL_e2eafd1b4cfa4965bf05c9caa0ea4595",
       "IPY_MODEL_e3ac5081836d40f797a5305f1429175e"
      ],
      "layout": "IPY_MODEL_5ebfc1a0964a4af7a600afb7904c8e0b"
     }
    },
    "20589c5d2372402e99f4c1406659c0ee": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "20fb65d2eee24bbb8d74fec87df215e6": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": "20px"
     }
    },
    "21cf114acd51449da8bb1532a5f18f8b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_ddbbe0f725de4361bb71b756f749a215",
      "placeholder": "​",
      "style": "IPY_MODEL_d251f651ebf24f6da07d1735559818b6",
      "value": "Extracting data files: 100%"
     }
    },
    "21e17f19d8c84ababf07dd94864f53e5": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "24270d9757e247669e9ca2105a727cb8": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2436895f138e4ae59b4ab936287554ed": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "24fbf1047b6c4180815d2ea167d17252": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "28828f3642a24b7984ed84748aa83c1d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_cb03eff0750d46bca00a21f58e81f841",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_dc0071c2fe704b7e8042069d1b6db79d",
      "value": 1
     }
    },
    "295a086f553e46ecb8eb8b2c9b56916b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_fbdb8309e4654b6c839127fdb5e29cf0",
      "max": 22865,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_b698e60171154efabc766b47d2d7c486",
      "value": 22865
     }
    },
    "29aae51c7130465f97ce90491f0c9696": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_d20cd3c0c8484cf8a4581619bfd061fb",
      "placeholder": "​",
      "style": "IPY_MODEL_c0b8d07504094fd3b4dc918fe80d5099",
      "value": ""
     }
    },
    "2e37ade3222b47b4bb3d9566dc862117": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "2f6043f91b71453ab2b7ac628c04e556": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "3197fad62a9d4d289c40772bfe021d7f": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "32ea79387ae845cea889c436ffabd9e1": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "33da8b0d87a14575aa6f65b46f803bd2": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_13d7e978cba64a3cbb9bd0e9bb50ecbc",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_20589c5d2372402e99f4c1406659c0ee",
      "value": 1
     }
    },
    "3519c3abbb684bae90a994f8a089d4ff": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "35929e7e4214489b8559a583fd28d171": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "373864a337c048778aacc3218f0aa5eb": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_679fc76bd85144659d03c25ea1cf67b1",
      "max": 271,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_e193535750a84ec0b98ab5077a6b5aa5",
      "value": 271
     }
    },
    "431c07b2e7ed4dbf9014c67d306945f8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_028465bf497d4737a5384f6f7c58200a",
       "IPY_MODEL_d9b6dbfb87fd4c469058532892cf7a09",
       "IPY_MODEL_cc31d15c0a584eb2af3b23c6db3d2503"
      ],
      "layout": "IPY_MODEL_77033cd66ad340acbbdaeb82aa47591c"
     }
    },
    "45af82f6eb18460784ab055d93f280ef": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "info",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_20fb65d2eee24bbb8d74fec87df215e6",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_e6bcacc7468d430990aebd786bd5db3c",
      "value": 1
     }
    },
    "462f437cc6144a7982a6dc89bd6f2a90": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "47c46c504521428d9bf84e798fde8937": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "4a2741e1b02749f5887bf798ee8e21d6": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "4a4bd6bca11747dab469e933548c31c8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_03b78f48e2ba4253b34d0946d5b40e15",
      "placeholder": "​",
      "style": "IPY_MODEL_ba01c404bddf435eba574cd35aa411e0",
      "value": " 1/1 [00:00&lt;00:00,  9.30ba/s]"
     }
    },
    "5100f2875c724d10b1801c55084c33ab": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "51379fdebbaf4587b5cabb85d4fb8faa": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "52e6c6ed71eb427b88df2e3fbf5b87c1": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "55742a800669463d81d67456044285cb": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5bcc6cfea7be4f3f8171f64ee9f44e17": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5ebfc1a0964a4af7a600afb7904c8e0b": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5f2c37ea11f24e96864754cb94c6c5dd": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "5f879ff41f624a7ba425b9e28646ab58": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "60a8726cf933422db26f755d9c5623d1": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_017e3f0a45c942e29b0fc432dca2ffc8",
       "IPY_MODEL_373864a337c048778aacc3218f0aa5eb",
       "IPY_MODEL_8f7ad298e78848c4918602274ddd45d1"
      ],
      "layout": "IPY_MODEL_2e37ade3222b47b4bb3d9566dc862117"
     }
    },
    "622ef2865684418eb481e799c337c523": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "6372d32e9b8c4efb9e212a376a4c7947": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_1144746deacc4c07aa06c81906f6ce77",
       "IPY_MODEL_45af82f6eb18460784ab055d93f280ef",
       "IPY_MODEL_c6d60b6c586f484ebc402f5d44cc2f7a"
      ],
      "layout": "IPY_MODEL_7e0fd7d1189048f09ad63b0d6f5e7783"
     }
    },
    "6687dc570dc74feba3bd2413c408eb76": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "679fc76bd85144659d03c25ea1cf67b1": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "68141e3ab39b40169949a3576477a42b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "69f8d2bece1e4bc4987f81c63d82aded": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_24fbf1047b6c4180815d2ea167d17252",
      "placeholder": "​",
      "style": "IPY_MODEL_6687dc570dc74feba3bd2413c408eb76",
      "value": " 346M/346M [00:19&lt;00:00, 19.2MB/s]"
     }
    },
    "6c590b31f3b043a4a2dcc3bacb742452": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "7121d94ad31140a5a9d6b88edd690aa9": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "71bfa349d37c4717bb34bb93e8779bd8": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "7254dc86b6714a81b46997dc132360e0": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "73578108cdb24b4586b123f9271e2fdf": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "743fdc0668b44aa2a79d9c64b1e2d08d": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "7478c6eda4694875a8dcfb3b59676f26": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "77033cd66ad340acbbdaeb82aa47591c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "77c5c395d16247cf9bd2a0d4e7a216f9": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_29aae51c7130465f97ce90491f0c9696",
       "IPY_MODEL_bfa55478d7ed4d629c85c76d44c08a3c",
       "IPY_MODEL_d1f5438cbf314ffaaecc473f9922ee70"
      ],
      "layout": "IPY_MODEL_e9045bde9871448a863b44559d114a5a"
     }
    },
    "77d5ea8f038c4dd48d16cd885b00629a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "781aceb284cf4bb192dde0fd2b731079": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "7b96d51d2819479c9adf009d0d1b6710": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_e6b09c270dac4dc19263fe6596985c0c",
      "placeholder": "​",
      "style": "IPY_MODEL_cae454ab61954479a24dad6620b3d937",
      "value": " 1/1 [00:00&lt;00:00, 10.45ba/s]"
     }
    },
    "7e0fd7d1189048f09ad63b0d6f5e7783": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": "hidden",
      "width": null
     }
    },
    "7e251276f132481e886901a9c0fa5562": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "7e98903f8faf4030a3b46fb8b744b5e5": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "811ee525a96b49b1819473a5ccdc01a6": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "81aa9067dbd94f979c23bc64897a3eab": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "824d814cdeea438798bd18426092fe41": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "87fea88df3494c8592b5de4485bcf8a7": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "8f7ad298e78848c4918602274ddd45d1": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5bcc6cfea7be4f3f8171f64ee9f44e17",
      "placeholder": "​",
      "style": "IPY_MODEL_a533fd53359e42548409f60ac412c7ba",
      "value": " 271/271 [00:00&lt;00:00, 2.61kB/s]"
     }
    },
    "9024ea625a284800811b19d7a0e26079": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_bfbbfff4a70e4d7183742f5e5118f6bb",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_c74dd5761ca349ed9eba8b7073484ae7",
      "value": 1
     }
    },
    "95889cc921824cfd90c53b7454175378": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "9a9d479f3065407d88be6ca2b12abffa": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "9b00cff2e12c4886b3f6cf1e6879d725": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "9e90e00ea181485c8ac420e32b989f08": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_fa4749f5fa94493a9ab3e9f218922106",
       "IPY_MODEL_b7ff863729484b8fbb5fbc6a8c791e3e",
       "IPY_MODEL_69f8d2bece1e4bc4987f81c63d82aded"
      ],
      "layout": "IPY_MODEL_1af7e067011a4854a1e5f97624b230cd"
     }
    },
    "a06160cdb0be42c2af5f55ec835e44ff": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_811ee525a96b49b1819473a5ccdc01a6",
      "placeholder": "​",
      "style": "IPY_MODEL_6c590b31f3b043a4a2dcc3bacb742452",
      "value": "Downloading: 100%"
     }
    },
    "a07073612892430e94915351ad1c32e2": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "a533fd53359e42548409f60ac412c7ba": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "ae9b118bc353457ab8e6c21208a8d57b": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_24270d9757e247669e9ca2105a727cb8",
      "placeholder": "​",
      "style": "IPY_MODEL_7e98903f8faf4030a3b46fb8b744b5e5",
      "value": "Extracting data files: 100%"
     }
    },
    "b56c2b116f4e43a89dcb1597f69deea2": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_95889cc921824cfd90c53b7454175378",
      "placeholder": "​",
      "style": "IPY_MODEL_35929e7e4214489b8559a583fd28d171",
      "value": "Creating json from Arrow format: 100%"
     }
    },
    "b698e60171154efabc766b47d2d7c486": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "b7ff863729484b8fbb5fbc6a8c791e3e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_87fea88df3494c8592b5de4485bcf8a7",
      "max": 346198861,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_f04bb6ab61ee477c8a02719eeab23dff",
      "value": 346198861
     }
    },
    "b9ecdecdc0af4ed5a8b14fe484eff014": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_fa915a0ccb534634b3b580fb3cb09c16",
       "IPY_MODEL_9024ea625a284800811b19d7a0e26079",
       "IPY_MODEL_7b96d51d2819479c9adf009d0d1b6710"
      ],
      "layout": "IPY_MODEL_a07073612892430e94915351ad1c32e2"
     }
    },
    "ba01c404bddf435eba574cd35aa411e0": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "bcea670e5b234125a4d801fafe8928f7": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_107b16ef81554781856cd67a6ae038da",
      "placeholder": "​",
      "style": "IPY_MODEL_68141e3ab39b40169949a3576477a42b",
      "value": " 1/1 [00:00&lt;00:00, 22.97it/s]"
     }
    },
    "bd9d32c5d158420990bf82ffb68f48c9": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_a06160cdb0be42c2af5f55ec835e44ff",
       "IPY_MODEL_295a086f553e46ecb8eb8b2c9b56916b",
       "IPY_MODEL_17b6f0610cee47e1a33f2b54edc3631e"
      ],
      "layout": "IPY_MODEL_9a9d479f3065407d88be6ca2b12abffa"
     }
    },
    "bfa55478d7ed4d629c85c76d44c08a3c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "info",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_fcaf3755cdc44224a46a32762fcae938",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_c59ef23f2be94dcba663c347779c860a",
      "value": 1
     }
    },
    "bfbbfff4a70e4d7183742f5e5118f6bb": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "bfe6a0d505be48b888ea13cdc0d56447": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_743fdc0668b44aa2a79d9c64b1e2d08d",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_7254dc86b6714a81b46997dc132360e0",
      "value": 1
     }
    },
    "c0b8d07504094fd3b4dc918fe80d5099": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "c59ef23f2be94dcba663c347779c860a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "c6d60b6c586f484ebc402f5d44cc2f7a": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3519c3abbb684bae90a994f8a089d4ff",
      "placeholder": "​",
      "style": "IPY_MODEL_51379fdebbaf4587b5cabb85d4fb8faa",
      "value": " 0/? [00:00&lt;?, ? tables/s]"
     }
    },
    "c74dd5761ca349ed9eba8b7073484ae7": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "cae454ab61954479a24dad6620b3d937": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "cafb90a4897b49028fbbcfe6b981e385": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "cb03eff0750d46bca00a21f58e81f841": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "cc31d15c0a584eb2af3b23c6db3d2503": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5f879ff41f624a7ba425b9e28646ab58",
      "placeholder": "​",
      "style": "IPY_MODEL_824d814cdeea438798bd18426092fe41",
      "value": " 1/1 [00:00&lt;00:00, 34.65it/s]"
     }
    },
    "d1f5438cbf314ffaaecc473f9922ee70": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_781aceb284cf4bb192dde0fd2b731079",
      "placeholder": "​",
      "style": "IPY_MODEL_81aa9067dbd94f979c23bc64897a3eab",
      "value": " 0/? [00:00&lt;?, ? tables/s]"
     }
    },
    "d20cd3c0c8484cf8a4581619bfd061fb": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "d251f651ebf24f6da07d1735559818b6": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "DescriptionStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "DescriptionStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "description_width": ""
     }
    },
    "d9b6dbfb87fd4c469058532892cf7a09": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_47c46c504521428d9bf84e798fde8937",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_08301e86bd1745f28af465f1b9f9d050",
      "value": 1
     }
    },
    "dc0071c2fe704b7e8042069d1b6db79d": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "ddbbe0f725de4361bb71b756f749a215": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "e193535750a84ec0b98ab5077a6b5aa5": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "e2eafd1b4cfa4965bf05c9caa0ea4595": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "FloatProgressModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "FloatProgressModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "ProgressView",
      "bar_style": "success",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_3197fad62a9d4d289c40772bfe021d7f",
      "max": 1,
      "min": 0,
      "orientation": "horizontal",
      "style": "IPY_MODEL_71bfa349d37c4717bb34bb93e8779bd8",
      "value": 1
     }
    },
    "e3ac5081836d40f797a5305f1429175e": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_5f2c37ea11f24e96864754cb94c6c5dd",
      "placeholder": "​",
      "style": "IPY_MODEL_2f6043f91b71453ab2b7ac628c04e556",
      "value": " 1/1 [00:00&lt;00:00, 31.83it/s]"
     }
    },
    "e6b09c270dac4dc19263fe6596985c0c": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "e6bcacc7468d430990aebd786bd5db3c": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "e79a955f009e447ea03841ebd51f5475": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_b56c2b116f4e43a89dcb1597f69deea2",
       "IPY_MODEL_28828f3642a24b7984ed84748aa83c1d",
       "IPY_MODEL_4a4bd6bca11747dab469e933548c31c8"
      ],
      "layout": "IPY_MODEL_73578108cdb24b4586b123f9271e2fdf"
     }
    },
    "e9045bde9871448a863b44559d114a5a": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": "hidden",
      "width": null
     }
    },
    "f04bb6ab61ee477c8a02719eeab23dff": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "ProgressStyleModel",
     "state": {
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "ProgressStyleModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "StyleView",
      "bar_color": null,
      "description_width": ""
     }
    },
    "fa4749f5fa94493a9ab3e9f218922106": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_cafb90a4897b49028fbbcfe6b981e385",
      "placeholder": "​",
      "style": "IPY_MODEL_622ef2865684418eb481e799c337c523",
      "value": "Downloading: 100%"
     }
    },
    "fa915a0ccb534634b3b580fb3cb09c16": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HTMLModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HTMLModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HTMLView",
      "description": "",
      "description_tooltip": null,
      "layout": "IPY_MODEL_7121d94ad31140a5a9d6b88edd690aa9",
      "placeholder": "​",
      "style": "IPY_MODEL_2436895f138e4ae59b4ab936287554ed",
      "value": "Creating json from Arrow format: 100%"
     }
    },
    "fbdb8309e4654b6c839127fdb5e29cf0": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": null
     }
    },
    "fcaf3755cdc44224a46a32762fcae938": {
     "model_module": "@jupyter-widgets/base",
     "model_module_version": "1.2.0",
     "model_name": "LayoutModel",
     "state": {
      "_model_module": "@jupyter-widgets/base",
      "_model_module_version": "1.2.0",
      "_model_name": "LayoutModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/base",
      "_view_module_version": "1.2.0",
      "_view_name": "LayoutView",
      "align_content": null,
      "align_items": null,
      "align_self": null,
      "border": null,
      "bottom": null,
      "display": null,
      "flex": null,
      "flex_flow": null,
      "grid_area": null,
      "grid_auto_columns": null,
      "grid_auto_flow": null,
      "grid_auto_rows": null,
      "grid_column": null,
      "grid_gap": null,
      "grid_row": null,
      "grid_template_areas": null,
      "grid_template_columns": null,
      "grid_template_rows": null,
      "height": null,
      "justify_content": null,
      "justify_items": null,
      "left": null,
      "margin": null,
      "max_height": null,
      "max_width": null,
      "min_height": null,
      "min_width": null,
      "object_fit": null,
      "object_position": null,
      "order": null,
      "overflow": null,
      "overflow_x": null,
      "overflow_y": null,
      "padding": null,
      "right": null,
      "top": null,
      "visibility": null,
      "width": "20px"
     }
    },
    "fec838d6713444ff837f6f340502adb9": {
     "model_module": "@jupyter-widgets/controls",
     "model_module_version": "1.5.0",
     "model_name": "HBoxModel",
     "state": {
      "_dom_classes": [],
      "_model_module": "@jupyter-widgets/controls",
      "_model_module_version": "1.5.0",
      "_model_name": "HBoxModel",
      "_view_count": null,
      "_view_module": "@jupyter-widgets/controls",
      "_view_module_version": "1.5.0",
      "_view_name": "HBoxView",
      "box_style": "",
      "children": [
       "IPY_MODEL_21cf114acd51449da8bb1532a5f18f8b",
       "IPY_MODEL_33da8b0d87a14575aa6f65b46f803bd2",
       "IPY_MODEL_0e8d7313d9f24c49821bb81bb013a925"
      ],
      "layout": "IPY_MODEL_7478c6eda4694875a8dcfb3b59676f26"
     }
    }
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}