notebooks/deepseek-r1/deepseek-r1.ipynb

{
 "cells": [
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# LLM reasoning with DeepSeek-R1 distilled models\n",
    "\n",
    "[DeepSeek-R1](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/DeepSeek_R1.pdf) is an open-source reasoning model developed by DeepSeek to address tasks requiring logical inference, mathematical problem-solving, and real-time decision-making. With DeepSeek-R1, you can follow its logic, making it easier to understand and, if necessary, challenge its output. This capability gives reasoning models an edge in fields where outcomes need to be explainable, like research or complex decision-making.\n",
    "\n",
    "Distillation in AI creates smaller, more efficient models from larger ones, preserving much of their reasoning power while reducing computational demands. DeepSeek applied this technique to create a suite of distilled models from R1, using Qwen and Llama architectures. That allows us to try DeepSeek-R1 capability locally on usual laptops.\n",
    "\n",
    "In this tutorial, we consider how to run DeepSeek-R1 distilled models using OpenVINO.\n",
    "\n",
    "#### Table of contents:\n",
    "\n",
    "- [Prerequisites](#Prerequisites)\n",
    "- [Select model for inference](#Select-model-for-inference)\n",
    "- [Convert model using Optimum-CLI tool](#Convert-model-using-Optimum-CLI-tool)\n",
    "    - [Weights Compression using Optimum-CLI](#Weights-Compression-using-Optimum-CLI)\n",
    "- [Instantiate pipeline with OpenVINO Generate API](#Instantiate-pipeline-with-OpenVINO-Generate-API)\n",
    "- [Run Chatbot](#Run-Chatbot)\n",
    "\n",
    "\n",
    "### Installation Instructions\n",
    "\n",
    "This is a self-contained example that relies solely on its own code.\n",
    "\n",
    "We recommend  running the notebook in a virtual environment. You only need a Jupyter server to start.\n",
    "For details, please refer to [Installation Guide](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/README.md#-installation-guide).\n",
    "\n",
    "<img referrerpolicy=\"no-referrer-when-downgrade\" src=\"https://static.scarf.sh/a.png?x-pxid=5b5a4db0-7875-4bfb-bdbd-01698b5b1a77&file=notebooks/deepseek-r1/deepseek-r1.ipynb\" />\n"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Prerequisites\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "\n",
    "Install required dependencies"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "import platform\n",
    "\n",
    "os.environ[\"GIT_CLONE_PROTECTION_ACTIVE\"] = \"false\"\n",
    "\n",
    "%pip install -q -U --pre \"openvino>=2024.6.0\" openvino-tokenizers openvino-genai --extra-index-url https://storage.openvinotoolkit.org/simple/wheels/nightly\n",
    "%pip install -q --extra-index-url https://download.pytorch.org/whl/cpu\\\n",
    "\"git+https://github.com/huggingface/optimum-intel.git\"\\\n",
    "\"nncf==2.14.1\"\\\n",
    "\"torch>=2.1\"\\\n",
    "\"datasets\" \\\n",
    "\"accelerate\" \\\n",
    "\"gradio>=4.19\" \\\n",
    "\"transformers>=4.43.1\" \\\n",
    "\"huggingface-hub>=0.26.5\" \\\n",
    "\"einops\" \"tiktoken\"\n",
    "\n",
    "if platform.system() == \"Darwin\":\n",
    "    %pip install -q \"numpy<2.0.0\""
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/ea/work/py311/lib/python3.11/site-packages/openvino/runtime/__init__.py:10: DeprecationWarning: The `openvino.runtime` module is deprecated and will be removed in the 2026.0 release. Please replace `openvino.runtime` with `openvino`.\n",
      "  warnings.warn(\n"
     ]
    }
   ],
   "source": [
    "import requests\n",
    "from pathlib import Path\n",
    "\n",
    "if not Path(\"llm_config.py\").exists():\n",
    "    r = requests.get(url=\"https://raw.githubusercontent.com/openvinotoolkit/openvino_notebooks/latest/utils/notebook_utils.py\")\n",
    "    open(\"llm_config.py\", \"w\").write(r.text)\n",
    "\n",
    "if not Path(\"notebook_utils.py\").exists():\n",
    "    r = requests.get(url=\"https://raw.githubusercontent.com/openvinotoolkit/openvino_notebooks/latest/utils/notebook_utils.py\")\n",
    "    open(\"notebook_utils.py\", \"w\").write(r.text)\n",
    "\n",
    "if not Path(\"genai_helper.py\").exists():\n",
    "    r = requests.get(url=\"https://raw.githubusercontent.com/openvinotoolkit/openvino_notebooks/latest/utils/genai_helper.py\")\n",
    "    open(\"genai_helper.py\", \"w\").write(r.text)\n",
    "\n",
    "# Read more about telemetry collection at https://github.com/openvinotoolkit/openvino_notebooks?tab=readme-ov-file#-telemetry\n",
    "from notebook_utils import collect_telemetry\n",
    "\n",
    "collect_telemetry(\"deepseek-r1.ipynb\")"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Select model for inference\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "The tutorial supports different models, you can select one from the provided options to compare the quality of open source LLM solutions.\n",
    "Model conversion and optimization is time- and memory-consuming process.  For your convenience, we provide a [collection](https://huggingface.co/collections/OpenVINO/llm-6687aaa2abca3bbcec71a9bd) of optimized models on HuggingFace hub. You can skip the model conversion step by selecting one of the available on HuggingFace hub model. If you want to reproduce optimization process locally, please unset **Use preconverted models** checkbox.\n",
    "\n",
    "* **DeepSeek-R1-Distill-Llama-8B** is a distilled model based on [Llama-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B), that prioritizes high performance and advanced reasoning capabilities, particularly excelling in tasks requiring mathematical and factual precision. Check [model card](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Llama-8B) for more info. Note: this model can also be accelerated with [FastDraft](../../supplementary_materials/notebooks/fastdraft-deepseek/fastdraft_deepseek.ipynb).\n",
    "* **DeepSeek-R1-Distill-Qwen-1.5B** is the smallest DeepSeek-R1 distilled model based on [Qwen2.5-Math-1.5B](https://huggingface.co/Qwen/Qwen2.5-Math-1.5B). Despite its compact size, the model demonstrates strong capabilities in solving basic mathematical tasks, at the same time its programming capabilities are limited. Check [model card](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B) for more info.\n",
    "* **DeepSeek-R1-Distill-Qwen-7B** is a distilled model based on [Qwen-2.5-Math-7B](https://huggingface.co/Qwen/Qwen2.5-Math-7B). The model demonstrates a good balance between mathematical and factual reasoning and can be less suited for complex coding tasks. Check [model card](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-7B) for more info.\n",
    "* **DeepSeek-R1-Distil-Qwen-14B** is a distilled model based on [Qwen2.5-14B](https://huggingface.co/Qwen/Qwen2.5-14B) that has great competence in factual reasoning and solving complex mathematical tasks.  Check [model card](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-14B) for more info.\n",
    "* **DeepSeek-R1-Distil-Qwen-32B** is a distilled model based on [Qwen2.5-32B](https://huggingface.co/Qwen/Qwen2.5-32B) that has comparable capability as OpenAI o1-mini. Check [model card](https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-32B) for more info. As the original model size is about 65GB, to quantize it to INT4 requires 32GB of RAM with 200GB for Swap File and another 200GB storage to save the models. The INT4 quantized model has about 16GB in size and requires 32GB of RAM when performing inference on CPU or 64GB of RAM on iGPU.\n",
    "\n",
    "[Weight compression](https://docs.openvino.ai/2024/openvino-workflow/model-optimization-guide/weight-compression.html) is a technique for enhancing the efficiency of models, especially those with large memory requirements. This method reduces the model’s memory footprint, a crucial factor for Large Language Models (LLMs). We provide several options for model weight compression:\n",
    "\n",
    "* **FP16** reducing model binary size on disk using `save_model` with enabled compression weights to FP16 precision. This approach is available in OpenVINO from scratch and is the default behavior.\n",
    "* **INT8** is an 8-bit weight-only quantization provided by [NNCF](https://github.com/openvinotoolkit/nncf): This method compresses weights to an 8-bit integer data type, which balances model size reduction and accuracy, making it a versatile option for a broad range of applications.\n",
    "* **INT4** is an 4-bit weight-only quantization provided by [NNCF](https://github.com/openvinotoolkit/nncf). involves quantizing weights to an unsigned 4-bit integer symmetrically around a fixed zero point of eight (i.e., the midpoint between zero and 15). in case of **symmetric quantization** or asymmetrically with a non-fixed zero point, in case of **asymmetric quantization** respectively. Compared to INT8 compression, INT4 compression improves performance even more, but introduces a minor drop in prediction quality. INT4 it ideal for situations where speed is prioritized over an acceptable trade-off against accuracy.\n",
    "* **INT4 AWQ** is an 4-bit activation-aware weight quantization. [Activation-aware Weight Quantization](https://arxiv.org/abs/2306.00978) (AWQ) is an algorithm that tunes model weights for more accurate INT4 compression. It slightly improves generation quality of compressed LLMs, but requires significant additional time for tuning weights on a calibration dataset. We will use `wikitext-2-raw-v1/train` subset of the [Wikitext](https://huggingface.co/datasets/Salesforce/wikitext) dataset for calibration.\n",
    "* **INT4 NPU-friendly** is an 4-bit channel-wise quantization. This approach is [recommended](https://docs.openvino.ai/2024/learn-openvino/llm_inference_guide/genai-guide-npu.html) for LLM inference using NPU."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "ced96f2a29aa4f4e9ec8a7300c371438",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Dropdown(description='Device:', options=('CPU', 'AUTO'), value='CPU')"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from notebook_utils import device_widget\n",
    "\n",
    "device = device_widget(default=\"CPU\")\n",
    "\n",
    "device"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {
    "test_replace": {
     "get_llm_selection_widget(device=device.value)": "get_llm_selection_widget(device=device.value, default_model_idx=0)"
    }
   },
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "4dc192a4ca5e41a6a4fbeda96c832bd4",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Box(children=(Box(children=(Label(value='Language:'), Dropdown(options=('English', 'Chinese'), value='English'…"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from llm_config import get_llm_selection_widget\n",
    "\n",
    "form, lang, model_id_widget, compression_variant, use_preconverted = get_llm_selection_widget(device=device.value)\n",
    "\n",
    "form"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Selected model DeepSeek-R1-Distill-Qwen-1.5B with INT4 compression\n"
     ]
    }
   ],
   "source": [
    "model_configuration = model_id_widget.value\n",
    "model_id = model_id_widget.label\n",
    "print(f\"Selected model {model_id} with {compression_variant.value} compression\")"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Convert model using Optimum-CLI tool\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "🤗 [Optimum Intel](https://huggingface.co/docs/optimum/intel/index) is the interface between the 🤗 [Transformers](https://huggingface.co/docs/transformers/index) and [Diffusers](https://huggingface.co/docs/diffusers/index) libraries and OpenVINO to accelerate end-to-end pipelines on Intel architectures. It provides ease-to-use cli interface for exporting models to [OpenVINO Intermediate Representation (IR)](https://docs.openvino.ai/2024/documentation/openvino-ir-format.html) format.\n",
    "\n",
    "<details>\n",
    "  <summary><b>Click here to read more about Optimum CLI usage</b></summary>\n",
    "\n",
    "The command bellow demonstrates basic command for model export with `optimum-cli`\n",
    "\n",
    "```\n",
    "optimum-cli export openvino --model <model_id_or_path> --task <task> <out_dir>\n",
    "```\n",
    "\n",
    "where `--model` argument is model id from HuggingFace Hub or local directory with model (saved using `.save_pretrained` method), `--task ` is one of [supported task](https://huggingface.co/docs/optimum/exporters/task_manager) that exported model should solve. For LLMs it is recommended to use `text-generation-with-past`. If model initialization requires to use remote code, `--trust-remote-code` flag additionally should be passed.\n",
    "</details>\n",
    "\n",
    "### Weights Compression using Optimum-CLI\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "You can also apply fp16, 8-bit or 4-bit weight compression on the Linear, Convolutional and Embedding layers when exporting your model with the CLI. \n",
    "<details>\n",
    "  <summary><b>Click here to read more about weights compression with Optimum CLI</b></summary>\n",
    "\n",
    "Setting `--weight-format` to respectively fp16, int8 or int4. This type of optimization allows to reduce the memory footprint and inference latency.\n",
    "By default the quantization scheme for int8/int4 will be [asymmetric](https://github.com/openvinotoolkit/nncf/blob/develop/docs/compression_algorithms/Quantization.md#asymmetric-quantization), to make it [symmetric](https://github.com/openvinotoolkit/nncf/blob/develop/docs/compression_algorithms/Quantization.md#symmetric-quantization) you can add `--sym`.\n",
    "\n",
    "For INT4 quantization you can also specify the following arguments :\n",
    "- The `--group-size` parameter will define the group size to use for quantization, -1 it will results in per-column quantization.\n",
    "- The `--ratio` parameter controls the ratio between 4-bit and 8-bit quantization. If set to 0.9, it means that 90% of the layers will be quantized to int4 while 10% will be quantized to int8.\n",
    "\n",
    "Smaller group_size and ratio values usually improve accuracy at the sacrifice of the model size and inference latency.\n",
    "You can enable AWQ to be additionally applied during model export with INT4 precision using `--awq` flag and providing dataset name with `--dataset`parameter (e.g. `--dataset wikitext2`)\n",
    "\n",
    ">**Note**: Applying AWQ requires significant memory and time.\n",
    "\n",
    ">**Note**: It is possible that there will be no matching patterns in the model to apply AWQ, in such case it will be skipped.\n",
    "</details>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "⌛Found preconverted INT4 DeepSeek-R1-Distill-Qwen-1.5B. Downloading model started. It may takes some time.\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "7e5a3afc923243dfb8514eb9726adfe8",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "Fetching 14 files:   0%|          | 0/14 [00:00<?, ?it/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "5a2b7a71772344b2b9f6681b6b8b7089",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "config.json:   0%|          | 0.00/767 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "2abe639a126146be80e1396ae4cb5588",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_detokenizer.xml:   0%|          | 0.00/10.1k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "8a3449b2f1254c9583a03ff7a89f7fc1",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_config.json:   0%|          | 0.00/612 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "bca311193a2141bea294278387ee4e01",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       ".gitattributes:   0%|          | 0.00/1.57k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "69936ea52d2245b2bdce1e11e4370dc1",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "generation_config.json:   0%|          | 0.00/181 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "c251544deec04d9a9d83e70de6cb8531",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "README.md:   0%|          | 0.00/4.14k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "3f0956d5f96147c091512017bb7a56be",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_model.xml:   0%|          | 0.00/2.53M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "cee9425cfccd46179cb74a5c2638f1ac",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "special_tokens_map.json:   0%|          | 0.00/485 [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "6732abf88bed4dd786008591eda54270",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer_config.json:   0%|          | 0.00/6.77k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "f018e2874fd84d82b06b24ff66886a54",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_tokenizer.xml:   0%|          | 0.00/28.5k [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "608d5d966e914e11832e727fb5a371d6",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_model.bin:   0%|          | 0.00/1.40G [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "90eda4d5d62b4ee4b0481dbe209f7c31",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_detokenizer.bin:   0%|          | 0.00/2.19M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "dc1b2e7ce60a4af98e9079952f148e00",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "tokenizer.json:   0%|          | 0.00/11.4M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "bcce2aa4cb9a4dac9ee21db889f4d69d",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "openvino_tokenizer.bin:   0%|          | 0.00/5.59M [00:00<?, ?B/s]"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "✅ INT4 DeepSeek-R1-Distill-Qwen-1.5B model downloaded and can be found in DeepSeek-R1-Distill-Qwen-1.5B/INT4_compressed_weights\n"
     ]
    }
   ],
   "source": [
    "from llm_config import convert_and_compress_model\n",
    "\n",
    "model_dir = convert_and_compress_model(model_id, model_configuration, compression_variant.value, use_preconverted=use_preconverted.value)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Size of model with INT4 compressed weights is 1331.98 MB\n"
     ]
    }
   ],
   "source": [
    "from llm_config import compare_model_size\n",
    "\n",
    "compare_model_size(model_dir)"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Instantiate pipeline with OpenVINO Generate API\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "[OpenVINO Generate API](https://github.com/openvinotoolkit/openvino.genai/blob/master/src/README.md) can be used to create pipelines to run an inference with OpenVINO Runtime. \n",
    "\n",
    "Firstly we need to create a pipeline with `LLMPipeline`. `LLMPipeline` is the main object used for text generation using LLM in OpenVINO GenAI API. You can construct it straight away from the folder with the converted model. We will provide directory with model and device for `LLMPipeline`. Then we run `generate` method and get the output in text format.\n",
    "Additionally, we can configure parameters for decoding. We can create the default config with `ov_genai.GenerationConfig()`, setup parameters, and apply the updated version with `set_generation_config(config)` or put config directly to `generate()`. It's also possible to specify the needed options just as inputs in the `generate()` method, as shown below, e.g. we can add `max_new_tokens` to stop generation if a specified number of tokens is generated and the end of generation is not reached. We will discuss some of the available generation parameters more deeply later.  Generation process for long response may be time consuming, for accessing partial result as soon as it is generated without waiting when whole process finished, Streaming API can be used. Token streaming is the mode in which the generative system returns the tokens one by one as the model generates them. This enables showing progressive generations to the user rather than waiting for the whole generation. Streaming is an essential aspect of the end-user experience as it reduces latency, one of the most critical aspects of a smooth experience. In code below, we implement simple streamer for printing output result. For more advanced streamer example please check openvino.genai [sample](https://github.com/openvinotoolkit/openvino.genai/tree/master/samples/python/multinomial_causal_lm)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Loading model from DeepSeek-R1-Distill-Qwen-1.5B/INT4_compressed_weights\n",
      "\n",
      "Input text: What is OpenVINO?\n",
      "<think>\n",
      "\n",
      "</think>\n",
      "\n",
      "OpenVINO is an open-source platform developed by Intel for the optimization, synthesis, and inference of neural networks. It is designed to enable the efficient deployment of AI models on various hardware platforms, including CPUs, GPUs, and specialized hardware like FPGAs. OpenVINO is built on top of the Intel Integrated Core Technology (ICT) platform, which provides a robust foundation for AI model optimization and acceleration.\n",
      "\n",
      "### Key Features of OpenVINO:\n",
      "1. **Neural Network Optimization**: OpenVINO optimizes AI models for better performance and energy efficiency.\n",
      "2. **Synthesis and Inference**: It synthesizes"
     ]
    }
   ],
   "source": [
    "import openvino_genai as ov_genai\n",
    "import sys\n",
    "\n",
    "print(f\"Loading model from {model_dir}\\n\")\n",
    "\n",
    "\n",
    "pipe = ov_genai.LLMPipeline(str(model_dir), device.value)\n",
    "if \"genai_chat_template\" in model_configuration:\n",
    "    pipe.get_tokenizer().set_chat_template(model_configuration[\"genai_chat_template\"])\n",
    "\n",
    "generation_config = ov_genai.GenerationConfig()\n",
    "generation_config.max_new_tokens = 128\n",
    "\n",
    "\n",
    "def streamer(subword):\n",
    "    print(subword, end=\"\", flush=True)\n",
    "    sys.stdout.flush()\n",
    "    # Return flag corresponds whether generation should be stopped.\n",
    "    # False means continue generation.\n",
    "    return False\n",
    "\n",
    "\n",
    "input_prompt = \"What is OpenVINO?\"\n",
    "print(f\"Input text: {input_prompt}\")\n",
    "result = pipe.generate(input_prompt, generation_config, streamer)"
   ]
  },
  {
   "attachments": {},
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Run Chatbot\n",
    "[back to top ⬆️](#Table-of-contents:)\n",
    "\n",
    "Now, when model created, we can setup Chatbot interface using [Gradio](https://www.gradio.app/).\n",
    "\n",
    "<details>\n",
    "  <summary><b>Click here to see how pipeline works</b></summary>\n",
    "\n",
    "The diagram below illustrates how the chatbot pipeline works\n",
    "\n",
    "![llm_diagram](https://github.com/user-attachments/assets/9c9b56e1-01a6-48d8-aa46-222a88e25066)\n",
    "\n",
    "As you can see, user input question passed via tokenizer to apply chat-specific formatting (chat template) and turn the provided string into the numeric format. [OpenVINO Tokenizers](https://github.com/openvinotoolkit/openvino_tokenizers) are used for these purposes inside `LLMPipeline`. You can find more detailed info about  tokenization theory and OpenVINO Tokenizers in this [tutorial](https://github.com/openvinotoolkit/openvino_notebooks/blob/latest/notebooks/openvino-tokenizers/openvino-tokenizers.ipynb). Then tokenized input passed to LLM for making prediction of next token probability. The way the next token will be selected over predicted probabilities is driven by the selected decoding methodology.  You can find more information about the most popular decoding methods in this [blog](https://huggingface.co/blog/how-to-generate). The sampler's goal is to select the next token id is driven by generation configuration. Next, we apply stop generation condition to check the generation is finished or not (e.g. if we reached the maximum new generated tokens or the next token id equals to end of the generation).  If the end of the generation is not reached, then new generated token id is used as the next iteration input, and the generation cycle repeats until the condition is not met. When stop generation criteria are met, then OpenVINO Detokenizer decodes generated token ids to text answer. \n",
    "\n",
    "The difference between chatbot and instruction-following pipelines is that the model should have \"memory\" to find correct answers on the chain of connected questions. OpenVINO GenAI uses `KVCache` representation for maintain a history of conversation. By default, `LLMPipeline` resets `KVCache` after each `generate` call. To keep conversational history, we should move LLMPipeline to chat mode using `start_chat()` method.\n",
    "\n",
    "More info about OpenVINO LLM inference can be found in [LLM Inference Guide](https://docs.openvino.ai/2024/learn-openvino/llm_inference_guide.html)\n",
    "</details>"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/ea/work/py311/lib/python3.11/site-packages/gradio/components/chatbot.py:285: UserWarning: You have not specified a value for the `type` parameter. Defaulting to the 'tuples' format for chatbot messages, but this is deprecated and will be removed in a future version of Gradio. Please set type='messages' instead, which uses openai-style dictionaries with 'role' and 'content' keys.\n",
      "  warnings.warn(\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "* Running on local URL:  http://127.0.0.1:7860\n",
      "\n",
      "To create a public link, set `share=True` in `launch()`.\n"
     ]
    },
    {
     "data": {
      "text/html": [
       "<div><iframe src=\"http://127.0.0.1:7860/\" width=\"100%\" height=\"500\" allow=\"autoplay; camera; microphone; clipboard-read; clipboard-write;\" frameborder=\"0\" allowfullscreen></iframe></div>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Keyboard interruption in main thread... closing server.\n"
     ]
    }
   ],
   "source": [
    "if not Path(\"gradio_helper.py\").exists():\n",
    "    r = requests.get(url=\"https://raw.githubusercontent.com/openvinotoolkit/openvino_notebooks/latest/notebooks/deepseek-r1/gradio_helper.py\")\n",
    "    open(\"gradio_helper_genai.py\", \"w\").write(r.text)\n",
    "\n",
    "from gradio_helper import make_demo\n",
    "\n",
    "demo = make_demo(pipe, model_configuration, model_id, lang.value, device.value == \"NPU\")\n",
    "\n",
    "try:\n",
    "    demo.launch(debug=True)\n",
    "except Exception:\n",
    "    demo.launch(debug=True, share=True)\n",
    "# If you are launching remotely, specify server_name and server_port\n",
    "# EXAMPLE: `demo.launch(server_name='your server name', server_port='server port in int')`\n",
    "# To learn more please refer to the Gradio docs: https://gradio.app/docs/"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3 (ipykernel)",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.11.4"
  },
  "openvino_notebooks": {
   "imageUrl": "https://user-images.githubusercontent.com/29454499/255799218-611e7189-8979-4ef5-8a80-5a75e0136b50.png",
   "tags": {
    "categories": [
     "Model Demos",
     "AI Trends"
    ],
    "libraries": [],
    "other": [
     "LLM"
    ],
    "tasks": [
     "Text Generation",
     "Conversational"
    ]
   }
  },
  "widgets": {
   "application/vnd.jupyter.widget-state+json": {
    "state": {
     "052d1bddcfd7477ba7c78b58a6923276": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "07d203057de041f8b1ba059e5196a62e": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "0b2281546e154d26aef32f6aaabb1746": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_6667d788d6c74fb5a814dd23fedb53c2",
       "max": 612,
       "style": "IPY_MODEL_763ddf99ad8e4404b1e7591857796369",
       "value": 612
      }
     },
     "0d1ec579e9b049cfa03f2ec6fde909f4": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "0d398035b1a048b5ac18792fdcc8d97c": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "0dbd83a4a9a54fe9a4b4ad8356eb0412": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelStyleModel",
      "state": {
       "description_width": "",
       "font_family": null,
       "font_size": null,
       "font_style": null,
       "font_variant": null,
       "font_weight": null,
       "text_color": null,
       "text_decoration": null
      }
     },
     "118937af885a4146ad99630ef0ba988b": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "1398b98c46244c929b55d8498187ff14": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "13992f8af35f4ba8844a1499a450f6d2": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "141d9ced61784dcbaea5b4b015111a1f": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "154dc270ab55410181f9e38f8c90fa2b": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "15d0f0a5910545a283d605171d33b31c": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_5cc3fabf4e9c4fcda05eaf9908dc4a10",
       "max": 767,
       "style": "IPY_MODEL_aa4c71e08efd42469c986e44b48edf90",
       "value": 767
      }
     },
     "17abeb4471ac4e90bdd56146adaff0dd": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "19d3b20a58b140478a6ffe40df3d29b7": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "19e7b66de2894f98961f7825386d4180": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "1b86bcff3bc24fdea8d40536b6d92a06": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "1f06e424430244e2bc59b626e869d5e3": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "218a2811956c414ab3fd01d3bfcac941": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "22295041bc0d4a8cb10abcdde75e7aff": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "2360769ee4ee419fb2a9f24dc0bff061": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_c77c8dfd2de848768268944d91da1383",
       "style": "IPY_MODEL_78c19978628a41fb85b258880184d89a",
       "value": " 2.19M/2.19M [00:01&lt;00:00, 1.35MB/s]"
      }
     },
     "23bd8f165cf04cd581e15dcfaaed7169": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "24e4c5fbcf9a4cfba02b25e6d178bf47": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "265bd42ad8dd41c7920213a5f0cd86f4": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "27ce675fa9d24b46a8f2c67f4e53f261": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_ce300986ad174f0f9dc99b3a509df602",
       "style": "IPY_MODEL_d8f6926b30c34f029b601828013ce853",
       "value": " 767/767 [00:00&lt;00:00, 75.6kB/s]"
      }
     },
     "2847950c2ec5402b9671128977bf5824": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "2abe639a126146be80e1396ae4cb5588": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_742c31fccb2e40cd957299e79d622754",
        "IPY_MODEL_4eb4130dd50a426093773d21ee5e17b4",
        "IPY_MODEL_612c46813816441eb9fabb76739d1b8b"
       ],
       "layout": "IPY_MODEL_6b00c16965bc4aff8f8fb0cf3a7098f5"
      }
     },
     "2cc266d793c44f29ab9de8a1326ebc2b": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "2dc7bd481f014681bf6d4d91fbb2ee22": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DropdownModel",
      "state": {
       "_options_labels": [
        "DeepSeek-R1-Distill-Qwen-1.5B",
        "DeepSeek-R1-Distill-Qwen-7B",
        "DeepSeek-R1-Distill-Llama-8B",
        "DeepSeek-R1-Distill-Qwen-14B",
        "DeepSeek-R1-Distill-Qwen-32B"
       ],
       "index": 0,
       "layout": "IPY_MODEL_17abeb4471ac4e90bdd56146adaff0dd",
       "style": "IPY_MODEL_776c64dc014b4da08fc8914d99b24248"
      }
     },
     "2ed362ad21e9494eb31df93fb1e2392d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_a641d6b598354cbab86a02d2ba961137",
       "style": "IPY_MODEL_384e5e2b4f5f45bda743e2d62be948a6",
       "value": " 181/181 [00:00&lt;00:00, 16.6kB/s]"
      }
     },
     "2f72743e8e754bd29a15a4b83778e0d6": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "2fbf5c3fb0a74ee396478c6f7e63cd4d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "308a672d1e56429b90fd1f9ffb9176c3": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "30c138f1ef244fa49400a7a249b4047f": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "31530c7ddecc4ebbafca13b4a3eb4294": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "318bd02fb3904b93b90453bb74b6ebab": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "32865e0be1504efaafa2ee09f9521e36": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_7f1318e5fe7d4bc88d8bc4784d067288",
       "max": 2189629,
       "style": "IPY_MODEL_f1461a33aef4422e9ed054b7f2ed0e0c",
       "value": 2189629
      }
     },
     "32b25d3c4ba24b84bd606032eee9e533": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "CheckboxModel",
      "state": {
       "disabled": false,
       "layout": "IPY_MODEL_c5cf86d2870147c49ae280fb30795dc4",
       "style": "IPY_MODEL_84ca91fed7824cbb9a02976c8485c869",
       "value": true
      }
     },
     "3358dc436e8d44d69d5771d25385f44d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DescriptionStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "3364b2385a25465992ef6ef578daaaec": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "33d45c6911aa4ef5b0d0ff8aae756c86": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_dbacca85007b447f81eb01694613aa6c",
       "style": "IPY_MODEL_57e11c02aa30488b8dd55ce93310f75b",
       "value": "special_tokens_map.json: 100%"
      }
     },
     "349b1c0014b2438e92f5a5956cdfab99": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DropdownModel",
      "state": {
       "_options_labels": [
        "INT4",
        "INT4-AWQ",
        "INT4-NPU",
        "INT8",
        "FP16"
       ],
       "index": 0,
       "layout": "IPY_MODEL_46a93cfc680f469e80725714da61231c",
       "style": "IPY_MODEL_80dc1acc1172468bb9c3e417b8b25f23"
      }
     },
     "354949915bb04329b2710553fabf3861": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "384e5e2b4f5f45bda743e2d62be948a6": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "38c8eb02a3a74bb2a27b917437abb253": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "391b6ee2a3c04edab2efb3517de7f8ae": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "3afa88b388d24e7ead70bf2b6e9e2ac1": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_4c4c1d17cc9c4025b486119e22763779",
       "style": "IPY_MODEL_1b86bcff3bc24fdea8d40536b6d92a06",
       "value": "config.json: 100%"
      }
     },
     "3b33b80a6e4b4aefa626a4719cb6f5e0": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "3b5279ef9693447fae39009044dd075a": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "3f0956d5f96147c091512017bb7a56be": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_e1f94d560ec64fecba760df685564c81",
        "IPY_MODEL_e51662ce2695490e9434bfcfdac71169",
        "IPY_MODEL_8d220129fe0d4557b172d7ff8c34485e"
       ],
       "layout": "IPY_MODEL_ccf51dd13c7d4a1bbbc75cfdcffc3dca"
      }
     },
     "41ed24b4ed8e4c08af84d3519dd684b2": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "44ab071b1d63466f8877fac382f0d145": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_56f45bb04b7943f3ab936669a6a625d4",
       "max": 485,
       "style": "IPY_MODEL_19e7b66de2894f98961f7825386d4180",
       "value": 485
      }
     },
     "46a93cfc680f469e80725714da61231c": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "46d68e26374649139987583f2ccfe661": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_a1075fc146d04f9dae1e3fa2e936ec43",
       "max": 14,
       "style": "IPY_MODEL_b093a2527bda487b8f9b77a10348faa7",
       "value": 14
      }
     },
     "4883867fff014d158c04d287a50d4887": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "4c4c1d17cc9c4025b486119e22763779": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "4cd672196d7749298516b96bdb62db3a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelModel",
      "state": {
       "layout": "IPY_MODEL_30c138f1ef244fa49400a7a249b4047f",
       "style": "IPY_MODEL_714a48a32ee44b51b93bcde03d649fb1",
       "value": "Use preconverted models:"
      }
     },
     "4d75fe69d758454fb09f6ab02a8a75ad": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "4dc192a4ca5e41a6a4fbeda96c832bd4": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "BoxModel",
      "state": {
       "children": [
        "IPY_MODEL_6a2ef62b3d12436a99da83f339bd1ec3",
        "IPY_MODEL_f3f17f0cfe054258b2e1896510cfc34a",
        "IPY_MODEL_53a2793e766d48ffa9624c2215f67c16",
        "IPY_MODEL_cd75a49be4944b1dba79f2c7d5b54b77"
       ],
       "layout": "IPY_MODEL_50bb11a124d648b4a0d9953b2e94f7a3"
      }
     },
     "4eb4130dd50a426093773d21ee5e17b4": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_6c90bc99f3714083ba46efca08623123",
       "max": 10116,
       "style": "IPY_MODEL_0d398035b1a048b5ac18792fdcc8d97c",
       "value": 10116
      }
     },
     "4f7025d1ab0e48ed8f17b1c11f0ee0a9": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "50bb11a124d648b4a0d9953b2e94f7a3": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {
       "border_bottom": "solid 1px",
       "border_left": "solid 1px",
       "border_right": "solid 1px",
       "border_top": "solid 1px",
       "display": "flex",
       "flex_flow": "column",
       "padding": "1%",
       "width": "30%"
      }
     },
     "53a2793e766d48ffa9624c2215f67c16": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "BoxModel",
      "state": {
       "children": [
        "IPY_MODEL_77787dfbfbe343f3a25fd33de474ddd4",
        "IPY_MODEL_349b1c0014b2438e92f5a5956cdfab99"
       ],
       "layout": "IPY_MODEL_9492493798f24afdb4149cf5e634a503"
      }
     },
     "540205cc18e54952b4c512e97bba8b35": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "56bddd5056604e88ac8c71ccc888751e": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "56e29826845041a8bd39a488743d9d13": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_57dd03db3c8f4d82b83ec7cc8c61d935",
       "style": "IPY_MODEL_8d5d1bd737f34018b756ffe2c743f660",
       "value": "openvino_config.json: 100%"
      }
     },
     "56f45bb04b7943f3ab936669a6a625d4": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "574b2350ac3943c8ac35f0e0bad24bb9": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "57dd03db3c8f4d82b83ec7cc8c61d935": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "57e11c02aa30488b8dd55ce93310f75b": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "598ced09d74b4dae974185b5fc0df340": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_5f2dcc6db9a94a6e8cd900bc53b3918d",
       "style": "IPY_MODEL_4883867fff014d158c04d287a50d4887",
       "value": "README.md: 100%"
      }
     },
     "5a2b7a71772344b2b9f6681b6b8b7089": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_3afa88b388d24e7ead70bf2b6e9e2ac1",
        "IPY_MODEL_15d0f0a5910545a283d605171d33b31c",
        "IPY_MODEL_27ce675fa9d24b46a8f2c67f4e53f261"
       ],
       "layout": "IPY_MODEL_a6a14eaf94e44b3697551c7ef38691ec"
      }
     },
     "5b5ea3b1dfc644ee8f8f01a9441456d2": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelStyleModel",
      "state": {
       "description_width": "",
       "font_family": null,
       "font_size": null,
       "font_style": null,
       "font_variant": null,
       "font_weight": null,
       "text_color": null,
       "text_decoration": null
      }
     },
     "5cc3fabf4e9c4fcda05eaf9908dc4a10": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "5edbbb0ef4154098a7c921157d6a1735": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "5f2dcc6db9a94a6e8cd900bc53b3918d": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "608d5d966e914e11832e727fb5a371d6": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_78a5e5fe108b4e0fb7bd10ac429405a7",
        "IPY_MODEL_d6d23673961443a4bd6d94202813abf6",
        "IPY_MODEL_79533c22c4b44ecaadfb19670d186305"
       ],
       "layout": "IPY_MODEL_540205cc18e54952b4c512e97bba8b35"
      }
     },
     "60e57727767a4a8990f2bf003f3abbdb": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_d1896b98f3324fed82ffd11108868d59",
       "max": 11422778,
       "style": "IPY_MODEL_24e4c5fbcf9a4cfba02b25e6d178bf47",
       "value": 11422778
      }
     },
     "612c46813816441eb9fabb76739d1b8b": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_1f06e424430244e2bc59b626e869d5e3",
       "style": "IPY_MODEL_0d1ec579e9b049cfa03f2ec6fde909f4",
       "value": " 10.1k/10.1k [00:00&lt;00:00, 1.02MB/s]"
      }
     },
     "62bf2f77081845618fe4cee13bef8f32": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "631e3a2faf26400d83bcb058d2c1c964": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_391b6ee2a3c04edab2efb3517de7f8ae",
       "style": "IPY_MODEL_23bd8f165cf04cd581e15dcfaaed7169",
       "value": "tokenizer.json: 100%"
      }
     },
     "6604007851d8489cbc3a014f08c3922a": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6667d788d6c74fb5a814dd23fedb53c2": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6732abf88bed4dd786008591eda54270": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_9a036110c5f44bf0a4851fd6ba0c4073",
        "IPY_MODEL_bad445c5b89641468761820ffe428e22",
        "IPY_MODEL_f7fec91e7f93443baffb266e138d5853"
       ],
       "layout": "IPY_MODEL_308a672d1e56429b90fd1f9ffb9176c3"
      }
     },
     "673d2948c1524a79aa9e5190f9231f57": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "67831309f92040f980d3ed18bddc8c9a": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6945386629cd4b17b5a7e469f14d1191": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "69936ea52d2245b2bdce1e11e4370dc1": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_99b8477c5746418491ee3e239510ba0d",
        "IPY_MODEL_d12ed877b483410599c60493e7c8b6af",
        "IPY_MODEL_2ed362ad21e9494eb31df93fb1e2392d"
       ],
       "layout": "IPY_MODEL_e772d21d8d2a4f72ad31ff04b61ab318"
      }
     },
     "6a2ef62b3d12436a99da83f339bd1ec3": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "BoxModel",
      "state": {
       "children": [
        "IPY_MODEL_b2626fee255b4c5aadf1e7959e23b8f8",
        "IPY_MODEL_fd393ed06ae64ed38db098fe0abd932a"
       ],
       "layout": "IPY_MODEL_67831309f92040f980d3ed18bddc8c9a"
      }
     },
     "6a3603ae642a4c2088ca09157143ba3d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_df67120b15a84de390412af3b3712171",
       "style": "IPY_MODEL_154dc270ab55410181f9e38f8c90fa2b",
       "value": "openvino_tokenizer.bin: 100%"
      }
     },
     "6a38a0e3dfe2416280db0402e41ed28c": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6b00c16965bc4aff8f8fb0cf3a7098f5": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6c90bc99f3714083ba46efca08623123": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6d7668dd1c3449fbb0810ba0e12274eb": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6dd69c97aeac4aebb94bc0d8491da516": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_8a9990a8c53f46889e98ce74daeb6661",
       "style": "IPY_MODEL_bb2ea109a7ac400a80171f0492a46ff1",
       "value": " 11.4M/11.4M [00:02&lt;00:00, 5.34MB/s]"
      }
     },
     "6de6fdd0471f451cab5861cb28d6d235": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6f55129745ff410e872dcf17c500bd7e": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "6f6e54aaf79d4057a099c655bb118315": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "714a48a32ee44b51b93bcde03d649fb1": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelStyleModel",
      "state": {
       "description_width": "",
       "font_family": null,
       "font_size": null,
       "font_style": null,
       "font_variant": null,
       "font_weight": null,
       "text_color": null,
       "text_decoration": null
      }
     },
     "71889f340797427b9725b2e41d4d2c27": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "742c31fccb2e40cd957299e79d622754": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_38c8eb02a3a74bb2a27b917437abb253",
       "style": "IPY_MODEL_6f6e54aaf79d4057a099c655bb118315",
       "value": "openvino_detokenizer.xml: 100%"
      }
     },
     "763ddf99ad8e4404b1e7591857796369": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "776c64dc014b4da08fc8914d99b24248": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DescriptionStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "77787dfbfbe343f3a25fd33de474ddd4": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelModel",
      "state": {
       "layout": "IPY_MODEL_62bf2f77081845618fe4cee13bef8f32",
       "style": "IPY_MODEL_0dbd83a4a9a54fe9a4b4ad8356eb0412",
       "value": "Compression:"
      }
     },
     "77ba77015d104ce893c3ff9dc15d76e3": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "78a5e5fe108b4e0fb7bd10ac429405a7": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_8cb0ff58ae7d47fd9885036709afb801",
       "style": "IPY_MODEL_118937af885a4146ad99630ef0ba988b",
       "value": "openvino_model.bin: 100%"
      }
     },
     "78c19978628a41fb85b258880184d89a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "79533c22c4b44ecaadfb19670d186305": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_d90a1eb843584714bacf1aeecf6e1f81",
       "style": "IPY_MODEL_a14aa25d544b49e1a5a419f6831221de",
       "value": " 1.40G/1.40G [01:50&lt;00:00, 13.9MB/s]"
      }
     },
     "7a0a85a9606e4a45b1681c31b6a1152e": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "7a4614fd28714b52a74640ba34cd4616": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "7cbf0383cbb24f87a0a0d9caaa0965b0": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "7e5a3afc923243dfb8514eb9726adfe8": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_8727654bb52d447ba48f05add3dc8123",
        "IPY_MODEL_46d68e26374649139987583f2ccfe661",
        "IPY_MODEL_8335438289f141f494279013f19e83ed"
       ],
       "layout": "IPY_MODEL_3364b2385a25465992ef6ef578daaaec"
      }
     },
     "7f1318e5fe7d4bc88d8bc4784d067288": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "80dc1acc1172468bb9c3e417b8b25f23": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DescriptionStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "8335438289f141f494279013f19e83ed": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_dab22a6017de40f2948d275a61835199",
       "style": "IPY_MODEL_d789644fa1e0432d81afd61d30069c23",
       "value": " 14/14 [01:53&lt;00:00, 18.61s/it]"
      }
     },
     "84ca91fed7824cbb9a02976c8485c869": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "CheckboxStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "86c8de5a08a749f788d297de6677d187": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "86fd8a5e4ccb49b0b6f568e265a0ba22": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_86c8de5a08a749f788d297de6677d187",
       "style": "IPY_MODEL_a8956b43285e419c96b450a014f5acb8",
       "value": " 612/612 [00:00&lt;00:00, 54.0kB/s]"
      }
     },
     "8727654bb52d447ba48f05add3dc8123": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_d7e0b95c127446b5abd8a58257227f6a",
       "style": "IPY_MODEL_19d3b20a58b140478a6ffe40df3d29b7",
       "value": "Fetching 14 files: 100%"
      }
     },
     "89c4522f4e624fdaafd9d4082e3113fc": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "8a3449b2f1254c9583a03ff7a89f7fc1": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_56e29826845041a8bd39a488743d9d13",
        "IPY_MODEL_0b2281546e154d26aef32f6aaabb1746",
        "IPY_MODEL_86fd8a5e4ccb49b0b6f568e265a0ba22"
       ],
       "layout": "IPY_MODEL_e9aa15b9791f431c9ef098470088312f"
      }
     },
     "8a9990a8c53f46889e98ce74daeb6661": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "8ba52725a3ea49e895cb25ec5cc768f3": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "8cb0ff58ae7d47fd9885036709afb801": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "8d220129fe0d4557b172d7ff8c34485e": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_6de6fdd0471f451cab5861cb28d6d235",
       "style": "IPY_MODEL_318bd02fb3904b93b90453bb74b6ebab",
       "value": " 2.53M/2.53M [00:01&lt;00:00, 1.91MB/s]"
      }
     },
     "8d4b7a7b7018425b890422625b06361b": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "8d5d1bd737f34018b756ffe2c743f660": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "90e7ce6b487d4af4a6881ed03db1179e": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "90eda4d5d62b4ee4b0481dbe209f7c31": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_fc5f26f005a645968ed2c634407af69c",
        "IPY_MODEL_32865e0be1504efaafa2ee09f9521e36",
        "IPY_MODEL_2360769ee4ee419fb2a9f24dc0bff061"
       ],
       "layout": "IPY_MODEL_8ba52725a3ea49e895cb25ec5cc768f3"
      }
     },
     "9492493798f24afdb4149cf5e634a503": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "954bf391c2644626b063f5fea705a3ca": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "9653cfcf15f64c46a77ce4522b60198a": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "99b8477c5746418491ee3e239510ba0d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_1398b98c46244c929b55d8498187ff14",
       "style": "IPY_MODEL_13992f8af35f4ba8844a1499a450f6d2",
       "value": "generation_config.json: 100%"
      }
     },
     "9a036110c5f44bf0a4851fd6ba0c4073": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_71889f340797427b9725b2e41d4d2c27",
       "style": "IPY_MODEL_141d9ced61784dcbaea5b4b015111a1f",
       "value": "tokenizer_config.json: 100%"
      }
     },
     "9b2aada9f33f41a0ac7e5e727235c763": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_354949915bb04329b2710553fabf3861",
       "max": 1570,
       "style": "IPY_MODEL_3b33b80a6e4b4aefa626a4719cb6f5e0",
       "value": 1570
      }
     },
     "9e595e8288484e2cbb1d95071d649c8d": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "a1075fc146d04f9dae1e3fa2e936ec43": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "a14aa25d544b49e1a5a419f6831221de": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "a19995bea6d24cb79072aa4185c0991a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_9e595e8288484e2cbb1d95071d649c8d",
       "style": "IPY_MODEL_c2412599fe094948979bf3aabd00147e",
       "value": " 1.57k/1.57k [00:00&lt;00:00, 139kB/s]"
      }
     },
     "a32042e92ee143459ce05f40fffda581": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "a3ee125da1fe4f14bd265000c3fb435c": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_7a4614fd28714b52a74640ba34cd4616",
       "style": "IPY_MODEL_673d2948c1524a79aa9e5190f9231f57",
       "value": " 5.59M/5.59M [00:01&lt;00:00, 3.21MB/s]"
      }
     },
     "a641d6b598354cbab86a02d2ba961137": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "a6a14eaf94e44b3697551c7ef38691ec": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "a8956b43285e419c96b450a014f5acb8": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "aa4c71e08efd42469c986e44b48edf90": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "abb15eca372e42c288b5e112b71e1100": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelModel",
      "state": {
       "layout": "IPY_MODEL_5edbbb0ef4154098a7c921157d6a1735",
       "style": "IPY_MODEL_dcd6851d69374c9b8203f68239914400",
       "value": "Model:"
      }
     },
     "ac6a88a5604947a88f3f412dab381279": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "b03d468d113b4fa791f9f1a390f01562": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DescriptionStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "b093a2527bda487b8f9b77a10348faa7": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "b2626fee255b4c5aadf1e7959e23b8f8": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelModel",
      "state": {
       "layout": "IPY_MODEL_6604007851d8489cbc3a014f08c3922a",
       "style": "IPY_MODEL_5b5ea3b1dfc644ee8f8f01a9441456d2",
       "value": "Language:"
      }
     },
     "b4224654e00144e4a628267415694dd8": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "bad445c5b89641468761820ffe428e22": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_d35a916e060142a1b91ed5592d64329f",
       "max": 6768,
       "style": "IPY_MODEL_07d203057de041f8b1ba059e5196a62e",
       "value": 6768
      }
     },
     "bb2ea109a7ac400a80171f0492a46ff1": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "bc20c36d20da47849d9e1eecad09022a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_e7f09b83570746789ea77c8201ebb20e",
       "style": "IPY_MODEL_31530c7ddecc4ebbafca13b4a3eb4294",
       "value": " 4.14k/4.14k [00:00&lt;00:00, 394kB/s]"
      }
     },
     "bca311193a2141bea294278387ee4e01": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_ee896ae271d847e2b28b94f3b6025203",
        "IPY_MODEL_9b2aada9f33f41a0ac7e5e727235c763",
        "IPY_MODEL_a19995bea6d24cb79072aa4185c0991a"
       ],
       "layout": "IPY_MODEL_2cc266d793c44f29ab9de8a1326ebc2b"
      }
     },
     "bcce2aa4cb9a4dac9ee21db889f4d69d": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_6a3603ae642a4c2088ca09157143ba3d",
        "IPY_MODEL_c40099de58fa46c5a0283d36348b319f",
        "IPY_MODEL_a3ee125da1fe4f14bd265000c3fb435c"
       ],
       "layout": "IPY_MODEL_6f55129745ff410e872dcf17c500bd7e"
      }
     },
     "bdb4c722604a4e2ba159ceda118f7e87": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "c2412599fe094948979bf3aabd00147e": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "c251544deec04d9a9d83e70de6cb8531": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_598ced09d74b4dae974185b5fc0df340",
        "IPY_MODEL_f72528494b1d41859089b9d38e3c8ae8",
        "IPY_MODEL_bc20c36d20da47849d9e1eecad09022a"
       ],
       "layout": "IPY_MODEL_b4224654e00144e4a628267415694dd8"
      }
     },
     "c2c45d32146c441ebdb77f8e303074b6": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "c40099de58fa46c5a0283d36348b319f": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_e82e8751d80141de85b3b93b043624a1",
       "max": 5588655,
       "style": "IPY_MODEL_218a2811956c414ab3fd01d3bfcac941",
       "value": 5588655
      }
     },
     "c5cf86d2870147c49ae280fb30795dc4": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "c77c8dfd2de848768268944d91da1383": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "c94c2b5eeeb44c179fd6094dbdb369cf": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "ccf51dd13c7d4a1bbbc75cfdcffc3dca": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "cd75a49be4944b1dba79f2c7d5b54b77": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "BoxModel",
      "state": {
       "children": [
        "IPY_MODEL_4cd672196d7749298516b96bdb62db3a",
        "IPY_MODEL_32b25d3c4ba24b84bd606032eee9e533"
       ],
       "layout": "IPY_MODEL_bdb4c722604a4e2ba159ceda118f7e87"
      }
     },
     "ce2dd8fc1c614c8a8b3747cffe8b3291": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_41ed24b4ed8e4c08af84d3519dd684b2",
       "style": "IPY_MODEL_2fbf5c3fb0a74ee396478c6f7e63cd4d",
       "value": " 28.5k/28.5k [00:00&lt;00:00, 205kB/s]"
      }
     },
     "ce300986ad174f0f9dc99b3a509df602": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "ced96f2a29aa4f4e9ec8a7300c371438": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DropdownModel",
      "state": {
       "_options_labels": [
        "CPU",
        "AUTO"
       ],
       "description": "Device:",
       "index": 0,
       "layout": "IPY_MODEL_89c4522f4e624fdaafd9d4082e3113fc",
       "style": "IPY_MODEL_3358dc436e8d44d69d5771d25385f44d"
      }
     },
     "cee9425cfccd46179cb74a5c2638f1ac": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_33d45c6911aa4ef5b0d0ff8aae756c86",
        "IPY_MODEL_44ab071b1d63466f8877fac382f0d145",
        "IPY_MODEL_e48930a290ed4cfcad5bf9b4a7b3f16f"
       ],
       "layout": "IPY_MODEL_265bd42ad8dd41c7920213a5f0cd86f4"
      }
     },
     "cfb5b32bfda94878a67d5828068c1370": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_dff4b1e0142740a9b64136b0fba5feb7",
       "max": 28529,
       "style": "IPY_MODEL_7cbf0383cbb24f87a0a0d9caaa0965b0",
       "value": 28529
      }
     },
     "d12ed877b483410599c60493e7c8b6af": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_6945386629cd4b17b5a7e469f14d1191",
       "max": 181,
       "style": "IPY_MODEL_22295041bc0d4a8cb10abcdde75e7aff",
       "value": 181
      }
     },
     "d1896b98f3324fed82ffd11108868d59": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "d35a916e060142a1b91ed5592d64329f": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "d6d23673961443a4bd6d94202813abf6": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_6a38a0e3dfe2416280db0402e41ed28c",
       "max": 1396681044,
       "style": "IPY_MODEL_2847950c2ec5402b9671128977bf5824",
       "value": 1396681044
      }
     },
     "d789644fa1e0432d81afd61d30069c23": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "d7e0b95c127446b5abd8a58257227f6a": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "d8f6926b30c34f029b601828013ce853": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLStyleModel",
      "state": {
       "description_width": "",
       "font_size": null,
       "text_color": null
      }
     },
     "d90a1eb843584714bacf1aeecf6e1f81": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "dab22a6017de40f2948d275a61835199": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "dbacca85007b447f81eb01694613aa6c": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "dc1b2e7ce60a4af98e9079952f148e00": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_631e3a2faf26400d83bcb058d2c1c964",
        "IPY_MODEL_60e57727767a4a8990f2bf003f3abbdb",
        "IPY_MODEL_6dd69c97aeac4aebb94bc0d8491da516"
       ],
       "layout": "IPY_MODEL_e06476fdfad04f809e58c51726fbea41"
      }
     },
     "dcd6851d69374c9b8203f68239914400": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "LabelStyleModel",
      "state": {
       "description_width": "",
       "font_family": null,
       "font_size": null,
       "font_style": null,
       "font_variant": null,
       "font_weight": null,
       "text_color": null,
       "text_decoration": null
      }
     },
     "df67120b15a84de390412af3b3712171": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "dff4b1e0142740a9b64136b0fba5feb7": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "e06476fdfad04f809e58c51726fbea41": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "e1f94d560ec64fecba760df685564c81": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_56bddd5056604e88ac8c71ccc888751e",
       "style": "IPY_MODEL_8d4b7a7b7018425b890422625b06361b",
       "value": "openvino_model.xml: 100%"
      }
     },
     "e48930a290ed4cfcad5bf9b4a7b3f16f": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_c2c45d32146c441ebdb77f8e303074b6",
       "style": "IPY_MODEL_77ba77015d104ce893c3ff9dc15d76e3",
       "value": " 485/485 [00:00&lt;00:00, 47.2kB/s]"
      }
     },
     "e4a24a7d718144f4a6d7de1740b0dea2": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_c94c2b5eeeb44c179fd6094dbdb369cf",
       "style": "IPY_MODEL_574b2350ac3943c8ac35f0e0bad24bb9",
       "value": "openvino_tokenizer.xml: 100%"
      }
     },
     "e51662ce2695490e9434bfcfdac71169": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_a32042e92ee143459ce05f40fffda581",
       "max": 2531709,
       "style": "IPY_MODEL_90e7ce6b487d4af4a6881ed03db1179e",
       "value": 2531709
      }
     },
     "e772d21d8d2a4f72ad31ff04b61ab318": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "e7c2124969334271ad9e738cfe0c47e7": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "e7f09b83570746789ea77c8201ebb20e": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "e82e8751d80141de85b3b93b043624a1": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "e9aa15b9791f431c9ef098470088312f": {
      "model_module": "@jupyter-widgets/base",
      "model_module_version": "2.0.0",
      "model_name": "LayoutModel",
      "state": {}
     },
     "ee896ae271d847e2b28b94f3b6025203": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_3b5279ef9693447fae39009044dd075a",
       "style": "IPY_MODEL_052d1bddcfd7477ba7c78b58a6923276",
       "value": ".gitattributes: 100%"
      }
     },
     "f018e2874fd84d82b06b24ff66886a54": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HBoxModel",
      "state": {
       "children": [
        "IPY_MODEL_e4a24a7d718144f4a6d7de1740b0dea2",
        "IPY_MODEL_cfb5b32bfda94878a67d5828068c1370",
        "IPY_MODEL_ce2dd8fc1c614c8a8b3747cffe8b3291"
       ],
       "layout": "IPY_MODEL_6d7668dd1c3449fbb0810ba0e12274eb"
      }
     },
     "f1461a33aef4422e9ed054b7f2ed0e0c": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "ProgressStyleModel",
      "state": {
       "description_width": ""
      }
     },
     "f3f17f0cfe054258b2e1896510cfc34a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "BoxModel",
      "state": {
       "children": [
        "IPY_MODEL_abb15eca372e42c288b5e112b71e1100",
        "IPY_MODEL_2dc7bd481f014681bf6d4d91fbb2ee22"
       ],
       "layout": "IPY_MODEL_4f7025d1ab0e48ed8f17b1c11f0ee0a9"
      }
     },
     "f72528494b1d41859089b9d38e3c8ae8": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "FloatProgressModel",
      "state": {
       "bar_style": "success",
       "layout": "IPY_MODEL_9653cfcf15f64c46a77ce4522b60198a",
       "max": 4140,
       "style": "IPY_MODEL_e7c2124969334271ad9e738cfe0c47e7",
       "value": 4140
      }
     },
     "f7fec91e7f93443baffb266e138d5853": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_ac6a88a5604947a88f3f412dab381279",
       "style": "IPY_MODEL_7a0a85a9606e4a45b1681c31b6a1152e",
       "value": " 6.77k/6.77k [00:00&lt;00:00, 865kB/s]"
      }
     },
     "fc5f26f005a645968ed2c634407af69c": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "HTMLModel",
      "state": {
       "layout": "IPY_MODEL_4d75fe69d758454fb09f6ab02a8a75ad",
       "style": "IPY_MODEL_2f72743e8e754bd29a15a4b83778e0d6",
       "value": "openvino_detokenizer.bin: 100%"
      }
     },
     "fd393ed06ae64ed38db098fe0abd932a": {
      "model_module": "@jupyter-widgets/controls",
      "model_module_version": "2.0.0",
      "model_name": "DropdownModel",
      "state": {
       "_options_labels": [
        "English",
        "Chinese"
       ],
       "index": 0,
       "layout": "IPY_MODEL_954bf391c2644626b063f5fea705a3ca",
       "style": "IPY_MODEL_b03d468d113b4fa791f9f1a390f01562"
      }
     }
    },
    "version_major": 2,
    "version_minor": 0
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}