dw.ipynb

{
 "cells": [
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {
    "init_cell": true
   },
   "outputs": [],
   "source": [
    "%logstop\n",
    "%logstart -rtq ~/.logs/dw.py append\n",
    "%matplotlib inline\n",
    "import matplotlib\n",
    "import seaborn as sns\n",
    "sns.set()\n",
    "matplotlib.rcParams['figure.dpi'] = 144"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "from static_grader import grader"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# DW Miniproject\n",
    "## Introduction\n",
    "\n",
    "The objective of this miniproject is to exercise your ability to wrangle tabular data set and aggregate large data sets into meaningful summary statistics. We'll work with the same medical data used in the `pw` miniproject but leverage the power of Pandas to more efficiently represent and act on our data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Downloading the data\n",
    "\n",
    "We first need to download the data we'll be using from Amazon S3:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "mkdir: cannot create directory ‘dw-data’: File exists\n",
      "File ‘./dw-data/201701scripts_sample.csv.gz’ already there; not retrieving.\n",
      "\n",
      "File ‘./dw-data/201606scripts_sample.csv.gz’ already there; not retrieving.\n",
      "\n",
      "File ‘./dw-data/practices.csv.gz’ already there; not retrieving.\n",
      "\n",
      "File ‘./dw-data/chem.csv.gz’ already there; not retrieving.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "!mkdir dw-data\n",
    "!wget http://dataincubator-wqu.s3.amazonaws.com/dwdata/201701scripts_sample.csv.gz -nc -P ./dw-data/\n",
    "!wget http://dataincubator-wqu.s3.amazonaws.com/dwdata/201606scripts_sample.csv.gz -nc -P ./dw-data/\n",
    "!wget http://dataincubator-wqu.s3.amazonaws.com/dwdata/practices.csv.gz -nc -P ./dw-data/\n",
    "!wget http://dataincubator-wqu.s3.amazonaws.com/dwdata/chem.csv.gz -nc -P ./dw-data/"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Loading the data\n",
    "\n",
    "Similar to the `PW` miniproject, the first step is to read in the data. The data files are stored as compressed CSV files. You can load the data into a Pandas DataFrame by making use of the `gzip` package to decompress the files and Panda's `read_csv` methods to parse the data into a DataFrame. You may want to check the Pandas documentation for parsing [CSV](http://pandas.pydata.org/pandas-docs/stable/generated/pandas.read_csv.html) files for reference.\n",
    "\n",
    "For a description of the data set please, refer to the [PW miniproject](./pw.ipynb). **Note that all questions make use of the 2017 data only, except for Question 5 which makes use of both the 2017 and 2016 data.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import numpy as np\n",
    "import gzip"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106040M0</td>\n",
       "      <td>Movicol Plain_Paed Pdr Sach 6.9g</td>\n",
       "      <td>1</td>\n",
       "      <td>4.38</td>\n",
       "      <td>4.07</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0301011R0</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0304010G0</td>\n",
       "      <td>Chlorphenamine Mal_Oral Soln 2mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>2.62</td>\n",
       "      <td>2.44</td>\n",
       "      <td>150</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0401020K0</td>\n",
       "      <td>Diazepam_Tab 2mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.16</td>\n",
       "      <td>0.26</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0406000T0</td>\n",
       "      <td>Prochlpzine Mal_Tab 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.97</td>\n",
       "      <td>0.91</td>\n",
       "      <td>28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0407010F0</td>\n",
       "      <td>Co-Codamol_Cap 30mg/500mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.84</td>\n",
       "      <td>0.89</td>\n",
       "      <td>24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0407010F0</td>\n",
       "      <td>Zapain_Tab 30mg/500mg</td>\n",
       "      <td>1</td>\n",
       "      <td>3.03</td>\n",
       "      <td>2.82</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0407010H0</td>\n",
       "      <td>Paracet_Oral Susp Paed 120mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>0.62</td>\n",
       "      <td>0.69</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501011P0</td>\n",
       "      <td>Phenoxymethylpenicillin Pot_Tab 250mg</td>\n",
       "      <td>2</td>\n",
       "      <td>5.94</td>\n",
       "      <td>5.72</td>\n",
       "      <td>160</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501012G0</td>\n",
       "      <td>Fluclox Sod_Cap 500mg</td>\n",
       "      <td>1</td>\n",
       "      <td>2.17</td>\n",
       "      <td>2.02</td>\n",
       "      <td>28</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501012G0</td>\n",
       "      <td>Fluclox Sod_Oral Soln 250mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>26.04</td>\n",
       "      <td>24.12</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501013B0</td>\n",
       "      <td>Amoxicillin_Cap 500mg</td>\n",
       "      <td>3</td>\n",
       "      <td>3.81</td>\n",
       "      <td>3.56</td>\n",
       "      <td>63</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501013B0</td>\n",
       "      <td>Amoxicillin_Oral Susp 250mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>2.26</td>\n",
       "      <td>2.10</td>\n",
       "      <td>200</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501021L0</td>\n",
       "      <td>Cefalexin_Tab 500mg</td>\n",
       "      <td>1</td>\n",
       "      <td>1.75</td>\n",
       "      <td>1.73</td>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501030I0</td>\n",
       "      <td>Doxycycline Hyclate_Cap 100mg</td>\n",
       "      <td>3</td>\n",
       "      <td>2.61</td>\n",
       "      <td>2.45</td>\n",
       "      <td>24</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501050B0</td>\n",
       "      <td>Clarithromycin_Oral Susp 125mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>4.06</td>\n",
       "      <td>3.77</td>\n",
       "      <td>70</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501080W0</td>\n",
       "      <td>Trimethoprim_Tab 200mg</td>\n",
       "      <td>2</td>\n",
       "      <td>1.64</td>\n",
       "      <td>1.55</td>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0501130R0</td>\n",
       "      <td>Nitrofurantoin_Cap 100mg M/R</td>\n",
       "      <td>1</td>\n",
       "      <td>4.07</td>\n",
       "      <td>3.88</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0603020T0</td>\n",
       "      <td>Prednisolone_Tab 5mg</td>\n",
       "      <td>3</td>\n",
       "      <td>4.22</td>\n",
       "      <td>4.14</td>\n",
       "      <td>136</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0902012H0</td>\n",
       "      <td>Gppe Pdr Sach_Dioralyte Relief S/F</td>\n",
       "      <td>1</td>\n",
       "      <td>2.50</td>\n",
       "      <td>2.33</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>N85639</td>\n",
       "      <td>1001010J0</td>\n",
       "      <td>Ibuprofen_Oral Susp 100mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>1.78</td>\n",
       "      <td>1.76</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>N85639</td>\n",
       "      <td>1103010C0</td>\n",
       "      <td>Chloramphen_Eye Dps 0.5%</td>\n",
       "      <td>2</td>\n",
       "      <td>3.04</td>\n",
       "      <td>2.84</td>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>N85639</td>\n",
       "      <td>1103010C0</td>\n",
       "      <td>Chloramphen_Eye Oint 1%</td>\n",
       "      <td>1</td>\n",
       "      <td>2.27</td>\n",
       "      <td>2.11</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>N85639</td>\n",
       "      <td>1203010E0</td>\n",
       "      <td>Difflam_P/Spy 0.15% 30ml</td>\n",
       "      <td>1</td>\n",
       "      <td>4.24</td>\n",
       "      <td>3.94</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>N85639</td>\n",
       "      <td>1502010J0</td>\n",
       "      <td>Instillagel_Gel 6ml Pfs</td>\n",
       "      <td>1</td>\n",
       "      <td>14.05</td>\n",
       "      <td>13.02</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>N85639</td>\n",
       "      <td>210102301</td>\n",
       "      <td>Able Spacer</td>\n",
       "      <td>1</td>\n",
       "      <td>4.39</td>\n",
       "      <td>4.08</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>N85647</td>\n",
       "      <td>0301011R0</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>N85647</td>\n",
       "      <td>0407010H0</td>\n",
       "      <td>Paracet_Oral Susp Paed 120mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>0.62</td>\n",
       "      <td>0.69</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>N85647</td>\n",
       "      <td>0501013B0</td>\n",
       "      <td>Amoxicillin_Oral Susp 250mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>1.13</td>\n",
       "      <td>1.06</td>\n",
       "      <td>100</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973163</th>\n",
       "      <td>H81615</td>\n",
       "      <td>231534515</td>\n",
       "      <td>Pelican_Release Non-Sting Adh Remover A/</td>\n",
       "      <td>2</td>\n",
       "      <td>38.44</td>\n",
       "      <td>35.62</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973164</th>\n",
       "      <td>H81615</td>\n",
       "      <td>231560015</td>\n",
       "      <td>C D Medical_Peel Easy Adh Remover Spy 50</td>\n",
       "      <td>1</td>\n",
       "      <td>28.40</td>\n",
       "      <td>26.29</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973165</th>\n",
       "      <td>H81615</td>\n",
       "      <td>232502625</td>\n",
       "      <td>AMI_Suportx Ostomy Support Mens Shorts D</td>\n",
       "      <td>1</td>\n",
       "      <td>19.62</td>\n",
       "      <td>18.16</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973166</th>\n",
       "      <td>H81615</td>\n",
       "      <td>232502625</td>\n",
       "      <td>AMI_Suportx Ostomy Support Mens Trunks D</td>\n",
       "      <td>1</td>\n",
       "      <td>39.24</td>\n",
       "      <td>36.33</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973167</th>\n",
       "      <td>H81615</td>\n",
       "      <td>233510037</td>\n",
       "      <td>Coloplast_SenSura Midi Closed Bag S/Cove</td>\n",
       "      <td>1</td>\n",
       "      <td>177.50</td>\n",
       "      <td>164.32</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973168</th>\n",
       "      <td>H81615</td>\n",
       "      <td>234506045</td>\n",
       "      <td>Bullen_NA'Scent Odour Eliminator</td>\n",
       "      <td>1</td>\n",
       "      <td>11.97</td>\n",
       "      <td>11.08</td>\n",
       "      <td>236</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973169</th>\n",
       "      <td>H81615</td>\n",
       "      <td>234510045</td>\n",
       "      <td>Coloplast_Brava Lubricating Deod 240ml</td>\n",
       "      <td>1</td>\n",
       "      <td>8.46</td>\n",
       "      <td>7.84</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973170</th>\n",
       "      <td>H81615</td>\n",
       "      <td>234533745</td>\n",
       "      <td>Respond_OstoMart OstoZyme M/Odour Neutra</td>\n",
       "      <td>1</td>\n",
       "      <td>16.16</td>\n",
       "      <td>14.96</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973171</th>\n",
       "      <td>H81615</td>\n",
       "      <td>234544045</td>\n",
       "      <td>Shaw_Forest Breeze Deod</td>\n",
       "      <td>1</td>\n",
       "      <td>7.70</td>\n",
       "      <td>7.14</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973172</th>\n",
       "      <td>H81615</td>\n",
       "      <td>236007062</td>\n",
       "      <td>Dansac_Nova 1 Drnbl + E/Fld Ileo Bag Sym</td>\n",
       "      <td>1</td>\n",
       "      <td>176.16</td>\n",
       "      <td>163.09</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973173</th>\n",
       "      <td>H81615</td>\n",
       "      <td>236007063</td>\n",
       "      <td>Dansac_Nova 1 Convex E/Fld Drnbl Ileo Ba</td>\n",
       "      <td>1</td>\n",
       "      <td>245.28</td>\n",
       "      <td>227.07</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973174</th>\n",
       "      <td>H81615</td>\n",
       "      <td>236010063</td>\n",
       "      <td>Coloplast_Sensura Mio Maxi DrnblBag Grey</td>\n",
       "      <td>1</td>\n",
       "      <td>99.63</td>\n",
       "      <td>92.23</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973175</th>\n",
       "      <td>H81615</td>\n",
       "      <td>236056062</td>\n",
       "      <td>Welland_FreeStyle Vie Convex Drnbl Pch M</td>\n",
       "      <td>1</td>\n",
       "      <td>220.75</td>\n",
       "      <td>204.36</td>\n",
       "      <td>50</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973176</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238009080</td>\n",
       "      <td>CliniMed_LBF Ster No Sting Barrier Film</td>\n",
       "      <td>2</td>\n",
       "      <td>76.14</td>\n",
       "      <td>70.50</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973177</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238020980</td>\n",
       "      <td>H &amp; R_Proshield Plus Skin Prote 115g</td>\n",
       "      <td>9</td>\n",
       "      <td>119.28</td>\n",
       "      <td>110.51</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973178</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238031080</td>\n",
       "      <td>3m Health Care_Cavilon No Sting Barrier</td>\n",
       "      <td>4</td>\n",
       "      <td>141.00</td>\n",
       "      <td>130.54</td>\n",
       "      <td>180</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973179</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238031080</td>\n",
       "      <td>3m Health Care_Cavilon Durable Barrier C</td>\n",
       "      <td>2</td>\n",
       "      <td>16.24</td>\n",
       "      <td>15.05</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973180</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238033680</td>\n",
       "      <td>Opus_SkinSafe Non Sting Prote Film</td>\n",
       "      <td>1</td>\n",
       "      <td>36.76</td>\n",
       "      <td>34.04</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973181</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238048080</td>\n",
       "      <td>Convatec_Orabase Paste 30g</td>\n",
       "      <td>3</td>\n",
       "      <td>8.56</td>\n",
       "      <td>7.93</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973182</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238501085</td>\n",
       "      <td>Hollister_Adapt Barrier Rings 98mm</td>\n",
       "      <td>2</td>\n",
       "      <td>180.08</td>\n",
       "      <td>166.74</td>\n",
       "      <td>80</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973183</th>\n",
       "      <td>H81615</td>\n",
       "      <td>238510085</td>\n",
       "      <td>Coloplast_Brava Mouldable Rings 48mm x 2</td>\n",
       "      <td>1</td>\n",
       "      <td>58.39</td>\n",
       "      <td>54.05</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973184</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239401097</td>\n",
       "      <td>Hollister_Conform 2 Flat Barrier +Adh 45</td>\n",
       "      <td>1</td>\n",
       "      <td>98.28</td>\n",
       "      <td>90.98</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973185</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239407096</td>\n",
       "      <td>Dansac_Nova 2 Flng 43mm P/Cut 30mm</td>\n",
       "      <td>1</td>\n",
       "      <td>47.46</td>\n",
       "      <td>43.94</td>\n",
       "      <td>15</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973186</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239407098</td>\n",
       "      <td>Dansac_NovaLife 2 Open Pouch Maxi Opqe 4</td>\n",
       "      <td>1</td>\n",
       "      <td>212.04</td>\n",
       "      <td>196.30</td>\n",
       "      <td>120</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973187</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239410093</td>\n",
       "      <td>Coloplast_SenSura Flex Drnbl Bag Maxi Op</td>\n",
       "      <td>2</td>\n",
       "      <td>105.02</td>\n",
       "      <td>97.22</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973188</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239410100</td>\n",
       "      <td>Coloplast_SenSura Mio Flex B/Plt 50mm C/</td>\n",
       "      <td>1</td>\n",
       "      <td>78.92</td>\n",
       "      <td>73.06</td>\n",
       "      <td>20</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973189</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239410100</td>\n",
       "      <td>Coloplast_SenSura Mio Flex Clsd Bag Mini</td>\n",
       "      <td>1</td>\n",
       "      <td>106.36</td>\n",
       "      <td>98.46</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973190</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239410100</td>\n",
       "      <td>Coloplast_SenSura Mio Flex Clsd Bag Midi</td>\n",
       "      <td>1</td>\n",
       "      <td>159.54</td>\n",
       "      <td>147.69</td>\n",
       "      <td>90</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973191</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239607096</td>\n",
       "      <td>Dansac_Nova 1 Convex Urost Pouch Clr C/F</td>\n",
       "      <td>2</td>\n",
       "      <td>329.76</td>\n",
       "      <td>305.28</td>\n",
       "      <td>60</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>973192</th>\n",
       "      <td>H81615</td>\n",
       "      <td>239610096</td>\n",
       "      <td>Coloplast_SenSura Mio Urost Bag Maxi Tra</td>\n",
       "      <td>1</td>\n",
       "      <td>182.48</td>\n",
       "      <td>168.93</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>973193 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       practice   bnf_code                                  bnf_name  items  \\\n",
       "0        N85639  0106020C0                     Bisacodyl_Tab E/C 5mg      1   \n",
       "1        N85639  0106040M0          Movicol Plain_Paed Pdr Sach 6.9g      1   \n",
       "2        N85639  0301011R0        Salbutamol_Inha 100mcg (200 D) CFF      1   \n",
       "3        N85639  0304010G0      Chlorphenamine Mal_Oral Soln 2mg/5ml      1   \n",
       "4        N85639  0401020K0                          Diazepam_Tab 2mg      1   \n",
       "...         ...        ...                                       ...    ...   \n",
       "973188   H81615  239410100  Coloplast_SenSura Mio Flex B/Plt 50mm C/      1   \n",
       "973189   H81615  239410100  Coloplast_SenSura Mio Flex Clsd Bag Mini      1   \n",
       "973190   H81615  239410100  Coloplast_SenSura Mio Flex Clsd Bag Midi      1   \n",
       "973191   H81615  239607096  Dansac_Nova 1 Convex Urost Pouch Clr C/F      2   \n",
       "973192   H81615  239610096  Coloplast_SenSura Mio Urost Bag Maxi Tra      1   \n",
       "\n",
       "           nic  act_cost  quantity  \n",
       "0         0.39      0.47        12  \n",
       "1         4.38      4.07        30  \n",
       "2         1.50      1.40         1  \n",
       "3         2.62      2.44       150  \n",
       "4         0.16      0.26         6  \n",
       "...        ...       ...       ...  \n",
       "973188   78.92     73.06        20  \n",
       "973189  106.36     98.46        60  \n",
       "973190  159.54    147.69        90  \n",
       "973191  329.76    305.28        60  \n",
       "973192  182.48    168.93        30  \n",
       "\n",
       "[973193 rows x 7 columns]"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# load the 2017 data\n",
    "scripts = pd.read_csv('dw-data/201701scripts_sample.csv.gz')\n",
    "scripts"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>A81002</td>\n",
       "      <td>QUEENS PARK MEDICAL CENTRE</td>\n",
       "      <td>QUEENS PARK MEDICAL CTR</td>\n",
       "      <td>FARRER STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 2AW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>A81003</td>\n",
       "      <td>VICTORIA MEDICAL PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>VICTORIA ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS26 8DB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>A81004</td>\n",
       "      <td>WOODLANDS ROAD SURGERY</td>\n",
       "      <td>6 WOODLANDS ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 3BE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>A81005</td>\n",
       "      <td>SPRINGWOOD SURGERY</td>\n",
       "      <td>SPRINGWOOD SURGERY</td>\n",
       "      <td>RECTORY LANE</td>\n",
       "      <td>GUISBOROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS14 7DJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>A81006</td>\n",
       "      <td>TENNANT STREET MEDICAL PRACTICE</td>\n",
       "      <td>TENNANT ST MED PRACT</td>\n",
       "      <td>FARRER STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 2AT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>A81007</td>\n",
       "      <td>BANKHOUSE SURGERY</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>A81008</td>\n",
       "      <td>ALBERT HOUSE CLINIC</td>\n",
       "      <td>LOW GRANGE HEALTH VILLAGE</td>\n",
       "      <td>NORMANBY ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS6 6TD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>A81009</td>\n",
       "      <td>VILLAGE MEDICAL CENTRE</td>\n",
       "      <td>THE VILLAGE MEDICAL CTR</td>\n",
       "      <td>400/404 LINTHORPE ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS5 6HF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>A81011</td>\n",
       "      <td>CHADWICK PRACTICE</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>A81012</td>\n",
       "      <td>WESTBOURNE MEDICAL CENTRE</td>\n",
       "      <td>WESTBOURNE MEDICAL CENTRE</td>\n",
       "      <td>7 TRINITY MEWS N. ORMESBY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS3 6AL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>A81013</td>\n",
       "      <td>BROTTON SURGERY</td>\n",
       "      <td>BROTTON SURGERY</td>\n",
       "      <td>ALFORD ROAD BROTTON</td>\n",
       "      <td>SALTBURN BY SEA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS12 2FF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>A81014</td>\n",
       "      <td>QUEENSTREE PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>QUEENSWAY</td>\n",
       "      <td>BILLINGHAM</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS23 2LA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>A81015</td>\n",
       "      <td>LAGAN SURGERY</td>\n",
       "      <td>LAGAN SURGERY</td>\n",
       "      <td>20 KIRKLEATHAM STREET</td>\n",
       "      <td>REDCAR</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS10 1TZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>A81016</td>\n",
       "      <td>PARK SURGERY</td>\n",
       "      <td>PARK SURGERY  ONE LIFE</td>\n",
       "      <td>LINTHORPE ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 3QY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>A81017</td>\n",
       "      <td>WOODBRIDGE PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>TRENCHARD AVE  THORNABY</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS17 0EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>A81018</td>\n",
       "      <td>BENTLEY MEDICAL PRACTICE</td>\n",
       "      <td>REDCAR PRIMARY CARE HOSP</td>\n",
       "      <td>WEST DYKE ROAD</td>\n",
       "      <td>REDCAR</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS10 4NW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>A81019</td>\n",
       "      <td>CROSSFELL HEALTH CENTRE</td>\n",
       "      <td>CROSSFELL ROAD</td>\n",
       "      <td>BERWICK HILLS</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS3 7RL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>A81020</td>\n",
       "      <td>MARTONSIDE MEDICAL CENTRE</td>\n",
       "      <td>MARTONSIDE MEDICAL CENTRE</td>\n",
       "      <td>1A MARTONSIDE WAY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS4 3BU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>A81021</td>\n",
       "      <td>NORMANBY MEDICAL CENTRE</td>\n",
       "      <td>NORMANBY MEDICAL CENTRE</td>\n",
       "      <td>LOW GRANGE HV NORMANBY RD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS6 6TD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>A81022</td>\n",
       "      <td>HILLSIDE PRACTICE</td>\n",
       "      <td>HILLSIDE PRACTICE</td>\n",
       "      <td>WINDERMERE DRIVE SKELTON</td>\n",
       "      <td>SALTBURN BY THE SEA</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS12 2TG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>A81023</td>\n",
       "      <td>THE ENDEAVOUR PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>20 CLEVELAND SQUARE</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 2NX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>A81025</td>\n",
       "      <td>THE DOVECOT SURGERY</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>LAWSON STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 1HU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>A81026</td>\n",
       "      <td>THE LINTHORPE SURGERY</td>\n",
       "      <td>378 LINTHORPE ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS5 6HA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>A81027</td>\n",
       "      <td>YARM MEDICAL PRACTICE</td>\n",
       "      <td>YARM MEDICAL PRACTICE</td>\n",
       "      <td>MULBERRY HOUSE</td>\n",
       "      <td>1 WORSALL ROAD</td>\n",
       "      <td>YARM  CLEVELAND</td>\n",
       "      <td>TS15 9DD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>A81029</td>\n",
       "      <td>PROSPECT SURGERY</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>PO BOX 101E</td>\n",
       "      <td>20 CLEVELAND SQUARE</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>TS1 2NX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>A81030</td>\n",
       "      <td>BOROUGH ROAD &amp; NUNTHORPE MEDICAL GROUP</td>\n",
       "      <td>167A BOROUGH ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS1 3RY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>A81031</td>\n",
       "      <td>HAVELOCK GRANGE PRACTICE</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>A81032</td>\n",
       "      <td>THE GARTH</td>\n",
       "      <td>THE GARTH SURGERY</td>\n",
       "      <td>RECTORY LANE</td>\n",
       "      <td>GUISBOROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS14 7DJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>A81033</td>\n",
       "      <td>OAKFIELD MEDICAL PRACTICE</td>\n",
       "      <td>OAKFIELDS MED PRACTICE</td>\n",
       "      <td>1 TRINITY MEWS N. ORMESBY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS3 6AL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>A81034</td>\n",
       "      <td>THORNABY &amp; BARWICK MEDICAL GROUP</td>\n",
       "      <td>THORNABY HEALTH CENTRE</td>\n",
       "      <td>TRENCHARD AVE  THORNABY</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS17 0EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11989</th>\n",
       "      <td>Y04708</td>\n",
       "      <td>PCOC GASTROENTEROLOGY SERVICE</td>\n",
       "      <td>HILLTOPS MEDICAL CENTRE</td>\n",
       "      <td>KENSINGTON DVE GREAT HOLM</td>\n",
       "      <td>MILTON KEYNES</td>\n",
       "      <td>BUCKINGHAMSHIRE</td>\n",
       "      <td>MK8 9HN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11990</th>\n",
       "      <td>Y04712</td>\n",
       "      <td>PRIME ENDOSCOPY (BRISTOL)</td>\n",
       "      <td>PRIME ENDOSCOPY (BRISTOL)</td>\n",
       "      <td>MILLENIUM PROMENADE</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS1 5SZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11991</th>\n",
       "      <td>Y04765</td>\n",
       "      <td>AQP ANTICOAG YEW TREE HLC</td>\n",
       "      <td>AQP ANTICOAG YEW TREE HLC</td>\n",
       "      <td>REDWOOD RD YEW TREE EST</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS5 4LB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11992</th>\n",
       "      <td>Y04785</td>\n",
       "      <td>THORACIC MEDICINE DEPARTMENT CANNOCK</td>\n",
       "      <td>CANNOCK CHASE HOSPITAL</td>\n",
       "      <td>BRUNSWICK ROAD</td>\n",
       "      <td>CANNOCK</td>\n",
       "      <td>STAFFORDSHIRE</td>\n",
       "      <td>WS11 5XY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11993</th>\n",
       "      <td>Y04797</td>\n",
       "      <td>ENT GPWSI TAVISTOCK HOSPITAL</td>\n",
       "      <td>TAVISTOCK HOSPITAL</td>\n",
       "      <td>15 CARMEL GARDENS</td>\n",
       "      <td>TAVISTOCK</td>\n",
       "      <td>DEVON</td>\n",
       "      <td>PL19 8RG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11994</th>\n",
       "      <td>Y04856</td>\n",
       "      <td>ST MARYS HEALTH CENTRE OOH</td>\n",
       "      <td>KING EDWARD LANE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ST MARYS</td>\n",
       "      <td>ISLES OF SCILLY</td>\n",
       "      <td>TR21 0HE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11995</th>\n",
       "      <td>Y05156</td>\n",
       "      <td>MILLENIUM POINT</td>\n",
       "      <td>WATERFRONT BUSINESS PARK</td>\n",
       "      <td>WATERFRONT WAY</td>\n",
       "      <td>BRIERLEY HILL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>DY5 1LX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11996</th>\n",
       "      <td>Y05296</td>\n",
       "      <td>RAPID ASSESSMENT WAMP6D COMMUNITY CLINIC</td>\n",
       "      <td>ST MARK'S HOSPITAL</td>\n",
       "      <td>ST MARK'S ROAD</td>\n",
       "      <td>MAIDENHEAD</td>\n",
       "      <td>BERKSHIRE</td>\n",
       "      <td>SL6 6DU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11997</th>\n",
       "      <td>Y05315</td>\n",
       "      <td>SOLENT MEDICAL SERVICES OPHTHALMOLOGY</td>\n",
       "      <td>NEWTOWN CLINIC</td>\n",
       "      <td>24-26 LYON STREET</td>\n",
       "      <td>SOUTHAMPTON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SO14 0LX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11998</th>\n",
       "      <td>Y05330</td>\n",
       "      <td>TOTTENHAM HALE MEDICAL PRACTICE</td>\n",
       "      <td>10 LEBUS STREET</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>N17 9FD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11999</th>\n",
       "      <td>Y05542</td>\n",
       "      <td>PAIN MANAGEMENT SOUTH</td>\n",
       "      <td>MORSTON HOUSE</td>\n",
       "      <td>THE MIDWAY</td>\n",
       "      <td>NEWCASTLE UNDER LYME</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ST5 1QG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12000</th>\n",
       "      <td>Y05634</td>\n",
       "      <td>NEAS NORTH DURHAM CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12001</th>\n",
       "      <td>Y05638</td>\n",
       "      <td>NEAS SOUTH TYNESIDE CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12002</th>\n",
       "      <td>Y05639</td>\n",
       "      <td>NEAS SUNDERLAND CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12003</th>\n",
       "      <td>Y05675</td>\n",
       "      <td>8 TO 8 TOP-UP HUB ERITH</td>\n",
       "      <td>ERITH HOSPITAL</td>\n",
       "      <td>PARK CRESCENT</td>\n",
       "      <td>ERITH</td>\n",
       "      <td>KENT</td>\n",
       "      <td>DA8 3EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12004</th>\n",
       "      <td>Y05676</td>\n",
       "      <td>8 TO 8 TOP-UP HUB QMH</td>\n",
       "      <td>QUEEN MARY'S HOSPITAL</td>\n",
       "      <td>FROGNAL AVENUE</td>\n",
       "      <td>SIDCUP</td>\n",
       "      <td>KENT</td>\n",
       "      <td>DA14 6LT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12005</th>\n",
       "      <td>Y05682</td>\n",
       "      <td>PRIMARY HEALTHCARE DARLINGTON</td>\n",
       "      <td>UNIT 1  PARAMO HOUSE</td>\n",
       "      <td>DENMARK STREET</td>\n",
       "      <td>DARLINGTON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>DL3 0LP</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12006</th>\n",
       "      <td>Y05692</td>\n",
       "      <td>LD TEAM WIGAN</td>\n",
       "      <td>WILLIS HOUSE</td>\n",
       "      <td>23 CUMBER LANE  WHISTON</td>\n",
       "      <td>PRESCOT</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>L35 2YZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12007</th>\n",
       "      <td>Y05697</td>\n",
       "      <td>CCG ACUTE VISITING SERVICE</td>\n",
       "      <td>NS/SOT CCG  1 SMITHFIELD</td>\n",
       "      <td>LEONARD COATES WAY</td>\n",
       "      <td>HANLEY</td>\n",
       "      <td>STAFFORDSHIRE</td>\n",
       "      <td>ST1 4FA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12008</th>\n",
       "      <td>Y05702</td>\n",
       "      <td>EAST MERTON ACCESS HUB</td>\n",
       "      <td>75-79 MILES ROAD</td>\n",
       "      <td>MITCHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SURREY</td>\n",
       "      <td>CR4 3DA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12009</th>\n",
       "      <td>Y05703</td>\n",
       "      <td>PRIMARY CARE CONNECT - ANFIELD HEALTH</td>\n",
       "      <td>TOWNSEND LANE NHC</td>\n",
       "      <td>98 TOWNSEND LANE</td>\n",
       "      <td>LIVERPOOL</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>L6 0BB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12010</th>\n",
       "      <td>Y05725</td>\n",
       "      <td>ACUTE CARE AT HOME CENTRAL</td>\n",
       "      <td>TRURO HEALTH PARK</td>\n",
       "      <td>INFIRMARY HILL</td>\n",
       "      <td>TRURO</td>\n",
       "      <td>CORNWALL</td>\n",
       "      <td>TR1 2JA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12011</th>\n",
       "      <td>Y05743</td>\n",
       "      <td>NEWARK ACUTE HOME VISITING SERVICE</td>\n",
       "      <td>PICS</td>\n",
       "      <td>UNIT H4 ASH TREE COURT</td>\n",
       "      <td>NOTTINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NG8 6PY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12012</th>\n",
       "      <td>Y05744</td>\n",
       "      <td>NEWMEDICA COMMUNITY OPHTHALMOLOGY</td>\n",
       "      <td>CROMWELL PCC</td>\n",
       "      <td>CROMWELL ROAD</td>\n",
       "      <td>GRIMSBY</td>\n",
       "      <td>NORTH EAST LINCOLNSHIRE</td>\n",
       "      <td>DN31 2BH</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12013</th>\n",
       "      <td>Y05748</td>\n",
       "      <td>EAST KENT DRUG AND ALCOHOL SERVICE</td>\n",
       "      <td>TRANSPORT HOUSE</td>\n",
       "      <td>DRUM LANE</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN23 1LQ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12014</th>\n",
       "      <td>Y05752</td>\n",
       "      <td>MALVERN FRAILTY UNIT</td>\n",
       "      <td>MALVERN COMM. HOSPITAL</td>\n",
       "      <td>185 WORCESTER ROAD</td>\n",
       "      <td>MALVERN</td>\n",
       "      <td>WORCESTERSHIRE</td>\n",
       "      <td>WR14 1EX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12015</th>\n",
       "      <td>Y05757</td>\n",
       "      <td>VC WEST LANCS HC-UCC</td>\n",
       "      <td>ORMSKIRK DG HOSPITAL</td>\n",
       "      <td>WIGAN ROAD</td>\n",
       "      <td>ORMSKIRK</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>L39 2AZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12016</th>\n",
       "      <td>Y05758</td>\n",
       "      <td>VC SKELMERSDALE UCC</td>\n",
       "      <td>CONCOURSE SHOPPING CENTRE</td>\n",
       "      <td>116-8 SOUTH WAY</td>\n",
       "      <td>SKELMERSDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>WN8 6LJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12017</th>\n",
       "      <td>Y05762</td>\n",
       "      <td>WEST MERTON ACCESS HUB</td>\n",
       "      <td>THE NELSON HEALTH CENTRE</td>\n",
       "      <td>KINGSTON ROAD</td>\n",
       "      <td>WIMBLEDON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SW20 8DA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12018</th>\n",
       "      <td>Y05763</td>\n",
       "      <td>ELY LOCAL URGENT CARE SERVICE</td>\n",
       "      <td>PRINCESS OF WALES HOSP</td>\n",
       "      <td>LYNN ROAD</td>\n",
       "      <td>ELY</td>\n",
       "      <td>CAMBRIDGSHIRE</td>\n",
       "      <td>CB6 1DN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>12019 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         code                             name                     addr_1  \\\n",
       "0      A81002       QUEENS PARK MEDICAL CENTRE    QUEENS PARK MEDICAL CTR   \n",
       "1      A81003        VICTORIA MEDICAL PRACTICE          THE HEALTH CENTRE   \n",
       "2      A81004           WOODLANDS ROAD SURGERY           6 WOODLANDS ROAD   \n",
       "3      A81005               SPRINGWOOD SURGERY         SPRINGWOOD SURGERY   \n",
       "4      A81006  TENNANT STREET MEDICAL PRACTICE       TENNANT ST MED PRACT   \n",
       "...       ...                              ...                        ...   \n",
       "12014  Y05752             MALVERN FRAILTY UNIT     MALVERN COMM. HOSPITAL   \n",
       "12015  Y05757             VC WEST LANCS HC-UCC       ORMSKIRK DG HOSPITAL   \n",
       "12016  Y05758              VC SKELMERSDALE UCC  CONCOURSE SHOPPING CENTRE   \n",
       "12017  Y05762           WEST MERTON ACCESS HUB   THE NELSON HEALTH CENTRE   \n",
       "12018  Y05763    ELY LOCAL URGENT CARE SERVICE     PRINCESS OF WALES HOSP   \n",
       "\n",
       "                   addr_2           borough         village post_code  \n",
       "0           FARRER STREET  STOCKTON ON TEES       CLEVELAND  TS18 2AW  \n",
       "1           VICTORIA ROAD        HARTLEPOOL       CLEVELAND  TS26 8DB  \n",
       "2                     NaN     MIDDLESBROUGH       CLEVELAND   TS1 3BE  \n",
       "3            RECTORY LANE       GUISBOROUGH             NaN  TS14 7DJ  \n",
       "4           FARRER STREET  STOCKTON ON TEES       CLEVELAND  TS18 2AT  \n",
       "...                   ...               ...             ...       ...  \n",
       "12014  185 WORCESTER ROAD           MALVERN  WORCESTERSHIRE  WR14 1EX  \n",
       "12015          WIGAN ROAD          ORMSKIRK      LANCASHIRE   L39 2AZ  \n",
       "12016     116-8 SOUTH WAY      SKELMERSDALE      LANCASHIRE   WN8 6LJ  \n",
       "12017       KINGSTON ROAD         WIMBLEDON             NaN  SW20 8DA  \n",
       "12018           LYNN ROAD               ELY   CAMBRIDGSHIRE   CB6 1DN  \n",
       "\n",
       "[12019 rows x 7 columns]"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "col_names=[ 'code', 'name', 'addr_1', 'addr_2', 'borough', 'village', 'post_code']\n",
    "practices = pd.read_csv('dw-data/practices.csv.gz')\n",
    "practices.columns = col_names\n",
    "practices"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CHEM SUB</th>\n",
       "      <th>NAME</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0101010A0</td>\n",
       "      <td>Alexitol Sodium</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0101010B0</td>\n",
       "      <td>Almasilate</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0101010C0</td>\n",
       "      <td>Aluminium Hydroxide</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0101010D0</td>\n",
       "      <td>Aluminium Hydroxide With Magnesium</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0101010E0</td>\n",
       "      <td>Hydrotalcite</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    CHEM SUB                                NAME\n",
       "0  0101010A0                     Alexitol Sodium\n",
       "1  0101010B0                          Almasilate\n",
       "2  0101010C0                 Aluminium Hydroxide\n",
       "3  0101010D0  Aluminium Hydroxide With Magnesium\n",
       "4  0101010E0                        Hydrotalcite"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem = pd.read_csv('dw-data/chem.csv.gz')\n",
    "chem.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we've loaded in the data, let's first replicate our results from the `PW` miniproject. Note that we are now working with a larger data set so the answers will be different than in the `PW` miniproject even if the analysis is the same."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 1: summary_statistics\n",
    "\n",
    "In the `PW` miniproject we first calculated the total, mean, standard deviation, and quartile statistics of the `'items'`, `'quantity'`', `'nic'`, and `'act_cost'` fields. To do this we had to write some functions to calculate the statistics and apply the functions to our data structure. The DataFrame has a `describe` method that will calculate most (not all) of these things for us.\n",
    "\n",
    "Submit the summary statistics to the grader as a list of tuples: [('act_cost', (total, mean, std, q25, median, q75)), ...]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [],
   "source": [
    "variables = ['items', 'quantity', 'nic', 'act_cost']\n",
    "for var in variables:\n",
    "    (var, (scripts[var].sum(), scripts[var].mean(), scripts[var].std(), scripts[var].quantile(.25), scripts[var].median(), scripts[var].quantile(.75)))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "summary_stats = [(var, (scripts[var].sum(), scripts[var].mean(), scripts[var].std(), scripts[var].quantile(.25), scripts[var].median(), scripts[var].quantile(.75))) for var in variables]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6.0"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts['items'].quantile(.75)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "summary_stats = [('items', (0,) * 6), ('quantity', (0,) * 6), ('nic', (0,) * 6), ('act_cost', (0,) * 6)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Your score:  0.0\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__summary_statistics(summary_stats)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 2: most_common_item\n",
    "\n",
    "We can also easily compute summary statistics on groups within the data. In the `pw` miniproject we had to explicitly construct the groups based on the values of a particular field. Pandas will handle that for us via the `groupby` method. This process is [detailed in the Pandas documentation](https://pandas.pydata.org/pandas-docs/stable/groupby.html).\n",
    "\n",
    "Use `groupby` to calculate the total number of items dispensed for each `'bnf_name'`. Find the item with the highest total and return the result as `[(bnf_name, total)]`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [],
   "source": [
    "group = scripts.groupby(scripts['bnf_name'])['items'].sum().sort_values(ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "bnf_name\n",
       "Omeprazole_Cap E/C 20mg                     218583\n",
       "Paracet_Tab 500mg                           151669\n",
       "Aspirin Disper_Tab 75mg                     148591\n",
       "Simvastatin_Tab 40mg                        132941\n",
       "Amlodipine_Tab 5mg                          128245\n",
       "                                             ...  \n",
       "Quest_Cell Life Antiox Tab                       1\n",
       "Quest_Lactase Tab                                1\n",
       "Juzo Soft Rib Style Class 1 B/Knee Close         1\n",
       "Quetiapine_Oral Soln 12.5mg/5ml                  1\n",
       "ReadyWrap Gauntlet Lymph Gmt                     1\n",
       "Name: items, Length: 13471, dtype: int64"
      ]
     },
     "execution_count": 15,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "group"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [],
   "source": [
    "most_common_item = [(\"Omeprazole_Cap E/C 20mg\", 218583)]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Your score:  1.0\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__most_common_item(most_common_item)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 3: items_by_region\n",
    "\n",
    "Now let's find the most common item by post code. The post code information is in the `practices` DataFrame, and we'll need to `merge` it into the `scripts` DataFrame. Pandas provides [extensive documentation](https://pandas.pydata.org/pandas-docs/stable/merging.html) with diagrammed examples on different methods and approaches for joining data. The `merge` method is only one of many possible options.\n",
    "\n",
    "Return your results as a list of tuples `(post code, item name, amount dispensed as % of total)`. Sort your results ascending alphabetically by post code and take only results from the first 100 post codes.\n",
    "\n",
    "**NOTE:** Some practices have multiple postal codes associated with them. Use the alphabetically first postal code. Note some postal codes may have multiple `'bnf_name'` with the same prescription rate for the maximum. In this case, take the alphabetically first `'bnf_name'` (as in the PW miniproject)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "10843"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "practices['code'].nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of practices: 12019\n",
      "Number of unique practices: 10843\n"
     ]
    }
   ],
   "source": [
    "print(f\"Number of practices: {practices.shape[0]}\")\n",
    "print(f\"Number of unique practices: {practices['code'].nunique()}\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [],
   "source": [
    "practices_unique = practices.sort_values('post_code').drop_duplicates(subset='code', keep='first')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [],
   "source": [
    "scripts_with_post_code = scripts.merge(practices_unique, left_on='practice', right_on='code', how='left')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "      <td>N85639</td>\n",
       "      <td>GP OOH VCH</td>\n",
       "      <td>VICTORIA CENTRAL HOSPITAL</td>\n",
       "      <td>MILL LANE</td>\n",
       "      <td>WALLASEY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>CH44 5UF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106040M0</td>\n",
       "      <td>Movicol Plain_Paed Pdr Sach 6.9g</td>\n",
       "      <td>1</td>\n",
       "      <td>4.38</td>\n",
       "      <td>4.07</td>\n",
       "      <td>30</td>\n",
       "      <td>N85639</td>\n",
       "      <td>GP OOH VCH</td>\n",
       "      <td>VICTORIA CENTRAL HOSPITAL</td>\n",
       "      <td>MILL LANE</td>\n",
       "      <td>WALLASEY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>CH44 5UF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0301011R0</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "      <td>N85639</td>\n",
       "      <td>GP OOH VCH</td>\n",
       "      <td>VICTORIA CENTRAL HOSPITAL</td>\n",
       "      <td>MILL LANE</td>\n",
       "      <td>WALLASEY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>CH44 5UF</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  practice   bnf_code                            bnf_name  items   nic  \\\n",
       "0   N85639  0106020C0               Bisacodyl_Tab E/C 5mg      1  0.39   \n",
       "1   N85639  0106040M0    Movicol Plain_Paed Pdr Sach 6.9g      1  4.38   \n",
       "2   N85639  0301011R0  Salbutamol_Inha 100mcg (200 D) CFF      1  1.50   \n",
       "\n",
       "   act_cost  quantity    code        name                     addr_1  \\\n",
       "0      0.47        12  N85639  GP OOH VCH  VICTORIA CENTRAL HOSPITAL   \n",
       "1      4.07        30  N85639  GP OOH VCH  VICTORIA CENTRAL HOSPITAL   \n",
       "2      1.40         1  N85639  GP OOH VCH  VICTORIA CENTRAL HOSPITAL   \n",
       "\n",
       "      addr_2   borough village post_code  \n",
       "0  MILL LANE  WALLASEY     NaN  CH44 5UF  \n",
       "1  MILL LANE  WALLASEY     NaN  CH44 5UF  \n",
       "2  MILL LANE  WALLASEY     NaN  CH44 5UF  "
      ]
     },
     "execution_count": 22,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_with_post_code.head(3) "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>post_code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon Durable Barrier C</td>\n",
       "      <td>7</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon No Sting Barrier</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abasaglar KwikPen_100u/ml 3ml Pf Pen</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abidec_Dps</td>\n",
       "      <td>63</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Able Spacer + Sml/Med Mask</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                           bnf_name  items\n",
       "post_code                                                 \n",
       "B11 4BW    3m Health Care_Cavilon Durable Barrier C      7\n",
       "B11 4BW     3m Health Care_Cavilon No Sting Barrier      2\n",
       "B11 4BW        Abasaglar KwikPen_100u/ml 3ml Pf Pen      2\n",
       "B11 4BW                                  Abidec_Dps     63\n",
       "B11 4BW                  Able Spacer + Sml/Med Mask      1"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "output = (scripts_with_post_code\n",
    "          .groupby(['post_code', 'bnf_name'])['items'].sum()\n",
    "          .reset_index()\n",
    "          .set_index('post_code'))\n",
    "output.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "post_code\n",
       "B11 4BW    22731\n",
       "B12 9LP    17073\n",
       "B18 7AL    20508\n",
       "B21 9RY    31027\n",
       "B23 6DJ    28011\n",
       "Name: items, dtype: int64"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "total = output.groupby('post_code')['items'].sum()\n",
    "total.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>total</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>post_code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon Durable Barrier C</td>\n",
       "      <td>7</td>\n",
       "      <td>22731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon No Sting Barrier</td>\n",
       "      <td>2</td>\n",
       "      <td>22731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abasaglar KwikPen_100u/ml 3ml Pf Pen</td>\n",
       "      <td>2</td>\n",
       "      <td>22731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abidec_Dps</td>\n",
       "      <td>63</td>\n",
       "      <td>22731</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Able Spacer + Sml/Med Mask</td>\n",
       "      <td>1</td>\n",
       "      <td>22731</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                           bnf_name  items  total\n",
       "post_code                                                        \n",
       "B11 4BW    3m Health Care_Cavilon Durable Barrier C      7  22731\n",
       "B11 4BW     3m Health Care_Cavilon No Sting Barrier      2  22731\n",
       "B11 4BW        Abasaglar KwikPen_100u/ml 3ml Pf Pen      2  22731\n",
       "B11 4BW                                  Abidec_Dps     63  22731\n",
       "B11 4BW                  Able Spacer + Sml/Med Mask      1  22731"
      ]
     },
     "execution_count": 25,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "output['total'] = total\n",
    "output.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {},
   "outputs": [],
   "source": [
    "output['ratio'] = output['items'] / output['total']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>total</th>\n",
       "      <th>ratio</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>post_code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon Durable Barrier C</td>\n",
       "      <td>7</td>\n",
       "      <td>22731</td>\n",
       "      <td>0.000308</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>3m Health Care_Cavilon No Sting Barrier</td>\n",
       "      <td>2</td>\n",
       "      <td>22731</td>\n",
       "      <td>0.000088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abasaglar KwikPen_100u/ml 3ml Pf Pen</td>\n",
       "      <td>2</td>\n",
       "      <td>22731</td>\n",
       "      <td>0.000088</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Abidec_Dps</td>\n",
       "      <td>63</td>\n",
       "      <td>22731</td>\n",
       "      <td>0.002772</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B11 4BW</th>\n",
       "      <td>Able Spacer + Sml/Med Mask</td>\n",
       "      <td>1</td>\n",
       "      <td>22731</td>\n",
       "      <td>0.000044</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                           bnf_name  items  total     ratio\n",
       "post_code                                                                  \n",
       "B11 4BW    3m Health Care_Cavilon Durable Barrier C      7  22731  0.000308\n",
       "B11 4BW     3m Health Care_Cavilon No Sting Barrier      2  22731  0.000088\n",
       "B11 4BW        Abasaglar KwikPen_100u/ml 3ml Pf Pen      2  22731  0.000088\n",
       "B11 4BW                                  Abidec_Dps     63  22731  0.002772\n",
       "B11 4BW                  Able Spacer + Sml/Med Mask      1  22731  0.000044"
      ]
     },
     "execution_count": 27,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "output.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {},
   "outputs": [],
   "source": [
    "result = output.groupby('post_code').apply(lambda df: df.sort_values('ratio', ascending=False).iloc[0])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {},
   "outputs": [],
   "source": [
    "items_by_region = result.reset_index()[['post_code', 'bnf_name', 'ratio']].sort_values('post_code').head(100)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>post_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>ratio</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>B11 4BW</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>0.031059</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>B12 9LP</td>\n",
       "      <td>Paracet_Tab 500mg</td>\n",
       "      <td>0.024893</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>B18 7AL</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>0.027111</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>B21 9RY</td>\n",
       "      <td>Metformin HCl_Tab 500mg</td>\n",
       "      <td>0.033294</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>B23 6DJ</td>\n",
       "      <td>Lansoprazole_Cap 30mg (E/C Gran)</td>\n",
       "      <td>0.021384</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  post_code                            bnf_name     ratio\n",
       "0   B11 4BW  Salbutamol_Inha 100mcg (200 D) CFF  0.031059\n",
       "1   B12 9LP                   Paracet_Tab 500mg  0.024893\n",
       "2   B18 7AL  Salbutamol_Inha 100mcg (200 D) CFF  0.027111\n",
       "3   B21 9RY             Metformin HCl_Tab 500mg  0.033294\n",
       "4   B23 6DJ    Lansoprazole_Cap 30mg (E/C Gran)  0.021384"
      ]
     },
     "execution_count": 30,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "items_by_region.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {},
   "outputs": [],
   "source": [
    "#items_by_region = [(\"B11 4BW\", \"Salbutamol_Inha 100mcg (200 D) CFF\", 0.0310589063)] * 100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Your score:  1.0\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__items_by_region(items_by_region)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 4: script_anomalies\n",
    "\n",
    "Drug abuse is a source of human and monetary costs in health care. A first step in identifying practitioners that enable drug abuse is to look for practices where commonly abused drugs are prescribed unusually often. Let's try to find practices that prescribe an unusually high amount of opioids. The opioids we'll look for are given in the list below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {},
   "outputs": [],
   "source": [
    "opioids = ['morphine', 'oxycodone', 'methadone', 'fentanyl', 'pethidine', 'buprenorphine', 'propoxyphene', 'codeine']"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "These are generic names for drugs, not brand names. Generic drug names can be found using the `'bnf_code'` field in `scripts` along with the `chem` table.. Use the list of opioids provided above along with these fields to make a new field in the `scripts` data that flags whether the row corresponds with a opioid prescription."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106040M0</td>\n",
       "      <td>Movicol Plain_Paed Pdr Sach 6.9g</td>\n",
       "      <td>1</td>\n",
       "      <td>4.38</td>\n",
       "      <td>4.07</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0301011R0</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0304010G0</td>\n",
       "      <td>Chlorphenamine Mal_Oral Soln 2mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>2.62</td>\n",
       "      <td>2.44</td>\n",
       "      <td>150</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0401020K0</td>\n",
       "      <td>Diazepam_Tab 2mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.16</td>\n",
       "      <td>0.26</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  practice   bnf_code                              bnf_name  items   nic  \\\n",
       "0   N85639  0106020C0                 Bisacodyl_Tab E/C 5mg      1  0.39   \n",
       "1   N85639  0106040M0      Movicol Plain_Paed Pdr Sach 6.9g      1  4.38   \n",
       "2   N85639  0301011R0    Salbutamol_Inha 100mcg (200 D) CFF      1  1.50   \n",
       "3   N85639  0304010G0  Chlorphenamine Mal_Oral Soln 2mg/5ml      1  2.62   \n",
       "4   N85639  0401020K0                      Diazepam_Tab 2mg      1  0.16   \n",
       "\n",
       "   act_cost  quantity  \n",
       "0      0.47        12  \n",
       "1      4.07        30  \n",
       "2      1.40         1  \n",
       "3      2.44       150  \n",
       "4      0.26         6  "
      ]
     },
     "execution_count": 34,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CHEM SUB</th>\n",
       "      <th>NAME</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0101010A0</td>\n",
       "      <td>Alexitol Sodium</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0101010B0</td>\n",
       "      <td>Almasilate</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0101010C0</td>\n",
       "      <td>Aluminium Hydroxide</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0101010D0</td>\n",
       "      <td>Aluminium Hydroxide With Magnesium</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>0101010E0</td>\n",
       "      <td>Hydrotalcite</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    CHEM SUB                                NAME\n",
       "0  0101010A0                     Alexitol Sodium\n",
       "1  0101010B0                          Almasilate\n",
       "2  0101010C0                 Aluminium Hydroxide\n",
       "3  0101010D0  Aluminium Hydroxide With Magnesium\n",
       "4  0101010E0                        Hydrotalcite"
      ]
     },
     "execution_count": 35,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(3487, 2)"
      ]
     },
     "execution_count": 36,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 37,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "3481"
      ]
     },
     "execution_count": 37,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem['CHEM SUB'].nunique()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 38,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(3481, 2)"
      ]
     },
     "execution_count": 38,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem = chem.sort_values('CHEM SUB').drop_duplicates(subset='CHEM SUB', keep='first')\n",
    "chem.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>CHEM SUB</th>\n",
       "      <th>NAME</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>010101000</td>\n",
       "      <td>Other Antacid &amp; Simeticone Preps</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>0101010A0</td>\n",
       "      <td>Alexitol Sodium</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0101010B0</td>\n",
       "      <td>Almasilate</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>0101010C0</td>\n",
       "      <td>Aluminium Hydroxide</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>0101010D0</td>\n",
       "      <td>Aluminium Hydroxide With Magnesium</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     CHEM SUB                                NAME\n",
       "18  010101000    Other Antacid & Simeticone Preps\n",
       "0   0101010A0                     Alexitol Sodium\n",
       "1   0101010B0                          Almasilate\n",
       "2   0101010C0                 Aluminium Hydroxide\n",
       "3   0101010D0  Aluminium Hydroxide With Magnesium"
      ]
     },
     "execution_count": 39,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "chem.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Join chem and scripts together\n",
    "#Flag prescriptions that are opiods based upon their value of name"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [],
   "source": [
    "scripts_and_chem = scripts.merge(chem, left_on='bnf_code', right_on='CHEM SUB', how='inner')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "      <th>CHEM SUB</th>\n",
       "      <th>NAME</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>19</td>\n",
       "      <td>28.10</td>\n",
       "      <td>28.14</td>\n",
       "      <td>860</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>50</td>\n",
       "      <td>67.73</td>\n",
       "      <td>67.51</td>\n",
       "      <td>2074</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Suppos 10mg</td>\n",
       "      <td>1</td>\n",
       "      <td>1.77</td>\n",
       "      <td>1.75</td>\n",
       "      <td>6</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Dulcolax_Tab 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>3.78</td>\n",
       "      <td>3.61</td>\n",
       "      <td>56</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  practice   bnf_code               bnf_name  items    nic  act_cost  \\\n",
       "0   N85639  0106020C0  Bisacodyl_Tab E/C 5mg      1   0.39      0.47   \n",
       "1   N81013  0106020C0  Bisacodyl_Tab E/C 5mg     19  28.10     28.14   \n",
       "2   N81029  0106020C0  Bisacodyl_Tab E/C 5mg     50  67.73     67.51   \n",
       "3   N81029  0106020C0  Bisacodyl_Suppos 10mg      1   1.77      1.75   \n",
       "4   N81029  0106020C0       Dulcolax_Tab 5mg      1   3.78      3.61   \n",
       "\n",
       "   quantity   CHEM SUB       NAME  \n",
       "0        12  0106020C0  Bisacodyl  \n",
       "1       860  0106020C0  Bisacodyl  \n",
       "2      2074  0106020C0  Bisacodyl  \n",
       "3         6  0106020C0  Bisacodyl  \n",
       "4        56  0106020C0  Bisacodyl  "
      ]
     },
     "execution_count": 42,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "'Bisacodyl'"
      ]
     },
     "execution_count": 43,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "#checking whether any of the strings in opiods lists appears in the string in column names\n",
    "scripts_and_chem.loc[0, 'NAME']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "False"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "any([opioid in scripts and scripts_and_chem.loc[0, 'NAME'] for opioid in opioids])"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0"
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem['NAME'].isnull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(854444, 9)"
      ]
     },
     "execution_count": 46,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem.shape"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "0         False\n",
       "1         False\n",
       "2         False\n",
       "3         False\n",
       "4         False\n",
       "          ...  \n",
       "854439    False\n",
       "854440    False\n",
       "854441    False\n",
       "854442    False\n",
       "854443    False\n",
       "Name: NAME, Length: 854444, dtype: bool"
      ]
     },
     "execution_count": 47,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem['NAME'].apply(lambda name: any([opioid in name for opioid in opioids]))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "8668"
      ]
     },
     "execution_count": 48,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem['NAME'].str.lower().isin(opioids).sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {},
   "outputs": [],
   "source": [
    "scripts_and_chem['is_opioid'] = scripts_and_chem['NAME'].str.lower().isin(opioids)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "8668"
      ]
     },
     "execution_count": 50,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem['is_opioid'].sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "      <th>CHEM SUB</th>\n",
       "      <th>NAME</th>\n",
       "      <th>is_opioid</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>359222</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl_Transdermal Patch 12mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>12.59</td>\n",
       "      <td>11.67</td>\n",
       "      <td>5</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359223</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl_Transdermal Patch 37.5mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>30.92</td>\n",
       "      <td>28.85</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359224</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 25mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>53.97</td>\n",
       "      <td>49.98</td>\n",
       "      <td>15</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359225</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 12mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>37.77</td>\n",
       "      <td>34.98</td>\n",
       "      <td>15</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359226</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 12mcg/hr</td>\n",
       "      <td>3</td>\n",
       "      <td>22.56</td>\n",
       "      <td>20.92</td>\n",
       "      <td>15</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359227</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 25mcg/hr</td>\n",
       "      <td>3</td>\n",
       "      <td>43.04</td>\n",
       "      <td>39.88</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359228</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 50mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>40.24</td>\n",
       "      <td>37.28</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359229</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 100mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>138.36</td>\n",
       "      <td>128.12</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359230</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 12mcg/hr</td>\n",
       "      <td>5</td>\n",
       "      <td>42.30</td>\n",
       "      <td>39.22</td>\n",
       "      <td>25</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359231</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 25mcg/hr</td>\n",
       "      <td>4</td>\n",
       "      <td>60.50</td>\n",
       "      <td>56.06</td>\n",
       "      <td>25</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359232</th>\n",
       "      <td>N81013</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 50mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>45.24</td>\n",
       "      <td>41.89</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359233</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 25mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>35.98</td>\n",
       "      <td>33.32</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359234</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 75mcg</td>\n",
       "      <td>2</td>\n",
       "      <td>140.97</td>\n",
       "      <td>130.52</td>\n",
       "      <td>15</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359235</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 100mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>115.72</td>\n",
       "      <td>107.14</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359236</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 12mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>25.18</td>\n",
       "      <td>23.32</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359237</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 12mcg/hr</td>\n",
       "      <td>7</td>\n",
       "      <td>82.72</td>\n",
       "      <td>76.67</td>\n",
       "      <td>55</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359238</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 25mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>43.04</td>\n",
       "      <td>39.86</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359239</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 50mcg/hr</td>\n",
       "      <td>6</td>\n",
       "      <td>185.10</td>\n",
       "      <td>171.53</td>\n",
       "      <td>46</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359240</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 75mcg/hr</td>\n",
       "      <td>4</td>\n",
       "      <td>196.42</td>\n",
       "      <td>181.89</td>\n",
       "      <td>35</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359241</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 12mcg/hr</td>\n",
       "      <td>3</td>\n",
       "      <td>50.76</td>\n",
       "      <td>47.04</td>\n",
       "      <td>30</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359242</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 25mcg/hr</td>\n",
       "      <td>5</td>\n",
       "      <td>145.20</td>\n",
       "      <td>134.49</td>\n",
       "      <td>60</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359243</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 50mcg/hr</td>\n",
       "      <td>4</td>\n",
       "      <td>158.34</td>\n",
       "      <td>146.63</td>\n",
       "      <td>35</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359244</th>\n",
       "      <td>N81029</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fencino_Transdermal Patch 75mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>126.16</td>\n",
       "      <td>116.82</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359245</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl_Transdermal Patch 25mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>53.97</td>\n",
       "      <td>49.99</td>\n",
       "      <td>15</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359246</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl_Transdermal Patch 12mcg/hr</td>\n",
       "      <td>7</td>\n",
       "      <td>100.72</td>\n",
       "      <td>93.33</td>\n",
       "      <td>40</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359247</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl_Tab Buccal 400mcg S/F</td>\n",
       "      <td>5</td>\n",
       "      <td>628.74</td>\n",
       "      <td>582.33</td>\n",
       "      <td>126</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359248</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 50mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>67.32</td>\n",
       "      <td>62.33</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359249</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Durogesic DTrans_T/Derm Patch 100mcg</td>\n",
       "      <td>1</td>\n",
       "      <td>115.72</td>\n",
       "      <td>107.14</td>\n",
       "      <td>10</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359250</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 12mcg/hr</td>\n",
       "      <td>11</td>\n",
       "      <td>103.78</td>\n",
       "      <td>96.30</td>\n",
       "      <td>69</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>359251</th>\n",
       "      <td>N81062</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Matrifen_Patch 25mcg/hr</td>\n",
       "      <td>12</td>\n",
       "      <td>172.16</td>\n",
       "      <td>159.81</td>\n",
       "      <td>80</td>\n",
       "      <td>0407020A0</td>\n",
       "      <td>Fentanyl</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367860</th>\n",
       "      <td>J81065</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 5mcg/hr (7day)</td>\n",
       "      <td>2</td>\n",
       "      <td>79.20</td>\n",
       "      <td>73.45</td>\n",
       "      <td>18</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367861</th>\n",
       "      <td>J81065</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 10mcg/hr (7day)</td>\n",
       "      <td>1</td>\n",
       "      <td>31.55</td>\n",
       "      <td>29.22</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367862</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 35mcg/hr (96hr)</td>\n",
       "      <td>1</td>\n",
       "      <td>47.40</td>\n",
       "      <td>43.89</td>\n",
       "      <td>12</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367863</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 70mcg/hr (96hr)</td>\n",
       "      <td>1</td>\n",
       "      <td>63.20</td>\n",
       "      <td>58.52</td>\n",
       "      <td>8</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367864</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 5mcg/hr (7day)</td>\n",
       "      <td>16</td>\n",
       "      <td>281.60</td>\n",
       "      <td>260.90</td>\n",
       "      <td>64</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367865</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 10mcg/hr (7day)</td>\n",
       "      <td>16</td>\n",
       "      <td>536.35</td>\n",
       "      <td>496.73</td>\n",
       "      <td>68</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367866</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 20mcg/hr (7day)</td>\n",
       "      <td>7</td>\n",
       "      <td>560.24</td>\n",
       "      <td>518.84</td>\n",
       "      <td>39</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367867</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 15mcg/hr (7day)</td>\n",
       "      <td>1</td>\n",
       "      <td>49.15</td>\n",
       "      <td>45.51</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367868</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 5mcg/hr</td>\n",
       "      <td>4</td>\n",
       "      <td>88.00</td>\n",
       "      <td>81.52</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367869</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 10mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>31.55</td>\n",
       "      <td>29.22</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367870</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 20mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>57.46</td>\n",
       "      <td>53.21</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367871</th>\n",
       "      <td>H81027</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 15mcg/hr</td>\n",
       "      <td>2</td>\n",
       "      <td>61.44</td>\n",
       "      <td>57.00</td>\n",
       "      <td>5</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367872</th>\n",
       "      <td>H81097</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 35mcg/hr (96hr)</td>\n",
       "      <td>1</td>\n",
       "      <td>63.20</td>\n",
       "      <td>58.52</td>\n",
       "      <td>16</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367873</th>\n",
       "      <td>H81097</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 5mcg/hr (7day)</td>\n",
       "      <td>11</td>\n",
       "      <td>171.60</td>\n",
       "      <td>159.20</td>\n",
       "      <td>39</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367874</th>\n",
       "      <td>H81097</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 10mcg/hr (7day)</td>\n",
       "      <td>13</td>\n",
       "      <td>315.51</td>\n",
       "      <td>292.65</td>\n",
       "      <td>40</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367875</th>\n",
       "      <td>H81097</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 20mcg/hr (7day)</td>\n",
       "      <td>1</td>\n",
       "      <td>57.46</td>\n",
       "      <td>53.21</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367876</th>\n",
       "      <td>H81097</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 15mcg/hr (7day)</td>\n",
       "      <td>1</td>\n",
       "      <td>49.15</td>\n",
       "      <td>45.51</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367877</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 35mcg/hr (96hr)</td>\n",
       "      <td>1</td>\n",
       "      <td>79.00</td>\n",
       "      <td>73.15</td>\n",
       "      <td>20</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367878</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 70mcg/hr (96hr)</td>\n",
       "      <td>1</td>\n",
       "      <td>31.60</td>\n",
       "      <td>29.27</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367879</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 5mcg/hr (7day)</td>\n",
       "      <td>18</td>\n",
       "      <td>330.00</td>\n",
       "      <td>305.93</td>\n",
       "      <td>75</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367880</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 10mcg/hr (7day)</td>\n",
       "      <td>10</td>\n",
       "      <td>347.05</td>\n",
       "      <td>321.41</td>\n",
       "      <td>44</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367881</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 20mcg/hr (7day)</td>\n",
       "      <td>3</td>\n",
       "      <td>172.38</td>\n",
       "      <td>159.62</td>\n",
       "      <td>12</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367882</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine_Patch 15mcg/hr (7day)</td>\n",
       "      <td>1</td>\n",
       "      <td>49.15</td>\n",
       "      <td>45.51</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367883</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Transtec_T/Derm Patch 52.5mcg/hr (30mg)</td>\n",
       "      <td>1</td>\n",
       "      <td>47.42</td>\n",
       "      <td>43.91</td>\n",
       "      <td>8</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367884</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Transtec_T/Derm Patch 70mcg/hr (40mg)</td>\n",
       "      <td>2</td>\n",
       "      <td>126.40</td>\n",
       "      <td>117.04</td>\n",
       "      <td>16</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367885</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 5mcg/hr</td>\n",
       "      <td>4</td>\n",
       "      <td>70.40</td>\n",
       "      <td>65.24</td>\n",
       "      <td>16</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367886</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 10mcg/hr</td>\n",
       "      <td>5</td>\n",
       "      <td>189.30</td>\n",
       "      <td>175.31</td>\n",
       "      <td>24</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367887</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>BuTrans_Transdermal Patch 15mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>49.15</td>\n",
       "      <td>45.51</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367888</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Butec_Transdermal Patch 5mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>7.92</td>\n",
       "      <td>7.34</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>367889</th>\n",
       "      <td>H81615</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Butec_Transdermal Patch 10mcg/hr</td>\n",
       "      <td>1</td>\n",
       "      <td>14.20</td>\n",
       "      <td>13.16</td>\n",
       "      <td>4</td>\n",
       "      <td>0407020B0</td>\n",
       "      <td>Buprenorphine</td>\n",
       "      <td>True</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>8668 rows × 10 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "       practice   bnf_code                               bnf_name  items  \\\n",
       "359222   N81013  0407020A0    Fentanyl_Transdermal Patch 12mcg/hr      1   \n",
       "359223   N81013  0407020A0  Fentanyl_Transdermal Patch 37.5mcg/hr      2   \n",
       "359224   N81013  0407020A0    Durogesic DTrans_T/Derm Patch 25mcg      1   \n",
       "359225   N81013  0407020A0    Durogesic DTrans_T/Derm Patch 12mcg      1   \n",
       "359226   N81013  0407020A0                Matrifen_Patch 12mcg/hr      3   \n",
       "...         ...        ...                                    ...    ...   \n",
       "367885   H81615  0407020B0      BuTrans_Transdermal Patch 5mcg/hr      4   \n",
       "367886   H81615  0407020B0     BuTrans_Transdermal Patch 10mcg/hr      5   \n",
       "367887   H81615  0407020B0     BuTrans_Transdermal Patch 15mcg/hr      1   \n",
       "367888   H81615  0407020B0        Butec_Transdermal Patch 5mcg/hr      1   \n",
       "367889   H81615  0407020B0       Butec_Transdermal Patch 10mcg/hr      1   \n",
       "\n",
       "           nic  act_cost  quantity   CHEM SUB           NAME  is_opioid  \n",
       "359222   12.59     11.67         5  0407020A0       Fentanyl       True  \n",
       "359223   30.92     28.85        10  0407020A0       Fentanyl       True  \n",
       "359224   53.97     49.98        15  0407020A0       Fentanyl       True  \n",
       "359225   37.77     34.98        15  0407020A0       Fentanyl       True  \n",
       "359226   22.56     20.92        15  0407020A0       Fentanyl       True  \n",
       "...        ...       ...       ...        ...            ...        ...  \n",
       "367885   70.40     65.24        16  0407020B0  Buprenorphine       True  \n",
       "367886  189.30    175.31        24  0407020B0  Buprenorphine       True  \n",
       "367887   49.15     45.51         4  0407020B0  Buprenorphine       True  \n",
       "367888    7.92      7.34         4  0407020B0  Buprenorphine       True  \n",
       "367889   14.20     13.16         4  0407020B0  Buprenorphine       True  \n",
       "\n",
       "[8668 rows x 10 columns]"
      ]
     },
     "execution_count": 51,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem[scripts_and_chem['is_opioid']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {},
   "outputs": [],
   "source": [
    "#scripts_and_chem['NAME'].str.lower().isin(opioids)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {},
   "outputs": [],
   "source": [
    "#chem['is_opioid'] = scripts_and_chem['NAME'].str.lower().isin(opioids)\n",
    "#scripts_and_chem = scripts.merge(chem[['CHEM SUB', 'is_opioid']], left_on='bnf_code', right_on='CHEM SUB', how='inner') "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {},
   "outputs": [],
   "source": [
    "#chem['NAME'].str.lower().isin(opioids).sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {},
   "outputs": [],
   "source": [
    "#scripts_and_chem.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {},
   "outputs": [],
   "source": [
    "#scripts_and_chem['is_opioid'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {},
   "outputs": [],
   "source": [
    "#scripts_and_chem['NAME'].apply(lambda name: any(opioid in name for opioid in opioids))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now for each practice calculate the proportion of its prescriptions containing opioids.\n",
    "\n",
    "**Hint:** Consider the following list: `[0, 1, 1, 0, 0, 0]`. What proportion of the entries are 1s? What is the mean value?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "practice\n",
       "A81005    0.007109\n",
       "A81007    0.013147\n",
       "A81011    0.014749\n",
       "A81012    0.010239\n",
       "A81017    0.014658\n",
       "            ...   \n",
       "Y05570    0.000000\n",
       "Y05583    0.000000\n",
       "Y05597    0.000000\n",
       "Y05660    0.000000\n",
       "Y05670    0.000000\n",
       "Name: is_opioid, Length: 850, dtype: float64"
      ]
     },
     "execution_count": 58,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem.groupby('practice')['is_opioid'].mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 59,
   "metadata": {},
   "outputs": [],
   "source": [
    "opioids_per_practice = scripts_and_chem.groupby('practice')['is_opioid'].mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "practice\n",
       "A81005    0.007109\n",
       "A81007    0.013147\n",
       "A81011    0.014749\n",
       "A81012    0.010239\n",
       "A81017    0.014658\n",
       "Name: is_opioid, dtype: float64"
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "opioids_per_practice.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "How do these proportions compare to the overall opioid prescription rate? Subtract off the proportion of all prescriptions that are opioids from each practice's proportion."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 61,
   "metadata": {},
   "outputs": [],
   "source": [
    "relative_opioids_per_practice = opioids_per_practice - scripts_and_chem['is_opioid'].mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 62,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "practice\n",
       "A81005   -0.003036\n",
       "A81007    0.003002\n",
       "A81011    0.004605\n",
       "A81012    0.000094\n",
       "A81017    0.004513\n",
       "            ...   \n",
       "Y05570   -0.010145\n",
       "Y05583   -0.010145\n",
       "Y05597   -0.010145\n",
       "Y05660   -0.010145\n",
       "Y05670   -0.010145\n",
       "Name: is_opioid, Length: 850, dtype: float64"
      ]
     },
     "execution_count": 62,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "relative_opioids_per_practice"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we know the difference between each practice's opioid prescription rate and the overall rate, we can identify which practices prescribe opioids at above average or below average rates. However, are the differences from the overall rate important or just random deviations? In other words, are the differences from the overall rate big or small?\n",
    "\n",
    "To answer this question we have to quantify the difference we would typically expect between a given practice's opioid prescription rate and the overall rate. This quantity is called the **standard error**, and is related to the **standard deviation**, $\\sigma$. The standard error in this case is\n",
    "\n",
    "$$ \\frac{\\sigma}{\\sqrt{n}} $$\n",
    "\n",
    "where $n$ is the number of prescriptions each practice made. Calculate the standard error for each practice. Then divide `relative_opioids_per_practice` by the standard errors. We'll call the final result `opioid_scores`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Denoinator is standard deviation of global opioid rate divided by number of prescriptions per practice\n",
    "#need to determine the number of prescriptions per practice"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 64,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "practice\n",
       "A81005    1266\n",
       "A81007    1217\n",
       "A81011    1356\n",
       "A81012    1172\n",
       "A81017    1842\n",
       "          ... \n",
       "Y05570      22\n",
       "Y05583      28\n",
       "Y05597      18\n",
       "Y05660     314\n",
       "Y05670      11\n",
       "Name: is_opioid, Length: 850, dtype: int64"
      ]
     },
     "execution_count": 64,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem.groupby('practice')['is_opioid'].count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 65,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "N83028    2402\n",
       "L83100    2239\n",
       "D81043    2099\n",
       "B81008    2081\n",
       "G81013    2004\n",
       "          ... \n",
       "Y03179       1\n",
       "Y01174       1\n",
       "Y03010       1\n",
       "Y05366       1\n",
       "Y03472       1\n",
       "Name: practice, Length: 850, dtype: int64"
      ]
     },
     "execution_count": 65,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts_and_chem['practice'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 66,
   "metadata": {},
   "outputs": [],
   "source": [
    "standard_error_per_practice = scripts_and_chem['is_opioid'].std() / scripts_and_chem['practice'].value_counts() ** 0.5\n",
    "opioid_scores = relative_opioids_per_practice / standard_error_per_practice"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 67,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "N83028    0.002045\n",
       "L83100    0.002118\n",
       "D81043    0.002187\n",
       "B81008    0.002197\n",
       "G81013    0.002238\n",
       "Name: practice, dtype: float64"
      ]
     },
     "execution_count": 67,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "standard_error_per_practice.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 68,
   "metadata": {},
   "outputs": [],
   "source": [
    "opioid_scores.name = \"z-score\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The quantity we have calculated in `opioid_scores` is called a **z-score**:\n",
    "\n",
    "$$ \\frac{\\bar{X} - \\mu}{\\sqrt{\\sigma^2/n}} $$\n",
    "\n",
    "Here $\\bar{X}$ corresponds with the proportion for each practice, $\\mu$ corresponds with the proportion across all practices, $\\sigma^2$ corresponds with the variance of the proportion across all practices, and $n$ is the number of prescriptions made by each practice. Notice $\\bar{X}$ and $n$ will be different for each practice, while $\\mu$ and $\\sigma$ are determined across all prescriptions, and so are the same for every z-score. The z-score is a useful statistical tool used for hypothesis testing, finding outliers, and comparing data about different types of objects or events.\n",
    "\n",
    "Now that we've calculated this statistic, take the 100 practices with the largest z-score. Return your result as a list of tuples in the form `(practice_name, z-score, number_of_scripts)`. Sort your tuples by z-score in descending order. Note that some practice codes will correspond with multiple names. In this case, use the first match when sorting names alphabetically."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 69,
   "metadata": {},
   "outputs": [],
   "source": [
    "unique_practices = practices.sort_values('name').drop_duplicates(subset='code', keep='first')\n",
    "#anomalies = [(\"NATIONAL ENHANCED SERVICE\", 11.6958178629, 7)] * 100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>7011</th>\n",
       "      <td>P87657</td>\n",
       "      <td>(IRLAM) SALFORD CARE CTRS MEDICAL PRACTI</td>\n",
       "      <td>SALFORD CARE CTR(IRLAM)</td>\n",
       "      <td>125 LIVERPOOL ROAD</td>\n",
       "      <td>IRLAM</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>M44 6DP</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10921</th>\n",
       "      <td>Y05381</td>\n",
       "      <td>0-19 EAST CHESHIRE HEALTH VISITORS</td>\n",
       "      <td>SALINAE CLINIC</td>\n",
       "      <td>LEWIN STREET</td>\n",
       "      <td>MIDDLEWICH</td>\n",
       "      <td>CHESHIRE</td>\n",
       "      <td>CW10 9FG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11983</th>\n",
       "      <td>Y04082</td>\n",
       "      <td>0-19 PUBLIC HEALTH SERVICE HARTLEPOOL</td>\n",
       "      <td>CHATHAM CHILDRENS CENTRE</td>\n",
       "      <td>29 CHATHAM ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS24 8QG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7572</th>\n",
       "      <td>Y00364</td>\n",
       "      <td>1 TO 1 CENTRE</td>\n",
       "      <td>BRENKLEY AVENUE</td>\n",
       "      <td>SHIREMOOR</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NE27 0PR</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6835</th>\n",
       "      <td>P87652</td>\n",
       "      <td>1/LOWER BROUGHTON MEDICAL PRACTICE</td>\n",
       "      <td>LOWER BROUGHTON HTH.CTR.</td>\n",
       "      <td>GREAT CLOWES STREET</td>\n",
       "      <td>SALFORD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M7 1RD</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         code                                      name  \\\n",
       "7011   P87657  (IRLAM) SALFORD CARE CTRS MEDICAL PRACTI   \n",
       "10921  Y05381        0-19 EAST CHESHIRE HEALTH VISITORS   \n",
       "11983  Y04082     0-19 PUBLIC HEALTH SERVICE HARTLEPOOL   \n",
       "7572   Y00364                             1 TO 1 CENTRE   \n",
       "6835   P87652        1/LOWER BROUGHTON MEDICAL PRACTICE   \n",
       "\n",
       "                         addr_1               addr_2              borough  \\\n",
       "7011    SALFORD CARE CTR(IRLAM)   125 LIVERPOOL ROAD                IRLAM   \n",
       "10921            SALINAE CLINIC         LEWIN STREET           MIDDLEWICH   \n",
       "11983  CHATHAM CHILDRENS CENTRE      29 CHATHAM ROAD           HARTLEPOOL   \n",
       "7572            BRENKLEY AVENUE            SHIREMOOR  NEWCASTLE UPON TYNE   \n",
       "6835   LOWER BROUGHTON HTH.CTR.  GREAT CLOWES STREET              SALFORD   \n",
       "\n",
       "          village post_code  \n",
       "7011   MANCHESTER   M44 6DP  \n",
       "10921    CHESHIRE  CW10 9FG  \n",
       "11983         NaN  TS24 8QG  \n",
       "7572          NaN  NE27 0PR  \n",
       "6835          NaN    M7 1RD  "
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 71,
   "metadata": {
    "scrolled": false
   },
   "outputs": [],
   "source": [
    "unique_practices = unique_practices.merge(opioid_scores, left_on='code', right_index=True)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 72,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "practice\n",
       "A81005    1507\n",
       "A81007    1454\n",
       "A81011    1568\n",
       "A81012    1332\n",
       "A81017    2150\n",
       "          ... \n",
       "Y05570      22\n",
       "Y05583      28\n",
       "Y05597      18\n",
       "Y05660     347\n",
       "Y05670      12\n",
       "Name: practice, Length: 856, dtype: int64"
      ]
     },
     "execution_count": 72,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts.groupby('practice')['practice'].count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "973193"
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts['practice'].count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 74,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "N83028    2844\n",
       "L83100    2797\n",
       "D81043    2459\n",
       "B81008    2396\n",
       "B81026    2347\n",
       "          ... \n",
       "Y03010       1\n",
       "Y01174       1\n",
       "C85617       1\n",
       "Y03472       1\n",
       "Y03179       1\n",
       "Name: practice, Length: 856, dtype: int64"
      ]
     },
     "execution_count": 74,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "x = scripts['practice'].value_counts()\n",
    "x"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [],
   "source": [
    "unique_practices['count'] = scripts.groupby('practice')['practice'].count()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 76,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6835    NaN\n",
       "6484    NaN\n",
       "6907    NaN\n",
       "7201    NaN\n",
       "6493    NaN\n",
       "         ..\n",
       "9388    NaN\n",
       "6102    NaN\n",
       "11397   NaN\n",
       "5340    NaN\n",
       "6613    NaN\n",
       "Name: count, Length: 850, dtype: float64"
      ]
     },
     "execution_count": 76,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices['count']"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 77,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "      <th>z-score</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>7453</th>\n",
       "      <td>G81703</td>\n",
       "      <td>H&amp;R P C SPECIAL SCHEME</td>\n",
       "      <td>STATION PLAZA HEALTH CTR</td>\n",
       "      <td>STATION APPROACH</td>\n",
       "      <td>HASTINGS</td>\n",
       "      <td>EAST SUSSEX</td>\n",
       "      <td>TN34 1BA</td>\n",
       "      <td>4.382195</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>474</th>\n",
       "      <td>B81069</td>\n",
       "      <td>PRACTICE 3  MEDICAL CENTRE  BRIDLINGTON</td>\n",
       "      <td>THE MEDICAL CENTRE</td>\n",
       "      <td>STATION AVENUE</td>\n",
       "      <td>BRIDLINGTON</td>\n",
       "      <td>EAST RIDING OF YORKSHIRE</td>\n",
       "      <td>YO16 4LZ</td>\n",
       "      <td>4.202988</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>528</th>\n",
       "      <td>B82001</td>\n",
       "      <td>FALSGRAVE SURGERY</td>\n",
       "      <td>FALSGRAVE SURGERY</td>\n",
       "      <td>LAWRENCE HOUSE MED CTR</td>\n",
       "      <td>1 BELGRAVE CRESCENT</td>\n",
       "      <td>SCARBOROUGH</td>\n",
       "      <td>YO11 1UB</td>\n",
       "      <td>3.558981</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7953</th>\n",
       "      <td>Y01852</td>\n",
       "      <td>NATIONAL ENHANCED SERVICE</td>\n",
       "      <td>NYE BEVAN HOUSE</td>\n",
       "      <td>MACLURE ROAD</td>\n",
       "      <td>ROCHDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>OL11 1DN</td>\n",
       "      <td>3.503944</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1363</th>\n",
       "      <td>C85008</td>\n",
       "      <td>HOYLAND FIRST PMS PRACTICE</td>\n",
       "      <td>HOYLAND FIRST PMS PRACT.</td>\n",
       "      <td>WALDERSLADE  HIGH CROFT</td>\n",
       "      <td>HOYLAND  BARNSLEY</td>\n",
       "      <td>SOUTH YORKSHIRE</td>\n",
       "      <td>S74 9AF</td>\n",
       "      <td>3.485717</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>782</th>\n",
       "      <td>B86016</td>\n",
       "      <td>SHAFTESBURY MEDICAL CTR.</td>\n",
       "      <td>SHAFTESBURY MEDICAL CTR</td>\n",
       "      <td>78 OSMONDTHORPE LANE</td>\n",
       "      <td>LEEDS</td>\n",
       "      <td>WEST YORKSHIRE</td>\n",
       "      <td>LS9 9EF</td>\n",
       "      <td>3.380592</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7216</th>\n",
       "      <td>M82619</td>\n",
       "      <td>LAWLEY MEDICAL PRACTICE</td>\n",
       "      <td>LAWLEY MEDICAL PRACTICE</td>\n",
       "      <td>FARRIERS GRN LAWLEY BANK</td>\n",
       "      <td>TELFORD</td>\n",
       "      <td>SHROPSHIRE</td>\n",
       "      <td>TF4 2LL</td>\n",
       "      <td>2.953124</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5637</th>\n",
       "      <td>M91022</td>\n",
       "      <td>HARDEN SURGERY</td>\n",
       "      <td>HARDEN HEALTH CENTRE</td>\n",
       "      <td>HARDEN ROAD  BLOXWICH</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS3 1ET</td>\n",
       "      <td>2.925944</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5639</th>\n",
       "      <td>M91025</td>\n",
       "      <td>DARLASTON HEALTH CENTRE</td>\n",
       "      <td>DARLASTON HEALTH CENTRE</td>\n",
       "      <td>PINFOLD STREET</td>\n",
       "      <td>DARLASTON</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS10 8SY</td>\n",
       "      <td>2.875986</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6102</th>\n",
       "      <td>P81057</td>\n",
       "      <td>WORDEN MEDICAL CENTRE</td>\n",
       "      <td>WORDEN MEDICAL CENTRE</td>\n",
       "      <td>WEST PADDOCK  LEYLAND</td>\n",
       "      <td>PRESTON</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>PR25 1HR</td>\n",
       "      <td>2.796668</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5719</th>\n",
       "      <td>N81013</td>\n",
       "      <td>HIGH STREET SURGERY</td>\n",
       "      <td>HIGH STREET SURGERY</td>\n",
       "      <td>WATERS GREEN MEDICAL CTR</td>\n",
       "      <td>SUNDERLAND STREET</td>\n",
       "      <td>MACCLESFIELD  CHESHIRE</td>\n",
       "      <td>SK11 6JL</td>\n",
       "      <td>2.793431</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9388</th>\n",
       "      <td>Y04531</td>\n",
       "      <td>WOODSIDE GROUP PRACTICE-CICS</td>\n",
       "      <td>3 ENMORE ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SOUTH NORWOOD</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>SE25 5NT</td>\n",
       "      <td>2.788933</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1272</th>\n",
       "      <td>C84064</td>\n",
       "      <td>PARKSIDE MEDICAL CENTRE</td>\n",
       "      <td>BULWELL RIVERSIDE CENTRE</td>\n",
       "      <td>MAIN STREET  BULWELL</td>\n",
       "      <td>NOTTINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NG6 8QJ</td>\n",
       "      <td>2.785874</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1251</th>\n",
       "      <td>C84035</td>\n",
       "      <td>CROWN HOUSE SURGERY</td>\n",
       "      <td>RETFORD PRIMARY CARE CTR</td>\n",
       "      <td>RETFORD HOSPITAL NORTH RD</td>\n",
       "      <td>RETFORD</td>\n",
       "      <td>NOTTINGHAMSHIRE</td>\n",
       "      <td>DN22 7XF</td>\n",
       "      <td>2.753678</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6351</th>\n",
       "      <td>P84032</td>\n",
       "      <td>DR MOKASHI</td>\n",
       "      <td>CLAYTON HEALTH CENTRE</td>\n",
       "      <td>89 NORTH ROAD  CLAYTON</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>M11 4EJ</td>\n",
       "      <td>2.721410</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5641</th>\n",
       "      <td>M91028</td>\n",
       "      <td>BERKLEY PRACTICE</td>\n",
       "      <td>BENTLEY MEDICAL CENTRE</td>\n",
       "      <td>CHURCHILL ROAD  BENTLEY</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS2 0BA</td>\n",
       "      <td>2.711558</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2419</th>\n",
       "      <td>F81106</td>\n",
       "      <td>THE ROSS PRACTICE</td>\n",
       "      <td>THE ROSS PRACTICE</td>\n",
       "      <td>KEATS HOUSE  BUSH FAIR</td>\n",
       "      <td>HARLOW</td>\n",
       "      <td>ESSEX</td>\n",
       "      <td>CM18 6LY</td>\n",
       "      <td>2.600867</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1375</th>\n",
       "      <td>C85022</td>\n",
       "      <td>HOYLAND MEDICAL PRACTICE</td>\n",
       "      <td>THE HOYLAND CENTRE</td>\n",
       "      <td>HIGH CROFT  HOYLAND</td>\n",
       "      <td>BARNSLEY</td>\n",
       "      <td>SOUTH YORKSHIRE</td>\n",
       "      <td>S74 9AF</td>\n",
       "      <td>2.564347</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1232</th>\n",
       "      <td>C84013</td>\n",
       "      <td>BRIDGEGATE AND TALL TREES PARTNERSHIP</td>\n",
       "      <td>RETFORD PRIMARY CARE CTR</td>\n",
       "      <td>RETFORD HOSPITAL NORTH RD</td>\n",
       "      <td>RETFORD</td>\n",
       "      <td>NOTTINGHAMSHIRE</td>\n",
       "      <td>DN22 7XF</td>\n",
       "      <td>2.542253</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10200</th>\n",
       "      <td>P81025</td>\n",
       "      <td>THE RICHMOND HILL PRACTICE</td>\n",
       "      <td>COLNE HEALTH CENTRE</td>\n",
       "      <td>CRADDOCK ROAD</td>\n",
       "      <td>COLNE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB8 0JZ</td>\n",
       "      <td>2.531105</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1180</th>\n",
       "      <td>C83047</td>\n",
       "      <td>WESTSIDE SURGERY</td>\n",
       "      <td>WESTSIDE SURGERY</td>\n",
       "      <td>SLEAFORD ROAD MEDICAL CTR</td>\n",
       "      <td>BOSTON</td>\n",
       "      <td>LINCOLNSHIRE</td>\n",
       "      <td>PE21 8EG</td>\n",
       "      <td>2.510380</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5636</th>\n",
       "      <td>M91021</td>\n",
       "      <td>LOCKSTOWN PRACTICE</td>\n",
       "      <td>WILLENHALL MEDICAL CENTRE</td>\n",
       "      <td>GOMER STREET</td>\n",
       "      <td>WILLENHALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WV13 2DR</td>\n",
       "      <td>2.483925</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>886</th>\n",
       "      <td>B87031</td>\n",
       "      <td>CHURCH STREET SURGERY</td>\n",
       "      <td>CHURCH STREET SURGERY</td>\n",
       "      <td>OSSETT HEALTH VILLAGE</td>\n",
       "      <td>OSSETT</td>\n",
       "      <td>WEST YORKSHIRE</td>\n",
       "      <td>WF5 8DF</td>\n",
       "      <td>2.411500</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6116</th>\n",
       "      <td>P81073</td>\n",
       "      <td>CLEVELEYS GROUP PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>KELSO AVENUE  CLEVELEYS</td>\n",
       "      <td>BLACKPOOL</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>FY5 3LF</td>\n",
       "      <td>2.406786</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6216</th>\n",
       "      <td>P81668</td>\n",
       "      <td>FLEETWOOD SURGERY</td>\n",
       "      <td>WEST VIEW HEALTH VILLAGE</td>\n",
       "      <td>BROADWAY</td>\n",
       "      <td>FLEETWOOD</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>FY7 8GU</td>\n",
       "      <td>2.350974</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6915</th>\n",
       "      <td>M91655</td>\n",
       "      <td>COALPOOL SURGERY</td>\n",
       "      <td>HARDEN HEALTH CENTRE</td>\n",
       "      <td>HARDEN ROAD  BLOXWICH</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS3 1ET</td>\n",
       "      <td>2.339351</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6554</th>\n",
       "      <td>P89008</td>\n",
       "      <td>BEDFORD HOUSE MEDICAL CENTRE</td>\n",
       "      <td>BEDFORD HOUSE MEDICAL CTR</td>\n",
       "      <td>GLEBE STREET</td>\n",
       "      <td>ASHTON-UNDER-LYNE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>OL6 6HD</td>\n",
       "      <td>2.335298</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1357</th>\n",
       "      <td>C85001</td>\n",
       "      <td>GOLDTHORPE MEDICAL CENTRE PMS PRACTICE</td>\n",
       "      <td>THE GOLDTHORPE CENTRE</td>\n",
       "      <td>GOLDTHORPE GRN GOLDTHORPE</td>\n",
       "      <td>ROTHERHAM</td>\n",
       "      <td>SOUTH YORKSHIRE</td>\n",
       "      <td>S63 9EH</td>\n",
       "      <td>2.318178</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2369</th>\n",
       "      <td>F81047</td>\n",
       "      <td>THE HAMILTON PRACTICE</td>\n",
       "      <td>KEATS HOUSE</td>\n",
       "      <td>BUSH FAIR</td>\n",
       "      <td>HARLOW</td>\n",
       "      <td>ESSEX</td>\n",
       "      <td>CM18 6LY</td>\n",
       "      <td>2.318097</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>412</th>\n",
       "      <td>B81002</td>\n",
       "      <td>DR AK CHOUDHARY &amp; DR SR DANDA PRACTICE</td>\n",
       "      <td>BRANSHOLME SOUTH HTH CTR</td>\n",
       "      <td>GOODHART RD  BRANSHOLME</td>\n",
       "      <td>KINGSTON UPON HULL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>HU7 4DW</td>\n",
       "      <td>2.298507</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6199</th>\n",
       "      <td>P81212</td>\n",
       "      <td>DR MOUJAES</td>\n",
       "      <td>THE SURGERY</td>\n",
       "      <td>7-9 MANCHESTER ROAD</td>\n",
       "      <td>HASLINGDEN ROSSENDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB4 5SL</td>\n",
       "      <td>-2.149904</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7052</th>\n",
       "      <td>E85739</td>\n",
       "      <td>GREENBROOK HESTON</td>\n",
       "      <td>HESTON HEALTH CENTRE</td>\n",
       "      <td>CRANFORD LANE  HESTON</td>\n",
       "      <td>HOUNSLOW</td>\n",
       "      <td>MIDDLESEX</td>\n",
       "      <td>TW5 9ER</td>\n",
       "      <td>-2.166148</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2191</th>\n",
       "      <td>E85624</td>\n",
       "      <td>DR UPPAL &amp; PARTN  PARKVIEW CTR FOR H&amp;W</td>\n",
       "      <td>DR UPPAL  PARKVIEW CFH&amp;W</td>\n",
       "      <td>56 BLOEMFONTEIN ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>W12 7FG</td>\n",
       "      <td>-2.221247</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>226</th>\n",
       "      <td>A84014</td>\n",
       "      <td>MARINE MEDICAL GROUP</td>\n",
       "      <td>MARINE MEDICAL GROUP</td>\n",
       "      <td>THE HLTH CTR  THOROTON ST</td>\n",
       "      <td>BLYTH</td>\n",
       "      <td>NORTHUMBERLAND</td>\n",
       "      <td>NE24 1DX</td>\n",
       "      <td>-2.223342</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8188</th>\n",
       "      <td>Y02499</td>\n",
       "      <td>ESTON GRANGE NHS HEALTH CARE CENTRE</td>\n",
       "      <td>LOW GRANGE HEALTH VILLAGE</td>\n",
       "      <td>NORMANBY ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS6 6TD</td>\n",
       "      <td>-2.234066</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11208</th>\n",
       "      <td>N85027</td>\n",
       "      <td>CENTRAL PARK MEDICAL CENTRE</td>\n",
       "      <td>VICTORIA CENTRAL HC</td>\n",
       "      <td>MILL LANE</td>\n",
       "      <td>WALLASEY</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>CH44 5UF</td>\n",
       "      <td>-2.244617</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>405</th>\n",
       "      <td>A89604</td>\n",
       "      <td>DR WEATHERHEAD &amp; ASSOCIATES</td>\n",
       "      <td>SOUTHWICK HEALTH CENTRE</td>\n",
       "      <td>THE GREEN SOUTHWICK</td>\n",
       "      <td>SUNDERLAND</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>SR5 2LT</td>\n",
       "      <td>-2.248398</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11689</th>\n",
       "      <td>J81012</td>\n",
       "      <td>PARKSTONE HEALTH CENTRE</td>\n",
       "      <td>PARKSTONE TOWER PRACTICE</td>\n",
       "      <td>MANSFIELD ROAD</td>\n",
       "      <td>PARKSTONE  POOLE</td>\n",
       "      <td>DORSET</td>\n",
       "      <td>BH14 0DJ</td>\n",
       "      <td>-2.272022</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>376</th>\n",
       "      <td>A89012</td>\n",
       "      <td>DR DIXIT'S PRACTICE</td>\n",
       "      <td>THE GALLERIES HEALTH CTR.</td>\n",
       "      <td>NaN</td>\n",
       "      <td>WASHINGTON</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE38 7NQ</td>\n",
       "      <td>-2.281463</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8607</th>\n",
       "      <td>Y03366</td>\n",
       "      <td>OLIVE FAMILY PRACTICE</td>\n",
       "      <td>THE PIKES LANE CENTRE</td>\n",
       "      <td>DEANE ROAD</td>\n",
       "      <td>BOLTON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BL3 5HP</td>\n",
       "      <td>-2.321956</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7614</th>\n",
       "      <td>Y00492</td>\n",
       "      <td>SUMMERFIELD GROUP PRACTICE</td>\n",
       "      <td>SUMMERFIELD PRIMARY C CTR</td>\n",
       "      <td>134 HEATH ST WINSON GREEN</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>B18 7AL</td>\n",
       "      <td>-2.330356</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7121</th>\n",
       "      <td>B83661</td>\n",
       "      <td>MOOR PARK MEDICAL PRACTICE</td>\n",
       "      <td>THE BLUEBELL BUILDING</td>\n",
       "      <td>BARKEREND HEALTH CENTRE</td>\n",
       "      <td>BRADFORD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BD3 8QH</td>\n",
       "      <td>-2.342376</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3216</th>\n",
       "      <td>G82687</td>\n",
       "      <td>DR S J WITTS PRACTICE</td>\n",
       "      <td>SHEERNESS HEALTH CENTRE</td>\n",
       "      <td>250-262 HIGH STREET</td>\n",
       "      <td>SHEERNESS</td>\n",
       "      <td>KENT</td>\n",
       "      <td>ME12 1UP</td>\n",
       "      <td>-2.349055</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2124</th>\n",
       "      <td>E85030</td>\n",
       "      <td>CHISWICK HEALTH PRACTICE</td>\n",
       "      <td>CHISWICK HEALTH CENTRE</td>\n",
       "      <td>FISHERS LANE</td>\n",
       "      <td>CHISWICK</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>W4 1RX</td>\n",
       "      <td>-2.350487</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8261</th>\n",
       "      <td>Y02620</td>\n",
       "      <td>THE HILL GENERAL PRACTICE &amp; UCC</td>\n",
       "      <td>856 STRATFORD ROAD</td>\n",
       "      <td>SPARKHILL</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>B11 4BW</td>\n",
       "      <td>-2.402455</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2114</th>\n",
       "      <td>E85018</td>\n",
       "      <td>DR SOOD'S PRACTICE</td>\n",
       "      <td>HESTON HEALTH CENTRE</td>\n",
       "      <td>CRANFORD LANE  HESTON</td>\n",
       "      <td>HOUNSLOW</td>\n",
       "      <td>MIDDLESEX</td>\n",
       "      <td>TW5 9ER</td>\n",
       "      <td>-2.473539</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5355</th>\n",
       "      <td>M85078</td>\n",
       "      <td>OAKWOOD SURGERY</td>\n",
       "      <td>SPARKHILL PRIM. CARE CTR</td>\n",
       "      <td>856 STRATFORD ROAD</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>B11 4BW</td>\n",
       "      <td>-2.474575</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8293</th>\n",
       "      <td>Y02671</td>\n",
       "      <td>THE PRACTICE HEART OF HOUNSLOW</td>\n",
       "      <td>HEART OF HOUNSLOW</td>\n",
       "      <td>92 BATH ROAD</td>\n",
       "      <td>HOUNSLOW</td>\n",
       "      <td>MIDDLESEX</td>\n",
       "      <td>TW3 3LN</td>\n",
       "      <td>-2.516275</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5424</th>\n",
       "      <td>M85686</td>\n",
       "      <td>SUMMERFIELD PCC  - DR KULSHRESTHA</td>\n",
       "      <td>SUMMERFIELD PRIM CARE CTR</td>\n",
       "      <td>134 HEATH ST WINSON GREEN</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>B18 7AL</td>\n",
       "      <td>-2.553054</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10548</th>\n",
       "      <td>A87023</td>\n",
       "      <td>BRIDGE MEDICAL</td>\n",
       "      <td>SHIREMOOR RESOURCE CENTRE</td>\n",
       "      <td>EARSDON ROAD  SHIREMOOR</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE27 0HJ</td>\n",
       "      <td>-2.556752</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7584</th>\n",
       "      <td>Y00412</td>\n",
       "      <td>SOHO HEALTH CENTRE</td>\n",
       "      <td>SOHO HEALTH CENTRE</td>\n",
       "      <td>247-251 SOHO ROAD</td>\n",
       "      <td>HANDSWORTH</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>B21 9RY</td>\n",
       "      <td>-2.572113</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5452</th>\n",
       "      <td>M85757</td>\n",
       "      <td>SOHO ROAD HEALTH CENTRE</td>\n",
       "      <td>SOHO ROAD HEALTH CENTRE</td>\n",
       "      <td>247-251 SOHO ROAD</td>\n",
       "      <td>HANDSWORTH  BIRMINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>B21 9RY</td>\n",
       "      <td>-2.588931</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>489</th>\n",
       "      <td>B81091</td>\n",
       "      <td>LITTLEFIELD SURGERY</td>\n",
       "      <td>FRESHNEY GREEN PCC</td>\n",
       "      <td>SORREL ROAD</td>\n",
       "      <td>GRIMSBY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>DN34 4GB</td>\n",
       "      <td>-2.604717</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6654</th>\n",
       "      <td>P92639</td>\n",
       "      <td>SHAHBAZI SS</td>\n",
       "      <td>GOLBORNE HEALTH CENTRE</td>\n",
       "      <td>KIDGLOVE ROAD</td>\n",
       "      <td>GOLBORNE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>WA3 3GS</td>\n",
       "      <td>-2.630434</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6252</th>\n",
       "      <td>P81736</td>\n",
       "      <td>WHITEFIELD HEALTHCARE</td>\n",
       "      <td>YARNSPINNERS PRIMARY HCC</td>\n",
       "      <td>YARNSPINNERS WHARF</td>\n",
       "      <td>CARR ROAD  NELSON</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB9 7SR</td>\n",
       "      <td>-2.632355</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6472</th>\n",
       "      <td>P86619</td>\n",
       "      <td>DR GHAFOOR &amp; ABBASI</td>\n",
       "      <td>1ST FLOOR  NYE BEVAN HSE</td>\n",
       "      <td>MACLURE ROAD</td>\n",
       "      <td>ROCHDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>OL11 1DN</td>\n",
       "      <td>-2.644486</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11193</th>\n",
       "      <td>N85003</td>\n",
       "      <td>ALLPORT MEDICAL CENTRE</td>\n",
       "      <td>ALLPORT MEDICAL CENTRE</td>\n",
       "      <td>TREE TOPS PHCC</td>\n",
       "      <td>43 BRIDLE ROAD</td>\n",
       "      <td>BROMBOROUGH  WIRRAL</td>\n",
       "      <td>CH62 6EE</td>\n",
       "      <td>-2.649584</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5435</th>\n",
       "      <td>M85715</td>\n",
       "      <td>SOHO ROAD PRIMARY CARE CENTRE</td>\n",
       "      <td>SOHO RD PRIMARY CARE CTRE</td>\n",
       "      <td>247-251 SOHO ROAD</td>\n",
       "      <td>BIRMINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>B21 9RY</td>\n",
       "      <td>-2.655388</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7166</th>\n",
       "      <td>M91659</td>\n",
       "      <td>BRACE STREET HEALTH CENTRE</td>\n",
       "      <td>BRACE STREET HEALTH CTR.</td>\n",
       "      <td>BRACE STREET  CALDMORE</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS1 3PS</td>\n",
       "      <td>-2.668619</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>660</th>\n",
       "      <td>B83058</td>\n",
       "      <td>THE AVICENNA MEDICAL PRACTICE</td>\n",
       "      <td>BARKEREND HEALTH CENTRE</td>\n",
       "      <td>BARKEREND ROAD</td>\n",
       "      <td>BRADFORD</td>\n",
       "      <td>WEST YORKSHIRE</td>\n",
       "      <td>BD3 8QH</td>\n",
       "      <td>-2.735961</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>850 rows × 9 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         code                                     name  \\\n",
       "7453   G81703                   H&R P C SPECIAL SCHEME   \n",
       "474    B81069  PRACTICE 3  MEDICAL CENTRE  BRIDLINGTON   \n",
       "528    B82001                        FALSGRAVE SURGERY   \n",
       "7953   Y01852                NATIONAL ENHANCED SERVICE   \n",
       "1363   C85008               HOYLAND FIRST PMS PRACTICE   \n",
       "...       ...                                      ...   \n",
       "6472   P86619                      DR GHAFOOR & ABBASI   \n",
       "11193  N85003                   ALLPORT MEDICAL CENTRE   \n",
       "5435   M85715            SOHO ROAD PRIMARY CARE CENTRE   \n",
       "7166   M91659               BRACE STREET HEALTH CENTRE   \n",
       "660    B83058            THE AVICENNA MEDICAL PRACTICE   \n",
       "\n",
       "                          addr_1                   addr_2  \\\n",
       "7453    STATION PLAZA HEALTH CTR         STATION APPROACH   \n",
       "474           THE MEDICAL CENTRE           STATION AVENUE   \n",
       "528            FALSGRAVE SURGERY   LAWRENCE HOUSE MED CTR   \n",
       "7953             NYE BEVAN HOUSE             MACLURE ROAD   \n",
       "1363    HOYLAND FIRST PMS PRACT.  WALDERSLADE  HIGH CROFT   \n",
       "...                          ...                      ...   \n",
       "6472    1ST FLOOR  NYE BEVAN HSE             MACLURE ROAD   \n",
       "11193     ALLPORT MEDICAL CENTRE           TREE TOPS PHCC   \n",
       "5435   SOHO RD PRIMARY CARE CTRE        247-251 SOHO ROAD   \n",
       "7166    BRACE STREET HEALTH CTR.   BRACE STREET  CALDMORE   \n",
       "660      BARKEREND HEALTH CENTRE           BARKEREND ROAD   \n",
       "\n",
       "                   borough                   village post_code   z-score  \\\n",
       "7453              HASTINGS               EAST SUSSEX  TN34 1BA  4.382195   \n",
       "474            BRIDLINGTON  EAST RIDING OF YORKSHIRE  YO16 4LZ  4.202988   \n",
       "528    1 BELGRAVE CRESCENT               SCARBOROUGH  YO11 1UB  3.558981   \n",
       "7953              ROCHDALE                LANCASHIRE  OL11 1DN  3.503944   \n",
       "1363     HOYLAND  BARNSLEY           SOUTH YORKSHIRE   S74 9AF  3.485717   \n",
       "...                    ...                       ...       ...       ...   \n",
       "6472              ROCHDALE                LANCASHIRE  OL11 1DN -2.644486   \n",
       "11193       43 BRIDLE ROAD       BROMBOROUGH  WIRRAL  CH62 6EE -2.649584   \n",
       "5435            BIRMINGHAM                       NaN   B21 9RY -2.655388   \n",
       "7166               WALSALL             WEST MIDLANDS   WS1 3PS -2.668619   \n",
       "660               BRADFORD            WEST YORKSHIRE   BD3 8QH -2.735961   \n",
       "\n",
       "       count  \n",
       "7453     NaN  \n",
       "474      NaN  \n",
       "528      NaN  \n",
       "7953     NaN  \n",
       "1363     NaN  \n",
       "...      ...  \n",
       "6472     NaN  \n",
       "11193    NaN  \n",
       "5435     NaN  \n",
       "7166     NaN  \n",
       "660      NaN  \n",
       "\n",
       "[850 rows x 9 columns]"
      ]
     },
     "execution_count": 77,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices['count'] = scripts['practice'].value_counts()\n",
    "unique_practices.sort_values('z-score', ascending=False)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 78,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "6835    NaN\n",
       "6484    NaN\n",
       "6907    NaN\n",
       "7201    NaN\n",
       "6493    NaN\n",
       "         ..\n",
       "9388    NaN\n",
       "6102    NaN\n",
       "11397   NaN\n",
       "5340    NaN\n",
       "6613    NaN\n",
       "Name: count, Length: 850, dtype: float64"
      ]
     },
     "execution_count": 78,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices['count'] "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 79,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "      <th>z-score</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>6835</th>\n",
       "      <td>P87652</td>\n",
       "      <td>1/LOWER BROUGHTON MEDICAL PRACTICE</td>\n",
       "      <td>LOWER BROUGHTON HTH.CTR.</td>\n",
       "      <td>GREAT CLOWES STREET</td>\n",
       "      <td>SALFORD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M7 1RD</td>\n",
       "      <td>-0.256762</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6484</th>\n",
       "      <td>P87020</td>\n",
       "      <td>2/ST ANDREWS MEDICAL PRACTICE</td>\n",
       "      <td>ST.ANDREWS MEDICAL CENTRE</td>\n",
       "      <td>30 RUSSELL STREET  ECCLES</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M30 0NU</td>\n",
       "      <td>-0.705053</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6907</th>\n",
       "      <td>P87654</td>\n",
       "      <td>3/LOWER BROUGHTON MEDICAL PRACTICE</td>\n",
       "      <td>LOWER BROUGHTON HTH.CTR.</td>\n",
       "      <td>GREAT CLOWES STREET</td>\n",
       "      <td>SALFORD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M7 1RD</td>\n",
       "      <td>-0.425940</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7201</th>\n",
       "      <td>P87659</td>\n",
       "      <td>3/ST ANDREWS MEDICAL CENTRE</td>\n",
       "      <td>ST.ANDREWS MEDICAL CENTRE</td>\n",
       "      <td>30 RUSSELL STREET  ECCLES</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M30 0NU</td>\n",
       "      <td>0.989859</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6493</th>\n",
       "      <td>P87036</td>\n",
       "      <td>4/LOWER BROUGHTON MEDICAL PRACTICE</td>\n",
       "      <td>LOWER BROUGHTON HTH.CTR.</td>\n",
       "      <td>GREAT CLOWES STREET</td>\n",
       "      <td>SALFORD</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>M7 1RD</td>\n",
       "      <td>0.535444</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "        code                                name                     addr_1  \\\n",
       "6835  P87652  1/LOWER BROUGHTON MEDICAL PRACTICE   LOWER BROUGHTON HTH.CTR.   \n",
       "6484  P87020       2/ST ANDREWS MEDICAL PRACTICE  ST.ANDREWS MEDICAL CENTRE   \n",
       "6907  P87654  3/LOWER BROUGHTON MEDICAL PRACTICE   LOWER BROUGHTON HTH.CTR.   \n",
       "7201  P87659         3/ST ANDREWS MEDICAL CENTRE  ST.ANDREWS MEDICAL CENTRE   \n",
       "6493  P87036  4/LOWER BROUGHTON MEDICAL PRACTICE   LOWER BROUGHTON HTH.CTR.   \n",
       "\n",
       "                         addr_2     borough     village post_code   z-score  \\\n",
       "6835        GREAT CLOWES STREET     SALFORD         NaN    M7 1RD -0.256762   \n",
       "6484  30 RUSSELL STREET  ECCLES  MANCHESTER         NaN   M30 0NU -0.705053   \n",
       "6907        GREAT CLOWES STREET     SALFORD         NaN    M7 1RD -0.425940   \n",
       "7201  30 RUSSELL STREET  ECCLES  MANCHESTER         NaN   M30 0NU  0.989859   \n",
       "6493        GREAT CLOWES STREET     SALFORD  MANCHESTER    M7 1RD  0.535444   \n",
       "\n",
       "      count  \n",
       "6835    NaN  \n",
       "6484    NaN  \n",
       "6907    NaN  \n",
       "7201    NaN  \n",
       "6493    NaN  "
      ]
     },
     "execution_count": 79,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices.head()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## FRESH START"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 80,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>A81002</td>\n",
       "      <td>QUEENS PARK MEDICAL CENTRE</td>\n",
       "      <td>QUEENS PARK MEDICAL CTR</td>\n",
       "      <td>FARRER STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 2AW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>A81003</td>\n",
       "      <td>VICTORIA MEDICAL PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>VICTORIA ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS26 8DB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>A81004</td>\n",
       "      <td>WOODLANDS ROAD SURGERY</td>\n",
       "      <td>6 WOODLANDS ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 3BE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>A81005</td>\n",
       "      <td>SPRINGWOOD SURGERY</td>\n",
       "      <td>SPRINGWOOD SURGERY</td>\n",
       "      <td>RECTORY LANE</td>\n",
       "      <td>GUISBOROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS14 7DJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>A81006</td>\n",
       "      <td>TENNANT STREET MEDICAL PRACTICE</td>\n",
       "      <td>TENNANT ST MED PRACT</td>\n",
       "      <td>FARRER STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 2AT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>A81007</td>\n",
       "      <td>BANKHOUSE SURGERY</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>A81008</td>\n",
       "      <td>ALBERT HOUSE CLINIC</td>\n",
       "      <td>LOW GRANGE HEALTH VILLAGE</td>\n",
       "      <td>NORMANBY ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS6 6TD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>A81009</td>\n",
       "      <td>VILLAGE MEDICAL CENTRE</td>\n",
       "      <td>THE VILLAGE MEDICAL CTR</td>\n",
       "      <td>400/404 LINTHORPE ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS5 6HF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>A81011</td>\n",
       "      <td>CHADWICK PRACTICE</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>A81012</td>\n",
       "      <td>WESTBOURNE MEDICAL CENTRE</td>\n",
       "      <td>WESTBOURNE MEDICAL CENTRE</td>\n",
       "      <td>7 TRINITY MEWS N. ORMESBY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS3 6AL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>A81013</td>\n",
       "      <td>BROTTON SURGERY</td>\n",
       "      <td>BROTTON SURGERY</td>\n",
       "      <td>ALFORD ROAD BROTTON</td>\n",
       "      <td>SALTBURN BY SEA</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS12 2FF</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>A81014</td>\n",
       "      <td>QUEENSTREE PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>QUEENSWAY</td>\n",
       "      <td>BILLINGHAM</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS23 2LA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>A81015</td>\n",
       "      <td>LAGAN SURGERY</td>\n",
       "      <td>LAGAN SURGERY</td>\n",
       "      <td>20 KIRKLEATHAM STREET</td>\n",
       "      <td>REDCAR</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS10 1TZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>A81016</td>\n",
       "      <td>PARK SURGERY</td>\n",
       "      <td>PARK SURGERY  ONE LIFE</td>\n",
       "      <td>LINTHORPE ROAD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 3QY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>A81017</td>\n",
       "      <td>WOODBRIDGE PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>TRENCHARD AVE  THORNABY</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS17 0EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>A81018</td>\n",
       "      <td>BENTLEY MEDICAL PRACTICE</td>\n",
       "      <td>REDCAR PRIMARY CARE HOSP</td>\n",
       "      <td>WEST DYKE ROAD</td>\n",
       "      <td>REDCAR</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS10 4NW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>A81019</td>\n",
       "      <td>CROSSFELL HEALTH CENTRE</td>\n",
       "      <td>CROSSFELL ROAD</td>\n",
       "      <td>BERWICK HILLS</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS3 7RL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>A81020</td>\n",
       "      <td>MARTONSIDE MEDICAL CENTRE</td>\n",
       "      <td>MARTONSIDE MEDICAL CENTRE</td>\n",
       "      <td>1A MARTONSIDE WAY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS4 3BU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>A81021</td>\n",
       "      <td>NORMANBY MEDICAL CENTRE</td>\n",
       "      <td>NORMANBY MEDICAL CENTRE</td>\n",
       "      <td>LOW GRANGE HV NORMANBY RD</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS6 6TD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>A81022</td>\n",
       "      <td>HILLSIDE PRACTICE</td>\n",
       "      <td>HILLSIDE PRACTICE</td>\n",
       "      <td>WINDERMERE DRIVE SKELTON</td>\n",
       "      <td>SALTBURN BY THE SEA</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS12 2TG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>A81023</td>\n",
       "      <td>THE ENDEAVOUR PRACTICE</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>20 CLEVELAND SQUARE</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS1 2NX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>A81025</td>\n",
       "      <td>THE DOVECOT SURGERY</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>LAWSON STREET</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS18 1HU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>A81026</td>\n",
       "      <td>THE LINTHORPE SURGERY</td>\n",
       "      <td>378 LINTHORPE ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS5 6HA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>A81027</td>\n",
       "      <td>YARM MEDICAL PRACTICE</td>\n",
       "      <td>YARM MEDICAL PRACTICE</td>\n",
       "      <td>MULBERRY HOUSE</td>\n",
       "      <td>1 WORSALL ROAD</td>\n",
       "      <td>YARM  CLEVELAND</td>\n",
       "      <td>TS15 9DD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>A81029</td>\n",
       "      <td>PROSPECT SURGERY</td>\n",
       "      <td>THE HEALTH CENTRE</td>\n",
       "      <td>PO BOX 101E</td>\n",
       "      <td>20 CLEVELAND SQUARE</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>TS1 2NX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>A81030</td>\n",
       "      <td>BOROUGH ROAD &amp; NUNTHORPE MEDICAL GROUP</td>\n",
       "      <td>167A BOROUGH ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS1 3RY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>A81031</td>\n",
       "      <td>HAVELOCK GRANGE PRACTICE</td>\n",
       "      <td>ONE LIFE HARTLEPOOL</td>\n",
       "      <td>PARK ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS24 7PW</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>A81032</td>\n",
       "      <td>THE GARTH</td>\n",
       "      <td>THE GARTH SURGERY</td>\n",
       "      <td>RECTORY LANE</td>\n",
       "      <td>GUISBOROUGH</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS14 7DJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>A81033</td>\n",
       "      <td>OAKFIELD MEDICAL PRACTICE</td>\n",
       "      <td>OAKFIELDS MED PRACTICE</td>\n",
       "      <td>1 TRINITY MEWS N. ORMESBY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS3 6AL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>A81034</td>\n",
       "      <td>THORNABY &amp; BARWICK MEDICAL GROUP</td>\n",
       "      <td>THORNABY HEALTH CENTRE</td>\n",
       "      <td>TRENCHARD AVE  THORNABY</td>\n",
       "      <td>STOCKTON ON TEES</td>\n",
       "      <td>CLEVELAND</td>\n",
       "      <td>TS17 0EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11989</th>\n",
       "      <td>Y04708</td>\n",
       "      <td>PCOC GASTROENTEROLOGY SERVICE</td>\n",
       "      <td>HILLTOPS MEDICAL CENTRE</td>\n",
       "      <td>KENSINGTON DVE GREAT HOLM</td>\n",
       "      <td>MILTON KEYNES</td>\n",
       "      <td>BUCKINGHAMSHIRE</td>\n",
       "      <td>MK8 9HN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11990</th>\n",
       "      <td>Y04712</td>\n",
       "      <td>PRIME ENDOSCOPY (BRISTOL)</td>\n",
       "      <td>PRIME ENDOSCOPY (BRISTOL)</td>\n",
       "      <td>MILLENIUM PROMENADE</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS1 5SZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11991</th>\n",
       "      <td>Y04765</td>\n",
       "      <td>AQP ANTICOAG YEW TREE HLC</td>\n",
       "      <td>AQP ANTICOAG YEW TREE HLC</td>\n",
       "      <td>REDWOOD RD YEW TREE EST</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS5 4LB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11992</th>\n",
       "      <td>Y04785</td>\n",
       "      <td>THORACIC MEDICINE DEPARTMENT CANNOCK</td>\n",
       "      <td>CANNOCK CHASE HOSPITAL</td>\n",
       "      <td>BRUNSWICK ROAD</td>\n",
       "      <td>CANNOCK</td>\n",
       "      <td>STAFFORDSHIRE</td>\n",
       "      <td>WS11 5XY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11993</th>\n",
       "      <td>Y04797</td>\n",
       "      <td>ENT GPWSI TAVISTOCK HOSPITAL</td>\n",
       "      <td>TAVISTOCK HOSPITAL</td>\n",
       "      <td>15 CARMEL GARDENS</td>\n",
       "      <td>TAVISTOCK</td>\n",
       "      <td>DEVON</td>\n",
       "      <td>PL19 8RG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11994</th>\n",
       "      <td>Y04856</td>\n",
       "      <td>ST MARYS HEALTH CENTRE OOH</td>\n",
       "      <td>KING EDWARD LANE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ST MARYS</td>\n",
       "      <td>ISLES OF SCILLY</td>\n",
       "      <td>TR21 0HE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11995</th>\n",
       "      <td>Y05156</td>\n",
       "      <td>MILLENIUM POINT</td>\n",
       "      <td>WATERFRONT BUSINESS PARK</td>\n",
       "      <td>WATERFRONT WAY</td>\n",
       "      <td>BRIERLEY HILL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>DY5 1LX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11996</th>\n",
       "      <td>Y05296</td>\n",
       "      <td>RAPID ASSESSMENT WAMP6D COMMUNITY CLINIC</td>\n",
       "      <td>ST MARK'S HOSPITAL</td>\n",
       "      <td>ST MARK'S ROAD</td>\n",
       "      <td>MAIDENHEAD</td>\n",
       "      <td>BERKSHIRE</td>\n",
       "      <td>SL6 6DU</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11997</th>\n",
       "      <td>Y05315</td>\n",
       "      <td>SOLENT MEDICAL SERVICES OPHTHALMOLOGY</td>\n",
       "      <td>NEWTOWN CLINIC</td>\n",
       "      <td>24-26 LYON STREET</td>\n",
       "      <td>SOUTHAMPTON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SO14 0LX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11998</th>\n",
       "      <td>Y05330</td>\n",
       "      <td>TOTTENHAM HALE MEDICAL PRACTICE</td>\n",
       "      <td>10 LEBUS STREET</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>N17 9FD</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11999</th>\n",
       "      <td>Y05542</td>\n",
       "      <td>PAIN MANAGEMENT SOUTH</td>\n",
       "      <td>MORSTON HOUSE</td>\n",
       "      <td>THE MIDWAY</td>\n",
       "      <td>NEWCASTLE UNDER LYME</td>\n",
       "      <td>NaN</td>\n",
       "      <td>ST5 1QG</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12000</th>\n",
       "      <td>Y05634</td>\n",
       "      <td>NEAS NORTH DURHAM CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12001</th>\n",
       "      <td>Y05638</td>\n",
       "      <td>NEAS SOUTH TYNESIDE CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12002</th>\n",
       "      <td>Y05639</td>\n",
       "      <td>NEAS SUNDERLAND CCG</td>\n",
       "      <td>BERNICIA HOUSE</td>\n",
       "      <td>NEWBURN RIVERSIDE</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE15 8NY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12003</th>\n",
       "      <td>Y05675</td>\n",
       "      <td>8 TO 8 TOP-UP HUB ERITH</td>\n",
       "      <td>ERITH HOSPITAL</td>\n",
       "      <td>PARK CRESCENT</td>\n",
       "      <td>ERITH</td>\n",
       "      <td>KENT</td>\n",
       "      <td>DA8 3EE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12004</th>\n",
       "      <td>Y05676</td>\n",
       "      <td>8 TO 8 TOP-UP HUB QMH</td>\n",
       "      <td>QUEEN MARY'S HOSPITAL</td>\n",
       "      <td>FROGNAL AVENUE</td>\n",
       "      <td>SIDCUP</td>\n",
       "      <td>KENT</td>\n",
       "      <td>DA14 6LT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12005</th>\n",
       "      <td>Y05682</td>\n",
       "      <td>PRIMARY HEALTHCARE DARLINGTON</td>\n",
       "      <td>UNIT 1  PARAMO HOUSE</td>\n",
       "      <td>DENMARK STREET</td>\n",
       "      <td>DARLINGTON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>DL3 0LP</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12006</th>\n",
       "      <td>Y05692</td>\n",
       "      <td>LD TEAM WIGAN</td>\n",
       "      <td>WILLIS HOUSE</td>\n",
       "      <td>23 CUMBER LANE  WHISTON</td>\n",
       "      <td>PRESCOT</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>L35 2YZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12007</th>\n",
       "      <td>Y05697</td>\n",
       "      <td>CCG ACUTE VISITING SERVICE</td>\n",
       "      <td>NS/SOT CCG  1 SMITHFIELD</td>\n",
       "      <td>LEONARD COATES WAY</td>\n",
       "      <td>HANLEY</td>\n",
       "      <td>STAFFORDSHIRE</td>\n",
       "      <td>ST1 4FA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12008</th>\n",
       "      <td>Y05702</td>\n",
       "      <td>EAST MERTON ACCESS HUB</td>\n",
       "      <td>75-79 MILES ROAD</td>\n",
       "      <td>MITCHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SURREY</td>\n",
       "      <td>CR4 3DA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12009</th>\n",
       "      <td>Y05703</td>\n",
       "      <td>PRIMARY CARE CONNECT - ANFIELD HEALTH</td>\n",
       "      <td>TOWNSEND LANE NHC</td>\n",
       "      <td>98 TOWNSEND LANE</td>\n",
       "      <td>LIVERPOOL</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>L6 0BB</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12010</th>\n",
       "      <td>Y05725</td>\n",
       "      <td>ACUTE CARE AT HOME CENTRAL</td>\n",
       "      <td>TRURO HEALTH PARK</td>\n",
       "      <td>INFIRMARY HILL</td>\n",
       "      <td>TRURO</td>\n",
       "      <td>CORNWALL</td>\n",
       "      <td>TR1 2JA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12011</th>\n",
       "      <td>Y05743</td>\n",
       "      <td>NEWARK ACUTE HOME VISITING SERVICE</td>\n",
       "      <td>PICS</td>\n",
       "      <td>UNIT H4 ASH TREE COURT</td>\n",
       "      <td>NOTTINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NG8 6PY</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12012</th>\n",
       "      <td>Y05744</td>\n",
       "      <td>NEWMEDICA COMMUNITY OPHTHALMOLOGY</td>\n",
       "      <td>CROMWELL PCC</td>\n",
       "      <td>CROMWELL ROAD</td>\n",
       "      <td>GRIMSBY</td>\n",
       "      <td>NORTH EAST LINCOLNSHIRE</td>\n",
       "      <td>DN31 2BH</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12013</th>\n",
       "      <td>Y05748</td>\n",
       "      <td>EAST KENT DRUG AND ALCOHOL SERVICE</td>\n",
       "      <td>TRANSPORT HOUSE</td>\n",
       "      <td>DRUM LANE</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN23 1LQ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12014</th>\n",
       "      <td>Y05752</td>\n",
       "      <td>MALVERN FRAILTY UNIT</td>\n",
       "      <td>MALVERN COMM. HOSPITAL</td>\n",
       "      <td>185 WORCESTER ROAD</td>\n",
       "      <td>MALVERN</td>\n",
       "      <td>WORCESTERSHIRE</td>\n",
       "      <td>WR14 1EX</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12015</th>\n",
       "      <td>Y05757</td>\n",
       "      <td>VC WEST LANCS HC-UCC</td>\n",
       "      <td>ORMSKIRK DG HOSPITAL</td>\n",
       "      <td>WIGAN ROAD</td>\n",
       "      <td>ORMSKIRK</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>L39 2AZ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12016</th>\n",
       "      <td>Y05758</td>\n",
       "      <td>VC SKELMERSDALE UCC</td>\n",
       "      <td>CONCOURSE SHOPPING CENTRE</td>\n",
       "      <td>116-8 SOUTH WAY</td>\n",
       "      <td>SKELMERSDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>WN8 6LJ</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12017</th>\n",
       "      <td>Y05762</td>\n",
       "      <td>WEST MERTON ACCESS HUB</td>\n",
       "      <td>THE NELSON HEALTH CENTRE</td>\n",
       "      <td>KINGSTON ROAD</td>\n",
       "      <td>WIMBLEDON</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SW20 8DA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12018</th>\n",
       "      <td>Y05763</td>\n",
       "      <td>ELY LOCAL URGENT CARE SERVICE</td>\n",
       "      <td>PRINCESS OF WALES HOSP</td>\n",
       "      <td>LYNN ROAD</td>\n",
       "      <td>ELY</td>\n",
       "      <td>CAMBRIDGSHIRE</td>\n",
       "      <td>CB6 1DN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>12019 rows × 7 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "         code                             name                     addr_1  \\\n",
       "0      A81002       QUEENS PARK MEDICAL CENTRE    QUEENS PARK MEDICAL CTR   \n",
       "1      A81003        VICTORIA MEDICAL PRACTICE          THE HEALTH CENTRE   \n",
       "2      A81004           WOODLANDS ROAD SURGERY           6 WOODLANDS ROAD   \n",
       "3      A81005               SPRINGWOOD SURGERY         SPRINGWOOD SURGERY   \n",
       "4      A81006  TENNANT STREET MEDICAL PRACTICE       TENNANT ST MED PRACT   \n",
       "...       ...                              ...                        ...   \n",
       "12014  Y05752             MALVERN FRAILTY UNIT     MALVERN COMM. HOSPITAL   \n",
       "12015  Y05757             VC WEST LANCS HC-UCC       ORMSKIRK DG HOSPITAL   \n",
       "12016  Y05758              VC SKELMERSDALE UCC  CONCOURSE SHOPPING CENTRE   \n",
       "12017  Y05762           WEST MERTON ACCESS HUB   THE NELSON HEALTH CENTRE   \n",
       "12018  Y05763    ELY LOCAL URGENT CARE SERVICE     PRINCESS OF WALES HOSP   \n",
       "\n",
       "                   addr_2           borough         village post_code  \n",
       "0           FARRER STREET  STOCKTON ON TEES       CLEVELAND  TS18 2AW  \n",
       "1           VICTORIA ROAD        HARTLEPOOL       CLEVELAND  TS26 8DB  \n",
       "2                     NaN     MIDDLESBROUGH       CLEVELAND   TS1 3BE  \n",
       "3            RECTORY LANE       GUISBOROUGH             NaN  TS14 7DJ  \n",
       "4           FARRER STREET  STOCKTON ON TEES       CLEVELAND  TS18 2AT  \n",
       "...                   ...               ...             ...       ...  \n",
       "12014  185 WORCESTER ROAD           MALVERN  WORCESTERSHIRE  WR14 1EX  \n",
       "12015          WIGAN ROAD          ORMSKIRK      LANCASHIRE   L39 2AZ  \n",
       "12016     116-8 SOUTH WAY      SKELMERSDALE      LANCASHIRE   WN8 6LJ  \n",
       "12017       KINGSTON ROAD         WIMBLEDON             NaN  SW20 8DA  \n",
       "12018           LYNN ROAD               ELY   CAMBRIDGSHIRE   CB6 1DN  \n",
       "\n",
       "[12019 rows x 7 columns]"
      ]
     },
     "execution_count": 80,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "col_names=[ 'code', 'name', 'addr_1', 'addr_2', 'borough', 'village', 'post_code']\n",
    "practices = pd.read_csv('dw-data/practices.csv.gz')\n",
    "practices.columns = col_names\n",
    "practices"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 81,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_code</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106020C0</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0106040M0</td>\n",
       "      <td>Movicol Plain_Paed Pdr Sach 6.9g</td>\n",
       "      <td>1</td>\n",
       "      <td>4.38</td>\n",
       "      <td>4.07</td>\n",
       "      <td>30</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0301011R0</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0304010G0</td>\n",
       "      <td>Chlorphenamine Mal_Oral Soln 2mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>2.62</td>\n",
       "      <td>2.44</td>\n",
       "      <td>150</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>N85639</td>\n",
       "      <td>0401020K0</td>\n",
       "      <td>Diazepam_Tab 2mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.16</td>\n",
       "      <td>0.26</td>\n",
       "      <td>6</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "  practice   bnf_code                              bnf_name  items   nic  \\\n",
       "0   N85639  0106020C0                 Bisacodyl_Tab E/C 5mg      1  0.39   \n",
       "1   N85639  0106040M0      Movicol Plain_Paed Pdr Sach 6.9g      1  4.38   \n",
       "2   N85639  0301011R0    Salbutamol_Inha 100mcg (200 D) CFF      1  1.50   \n",
       "3   N85639  0304010G0  Chlorphenamine Mal_Oral Soln 2mg/5ml      1  2.62   \n",
       "4   N85639  0401020K0                      Diazepam_Tab 2mg      1  0.16   \n",
       "\n",
       "   act_cost  quantity  \n",
       "0      0.47        12  \n",
       "1      4.07        30  \n",
       "2      1.40         1  \n",
       "3      2.44       150  \n",
       "4      0.26         6  "
      ]
     },
     "execution_count": 81,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 82,
   "metadata": {},
   "outputs": [],
   "source": [
    "chem = pd.read_csv('dw-data/chem.csv.gz')\n",
    "chem = chem.sort_values('CHEM SUB').drop_duplicates(subset='CHEM SUB', keep='first')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 83,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Flag opioids\n",
    "opioids = ['morphine', 'oxycodone', 'methadone', 'fentanyl', 'pethidine', 'buprenorphine', 'propoxyphene', 'codeine']\n",
    "chem['is_opioid'] = chem['NAME'].str.lower().str.contains(r'|'.join(opioids))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 84,
   "metadata": {},
   "outputs": [],
   "source": [
    "scripts_with_chem = (scripts\n",
    "                     .merge(chem[['CHEM SUB', 'is_opioid']], left_on='bnf_code', right_on='CHEM SUB', how='left')\n",
    "                     .fillna(False))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 85,
   "metadata": {},
   "outputs": [],
   "source": [
    "opioids_per_practice = scripts_with_chem.groupby('practice')['is_opioid'].mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 86,
   "metadata": {},
   "outputs": [],
   "source": [
    "relative_opioids_per_practice = opioids_per_practice - scripts_with_chem['is_opioid'].mean()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 87,
   "metadata": {},
   "outputs": [],
   "source": [
    "standard_error_per_practice = scripts_with_chem['is_opioid'].std() / (scripts_with_chem['practice'].value_counts() ** 0.5)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 88,
   "metadata": {},
   "outputs": [],
   "source": [
    "opioid_score = relative_opioids_per_practice / standard_error_per_practice"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 89,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "A81005   -0.548306\n",
       "A81007    1.544557\n",
       "A81011    2.291795\n",
       "A81012    1.373060\n",
       "A81017    0.583168\n",
       "            ...   \n",
       "Y05570    1.391142\n",
       "Y05583   -1.019657\n",
       "Y05597   -0.817544\n",
       "Y05660   -1.278102\n",
       "Y05670   -0.667522\n",
       "Length: 856, dtype: float64"
      ]
     },
     "execution_count": 89,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "opioid_score"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 90,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "      <th>z-score</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>P87657</th>\n",
       "      <td>(IRLAM) SALFORD CARE CTRS MEDICAL PRACTI</td>\n",
       "      <td>SALFORD CARE CTR(IRLAM)</td>\n",
       "      <td>125 LIVERPOOL ROAD</td>\n",
       "      <td>IRLAM</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>M44 6DP</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y05381</th>\n",
       "      <td>0-19 EAST CHESHIRE HEALTH VISITORS</td>\n",
       "      <td>SALINAE CLINIC</td>\n",
       "      <td>LEWIN STREET</td>\n",
       "      <td>MIDDLEWICH</td>\n",
       "      <td>CHESHIRE</td>\n",
       "      <td>CW10 9FG</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04082</th>\n",
       "      <td>0-19 PUBLIC HEALTH SERVICE HARTLEPOOL</td>\n",
       "      <td>CHATHAM CHILDRENS CENTRE</td>\n",
       "      <td>29 CHATHAM ROAD</td>\n",
       "      <td>HARTLEPOOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS24 8QG</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00364</th>\n",
       "      <td>1 TO 1 CENTRE</td>\n",
       "      <td>BRENKLEY AVENUE</td>\n",
       "      <td>SHIREMOOR</td>\n",
       "      <td>NEWCASTLE UPON TYNE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NE27 0PR</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P87652</th>\n",
       "      <td>1/LOWER BROUGHTON MEDICAL PRACTICE</td>\n",
       "      <td>LOWER BROUGHTON HTH.CTR.</td>\n",
       "      <td>GREAT CLOWES STREET</td>\n",
       "      <td>SALFORD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M7 1RD</td>\n",
       "      <td>2.435637</td>\n",
       "      <td>1044.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                            name                    addr_1  \\\n",
       "code                                                                         \n",
       "P87657  (IRLAM) SALFORD CARE CTRS MEDICAL PRACTI   SALFORD CARE CTR(IRLAM)   \n",
       "Y05381        0-19 EAST CHESHIRE HEALTH VISITORS            SALINAE CLINIC   \n",
       "Y04082     0-19 PUBLIC HEALTH SERVICE HARTLEPOOL  CHATHAM CHILDRENS CENTRE   \n",
       "Y00364                             1 TO 1 CENTRE           BRENKLEY AVENUE   \n",
       "P87652        1/LOWER BROUGHTON MEDICAL PRACTICE  LOWER BROUGHTON HTH.CTR.   \n",
       "\n",
       "                     addr_2              borough     village post_code  \\\n",
       "code                                                                     \n",
       "P87657   125 LIVERPOOL ROAD                IRLAM  MANCHESTER   M44 6DP   \n",
       "Y05381         LEWIN STREET           MIDDLEWICH    CHESHIRE  CW10 9FG   \n",
       "Y04082      29 CHATHAM ROAD           HARTLEPOOL         NaN  TS24 8QG   \n",
       "Y00364            SHIREMOOR  NEWCASTLE UPON TYNE         NaN  NE27 0PR   \n",
       "P87652  GREAT CLOWES STREET              SALFORD         NaN    M7 1RD   \n",
       "\n",
       "         z-score   count  \n",
       "code                      \n",
       "P87657       NaN     NaN  \n",
       "Y05381       NaN     NaN  \n",
       "Y04082       NaN     NaN  \n",
       "Y00364       NaN     NaN  \n",
       "P87652  2.435637  1044.0  "
      ]
     },
     "execution_count": 90,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices = practices.sort_values('name').drop_duplicates(subset='code', keep='first')\n",
    "unique_practices = unique_practices.set_index('code') \n",
    "unique_practices['z-score'] = opioid_score\n",
    "unique_practices['count'] = scripts_with_chem['practice'].value_counts()\n",
    "unique_practices.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 91,
   "metadata": {
    "scrolled": false
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>addr_1</th>\n",
       "      <th>addr_2</th>\n",
       "      <th>borough</th>\n",
       "      <th>village</th>\n",
       "      <th>post_code</th>\n",
       "      <th>z-score</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Y01852</th>\n",
       "      <td>NATIONAL ENHANCED SERVICE</td>\n",
       "      <td>NYE BEVAN HOUSE</td>\n",
       "      <td>MACLURE ROAD</td>\n",
       "      <td>ROCHDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>OL11 1DN</td>\n",
       "      <td>11.695818</td>\n",
       "      <td>7.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y03006</th>\n",
       "      <td>OUTREACH SERVICE NH / RH</td>\n",
       "      <td>PCC 69 CHURCH STREET WEST</td>\n",
       "      <td>RADCLIFFE</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>NaN</td>\n",
       "      <td>M26 2SP</td>\n",
       "      <td>7.339043</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y03668</th>\n",
       "      <td>BRISDOC HEALTHCARE SERVICES OOH</td>\n",
       "      <td>KNOWLE WEST HEALTH PARK</td>\n",
       "      <td>DOWNTON ROAD  KNOWLE</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS4 1WH</td>\n",
       "      <td>6.150582</td>\n",
       "      <td>60.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>G81703</th>\n",
       "      <td>H&amp;R P C SPECIAL SCHEME</td>\n",
       "      <td>STATION PLAZA HEALTH CTR</td>\n",
       "      <td>STATION APPROACH</td>\n",
       "      <td>HASTINGS</td>\n",
       "      <td>EAST SUSSEX</td>\n",
       "      <td>TN34 1BA</td>\n",
       "      <td>5.123032</td>\n",
       "      <td>36.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04997</th>\n",
       "      <td>HMR BARDOC OOH</td>\n",
       "      <td>MOORGATE PRIMARY CARE CTR</td>\n",
       "      <td>22 DERBY ROAD</td>\n",
       "      <td>BURY</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BL9 0NJ</td>\n",
       "      <td>4.958866</td>\n",
       "      <td>321.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04585</th>\n",
       "      <td>INTEGRATED CARE 24 LTD (CWSX OOH)</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>4.888878</td>\n",
       "      <td>426.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81051</th>\n",
       "      <td>DARWEN HEALTHCARE</td>\n",
       "      <td>DARWEN HEALTH CENTRE</td>\n",
       "      <td>JAMES STREET WEST</td>\n",
       "      <td>DARWEN</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB3 1PY</td>\n",
       "      <td>4.839159</td>\n",
       "      <td>1917.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P87017</th>\n",
       "      <td>THE LIMES MEDICAL PRACTICE</td>\n",
       "      <td>THE LIMES MEDICAL CENTRE</td>\n",
       "      <td>8-12 HODGE ROAD  WALKDEN</td>\n",
       "      <td>WORSLEY</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>M28 3AT</td>\n",
       "      <td>4.546842</td>\n",
       "      <td>1321.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y01086</th>\n",
       "      <td>IC24 LTD (BRIGHTON &amp; HOVE OOH)</td>\n",
       "      <td>IC24 LTD  KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>4.335047</td>\n",
       "      <td>357.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y05327</th>\n",
       "      <td>OLDHAM 7 DAY ACCESS HUB2 OOH</td>\n",
       "      <td>ROYTON H/WB CTR  PARK ST</td>\n",
       "      <td>ROYTON</td>\n",
       "      <td>OLDHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>OL2 6QW</td>\n",
       "      <td>4.311784</td>\n",
       "      <td>56.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00502</th>\n",
       "      <td>IC24 LTD (NORFOLK &amp; WISBECH OOH)</td>\n",
       "      <td>IC24 LTD  KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>4.257501</td>\n",
       "      <td>489.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04657</th>\n",
       "      <td>ROSSENDALE MIU &amp; OOH</td>\n",
       "      <td>ROSSENDALE MIU</td>\n",
       "      <td>ROSSENDALE H/C  BACUP RD</td>\n",
       "      <td>ROSSENDALE</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BB4 7PL</td>\n",
       "      <td>4.256827</td>\n",
       "      <td>18.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00016</th>\n",
       "      <td>BURY WALK-IN CENTRE</td>\n",
       "      <td>MOORGATE PRIMARY</td>\n",
       "      <td>CARE CENTRE 22 DERBY WAY</td>\n",
       "      <td>BURY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BL9 0NJ</td>\n",
       "      <td>4.150589</td>\n",
       "      <td>138.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04587</th>\n",
       "      <td>IC24 LTD (HORSHAM &amp; MID SUSSEX OOH)</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>3.781621</td>\n",
       "      <td>215.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04921</th>\n",
       "      <td>LCW HOUNSLOW CCG OOH</td>\n",
       "      <td>ST CHARLES CTR FOR H&amp;WB</td>\n",
       "      <td>EXMOOR STREET</td>\n",
       "      <td>NaN</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>W10 6DZ</td>\n",
       "      <td>3.582849</td>\n",
       "      <td>69.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y05419</th>\n",
       "      <td>WEEKEND WORKING EASINGTON NORTH</td>\n",
       "      <td>MARLBOROUGH SURGERY</td>\n",
       "      <td>SEAHAM PCC  ST JOHNS SQ</td>\n",
       "      <td>SEAHAM</td>\n",
       "      <td>COUNTY DURHAM</td>\n",
       "      <td>SR7 7JE</td>\n",
       "      <td>3.565939</td>\n",
       "      <td>278.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y02947</th>\n",
       "      <td>COMPASS ENFIELD</td>\n",
       "      <td>2ND FLOOR FOREST PCC</td>\n",
       "      <td>308A HERTFORD ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>LONDON</td>\n",
       "      <td>N9 7HD</td>\n",
       "      <td>3.558720</td>\n",
       "      <td>7.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00581</th>\n",
       "      <td>BASSETLAW DRUG &amp; ALCOHOL SERVICE</td>\n",
       "      <td>DRUG TREATMENT SERVICE</td>\n",
       "      <td>BASSETLAW PCT</td>\n",
       "      <td>RETFORD HOSP  NORTH ROAD</td>\n",
       "      <td>RETFORD  NOTTS</td>\n",
       "      <td>DN22 7XF</td>\n",
       "      <td>3.533264</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A88603</th>\n",
       "      <td>THE PARK SURGERY</td>\n",
       "      <td>THE PARK SURGERY</td>\n",
       "      <td>GLEN PRIMARY CC GLEN ST</td>\n",
       "      <td>HEBBURN</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE31 1NU</td>\n",
       "      <td>3.511115</td>\n",
       "      <td>969.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>G81061</th>\n",
       "      <td>CHAPEL STREET SURGERY</td>\n",
       "      <td>CHAPEL STREET SURGERY</td>\n",
       "      <td>CHAPEL STREET</td>\n",
       "      <td>NEWHAVEN</td>\n",
       "      <td>EAST SUSSEX</td>\n",
       "      <td>BN9 9PW</td>\n",
       "      <td>3.490746</td>\n",
       "      <td>1504.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>L81087</th>\n",
       "      <td>BEECHWOOD MEDICAL PRACTICE</td>\n",
       "      <td>FISHPONDS HEALTH CENTRE</td>\n",
       "      <td>BEECHWOOD ROAD  FISHPONDS</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS16 3TD</td>\n",
       "      <td>3.474795</td>\n",
       "      <td>1552.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y01696</th>\n",
       "      <td>BASSETLAW HOSPICE OF THE GOOD SHEPHERD</td>\n",
       "      <td>HOSPICE OF GOOD SHEPHERD</td>\n",
       "      <td>RETFORD HPL  NORTH ROAD</td>\n",
       "      <td>RETFORD  NOTTINGHAM</td>\n",
       "      <td>NORTH NOTTINGHAMSHIRE</td>\n",
       "      <td>DN22 7XF</td>\n",
       "      <td>3.454423</td>\n",
       "      <td>46.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>G81014</th>\n",
       "      <td>CARDEN SURGERY</td>\n",
       "      <td>COUNTY OAK MEDICAL CENTRE</td>\n",
       "      <td>CARDEN HILL</td>\n",
       "      <td>BRIGHTON</td>\n",
       "      <td>EAST SUSSEX</td>\n",
       "      <td>BN1 8DD</td>\n",
       "      <td>3.450311</td>\n",
       "      <td>1375.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y01716</th>\n",
       "      <td>GP IN A&amp;E (WIC)</td>\n",
       "      <td>IC24 LTD  KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>3.395918</td>\n",
       "      <td>87.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00234</th>\n",
       "      <td>NORTHAMPTONSHIRE OOH SERVICE</td>\n",
       "      <td>PROSPECT HOUSE</td>\n",
       "      <td>121 LOWER STREET</td>\n",
       "      <td>KETTERING</td>\n",
       "      <td>NORTHAMPTONSHIRE</td>\n",
       "      <td>NN16 8DN</td>\n",
       "      <td>3.393559</td>\n",
       "      <td>382.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81057</th>\n",
       "      <td>WORDEN MEDICAL CENTRE</td>\n",
       "      <td>WORDEN MEDICAL CENTRE</td>\n",
       "      <td>WEST PADDOCK  LEYLAND</td>\n",
       "      <td>PRESTON</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>PR25 1HR</td>\n",
       "      <td>3.341328</td>\n",
       "      <td>1898.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y03662</th>\n",
       "      <td>BRISDOC HEALTHCARE SERVICES OOH</td>\n",
       "      <td>KNOWLE WEST HEALTH PARK</td>\n",
       "      <td>DOWNTON RD  KNOWLE</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS4 1WH</td>\n",
       "      <td>3.333644</td>\n",
       "      <td>566.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y01003</th>\n",
       "      <td>BURY OOH</td>\n",
       "      <td>MOORGATE PRIMARY CARE CTR</td>\n",
       "      <td>22 DERBY WAY</td>\n",
       "      <td>BURY</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BL9 0NJ</td>\n",
       "      <td>3.321530</td>\n",
       "      <td>292.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00860</th>\n",
       "      <td>IC24 SOUTHEND/CP&amp;R CCG OOH</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>3.221115</td>\n",
       "      <td>336.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04586</th>\n",
       "      <td>IC24 LTD (CRAWLEY OOH)</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>3.194264</td>\n",
       "      <td>173.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00599</th>\n",
       "      <td>HASTINGS AND ROTHER OOH</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>2.076491</td>\n",
       "      <td>291.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>L81013</th>\n",
       "      <td>FISHPONDS FAMILY PRACTICE</td>\n",
       "      <td>FISHPONDS FAMILY PRACTICE</td>\n",
       "      <td>BEECHWOOD ROAD FISHPONDS</td>\n",
       "      <td>BRISTOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>BS16 3TD</td>\n",
       "      <td>2.074359</td>\n",
       "      <td>1632.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A89019</th>\n",
       "      <td>DRS CLOAK  CHOI AND MILLIGAN</td>\n",
       "      <td>SOUTHWICK HEALTH CENTRE</td>\n",
       "      <td>THE GREEN SOUTHWICK</td>\n",
       "      <td>SUNDERLAND</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>SR5 2LT</td>\n",
       "      <td>2.051116</td>\n",
       "      <td>1661.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>M91612</th>\n",
       "      <td>ST MARY'S SURGERY</td>\n",
       "      <td>ST MARY'S SURGERY</td>\n",
       "      <td>FIELD ROAD BLOXWICH</td>\n",
       "      <td>WALSALL</td>\n",
       "      <td>WEST MIDLANDS</td>\n",
       "      <td>WS3 3JP</td>\n",
       "      <td>2.041027</td>\n",
       "      <td>981.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81079</th>\n",
       "      <td>THE THORNTON PRACTICE</td>\n",
       "      <td>THE THORNTON PRACTICE</td>\n",
       "      <td>CHURCH ROAD</td>\n",
       "      <td>THORNTON-CLEVELEYS</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>FY5 2TZ</td>\n",
       "      <td>1.997013</td>\n",
       "      <td>1970.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04588</th>\n",
       "      <td>IC24 LTD (EAST SURREY OOH)</td>\n",
       "      <td>KINGSTON HOUSE</td>\n",
       "      <td>THE LONG BARROW</td>\n",
       "      <td>ASHFORD</td>\n",
       "      <td>KENT</td>\n",
       "      <td>TN24 0GP</td>\n",
       "      <td>1.953060</td>\n",
       "      <td>194.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P84043</th>\n",
       "      <td>CORNISHWAY GROUP PRACTICE</td>\n",
       "      <td>FORUM HEALTH  SIMONSWAY</td>\n",
       "      <td>WYTHENSHAWE</td>\n",
       "      <td>MANCHESTER</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>M22 5RX</td>\n",
       "      <td>1.952903</td>\n",
       "      <td>1506.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P92621</th>\n",
       "      <td>PREMIER HEALTH TEAM</td>\n",
       "      <td>THE BRIDGEWATER MED CTR</td>\n",
       "      <td>HENRY STREET</td>\n",
       "      <td>LEIGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>WN7 2PE</td>\n",
       "      <td>1.934268</td>\n",
       "      <td>876.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A89022</th>\n",
       "      <td>CONCORD MEDICAL PRACTICE</td>\n",
       "      <td>CONCORD MEDICAL PRACTICE</td>\n",
       "      <td>THE HLTH CTR  VICTORIA RD</td>\n",
       "      <td>WASHINGTON</td>\n",
       "      <td>TYNE &amp; WEAR</td>\n",
       "      <td>NE37 2PU</td>\n",
       "      <td>1.933961</td>\n",
       "      <td>1386.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A81058</th>\n",
       "      <td>COULBY MEDICAL PRACTICE</td>\n",
       "      <td>COULBY MEDICAL PRACTICE</td>\n",
       "      <td>CROPTON WAY COULBY NEWHAM</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS8 0TL</td>\n",
       "      <td>1.926809</td>\n",
       "      <td>1585.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>C84064</th>\n",
       "      <td>PARKSIDE MEDICAL CENTRE</td>\n",
       "      <td>BULWELL RIVERSIDE CENTRE</td>\n",
       "      <td>MAIN STREET  BULWELL</td>\n",
       "      <td>NOTTINGHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>NG6 8QJ</td>\n",
       "      <td>1.923552</td>\n",
       "      <td>1314.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A81064</th>\n",
       "      <td>THE DISCOVERY PRACTICE</td>\n",
       "      <td>CLEVELAND HEALTH CENTRE</td>\n",
       "      <td>20 CLEVELAND SQUARE</td>\n",
       "      <td>CLEVELAND CENTRE</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>TS1 2NX</td>\n",
       "      <td>1.904766</td>\n",
       "      <td>1268.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B81026</th>\n",
       "      <td>ANCORA MEDICAL PRACTICE</td>\n",
       "      <td>291 ASHBY ROAD</td>\n",
       "      <td>NaN</td>\n",
       "      <td>SCUNTHORPE</td>\n",
       "      <td>NORTH LINCOLNSHIRE</td>\n",
       "      <td>DN16 2AB</td>\n",
       "      <td>1.885416</td>\n",
       "      <td>2347.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81140</th>\n",
       "      <td>DARWEN HEALTHLINK</td>\n",
       "      <td>DARWEN HEALTH CENTRE</td>\n",
       "      <td>JAMES STREET WEST</td>\n",
       "      <td>DARWEN</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB3 1PY</td>\n",
       "      <td>1.882275</td>\n",
       "      <td>2019.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P85601</th>\n",
       "      <td>JALAL PRACTICE</td>\n",
       "      <td>INTEGRATED CARE CENTRE</td>\n",
       "      <td>NEW RADCLIFFE STREET</td>\n",
       "      <td>OLDHAM</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>OL1 1NL</td>\n",
       "      <td>1.866110</td>\n",
       "      <td>885.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B83042</th>\n",
       "      <td>ROOLEY LANE MED. CENTRE</td>\n",
       "      <td>ROOLEY LANE MEDICAL CTR</td>\n",
       "      <td>ROOLEY LANE</td>\n",
       "      <td>BRADFORD</td>\n",
       "      <td>WEST YORKSHIRE</td>\n",
       "      <td>BD4 7SS</td>\n",
       "      <td>1.863582</td>\n",
       "      <td>1522.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>N82669</th>\n",
       "      <td>GREAT HOMER STREET MEDICAL CENTRE</td>\n",
       "      <td>MERE LANE N'HOOD HC</td>\n",
       "      <td>49-51 MERE LANE</td>\n",
       "      <td>LIVERPOOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>L5 0QW</td>\n",
       "      <td>1.813002</td>\n",
       "      <td>1062.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y02344</th>\n",
       "      <td>NORTHPOINT</td>\n",
       "      <td>BRANSHOLME SOUTH H/CENTRE</td>\n",
       "      <td>GOODHART RD BRANSHOLME</td>\n",
       "      <td>KINGSTON UPON HULL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>HU7 4DW</td>\n",
       "      <td>1.802433</td>\n",
       "      <td>1137.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81092</th>\n",
       "      <td>THE CRESCENT SURGERY</td>\n",
       "      <td>CLEVELEYS HEALTH CENTRE</td>\n",
       "      <td>KELSO AVENUE</td>\n",
       "      <td>THORNTON CLEVELEYS</td>\n",
       "      <td>NaN</td>\n",
       "      <td>FY5 3LF</td>\n",
       "      <td>1.798917</td>\n",
       "      <td>1734.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>N81096</th>\n",
       "      <td>BROOKVALE PRACTICE</td>\n",
       "      <td>BROOKVALE PRACTICE</td>\n",
       "      <td>HALLWOOD HC  HOSPITAL WAY</td>\n",
       "      <td>RUNCORN</td>\n",
       "      <td>MERSEYSIDE</td>\n",
       "      <td>WA7 2UT</td>\n",
       "      <td>1.797944</td>\n",
       "      <td>1484.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y00675</th>\n",
       "      <td>LEIGH NHS WIC</td>\n",
       "      <td>LEIGH HEALTH CENTRE</td>\n",
       "      <td>THE AVENUE</td>\n",
       "      <td>LEIGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>WN7 1HR</td>\n",
       "      <td>1.776010</td>\n",
       "      <td>162.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B87006</th>\n",
       "      <td>DR SP SINGH AND PARTNERS</td>\n",
       "      <td>CHURCH VIEW HEALTH CENTRE</td>\n",
       "      <td>LANGTHWAITE RD STH KIRKBY</td>\n",
       "      <td>PONTEFRACT</td>\n",
       "      <td>WEST YORKSHIRE</td>\n",
       "      <td>WF9 3AP</td>\n",
       "      <td>1.772042</td>\n",
       "      <td>1840.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>B82092</th>\n",
       "      <td>BELGRAVE SURGERY</td>\n",
       "      <td>LAWRENCE HOUSE MED CENTRE</td>\n",
       "      <td>1 BELGRAVE CRESCENT</td>\n",
       "      <td>SCARBOROUGH</td>\n",
       "      <td>NORTH YORKSHIRE</td>\n",
       "      <td>YO11 1UB</td>\n",
       "      <td>1.764372</td>\n",
       "      <td>1291.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P85006</th>\n",
       "      <td>THE PARKS MEDICAL PRACTICE</td>\n",
       "      <td>ROYTON HLTH WELLBEING CTR</td>\n",
       "      <td>PARK STREET  ROYTON</td>\n",
       "      <td>OLDHAM</td>\n",
       "      <td>NaN</td>\n",
       "      <td>OL2 6QW</td>\n",
       "      <td>1.758969</td>\n",
       "      <td>1466.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>F81106</th>\n",
       "      <td>THE ROSS PRACTICE</td>\n",
       "      <td>THE ROSS PRACTICE</td>\n",
       "      <td>KEATS HOUSE  BUSH FAIR</td>\n",
       "      <td>HARLOW</td>\n",
       "      <td>ESSEX</td>\n",
       "      <td>CM18 6LY</td>\n",
       "      <td>1.723156</td>\n",
       "      <td>1648.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>D81024</th>\n",
       "      <td>THOMAS WALKER</td>\n",
       "      <td>THOMAS WALKER SURGERY</td>\n",
       "      <td>THOMAS WALKER MEDICAL CTR</td>\n",
       "      <td>PRINCES STREET</td>\n",
       "      <td>PETERBOROUGH</td>\n",
       "      <td>PE1 2QP</td>\n",
       "      <td>1.696924</td>\n",
       "      <td>1377.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>A81033</th>\n",
       "      <td>OAKFIELD MEDICAL PRACTICE</td>\n",
       "      <td>OAKFIELDS MED PRACTICE</td>\n",
       "      <td>1 TRINITY MEWS N. ORMESBY</td>\n",
       "      <td>MIDDLESBROUGH</td>\n",
       "      <td>NaN</td>\n",
       "      <td>TS3 6AL</td>\n",
       "      <td>1.694832</td>\n",
       "      <td>1055.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81684</th>\n",
       "      <td>DR DP CHARLES' PRACTICE</td>\n",
       "      <td>HARROWSIDE SURGERY</td>\n",
       "      <td>STH SHORE PCC LYTHAM RD</td>\n",
       "      <td>BLACKPOOL</td>\n",
       "      <td>NaN</td>\n",
       "      <td>FY4 1TJ</td>\n",
       "      <td>1.691316</td>\n",
       "      <td>1353.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>N81121</th>\n",
       "      <td>NORTHGATE VILLAGE SURGERY</td>\n",
       "      <td>FOUNTAINS HEALTH</td>\n",
       "      <td>DELAMERE STREET</td>\n",
       "      <td>CHESTER</td>\n",
       "      <td>CHESHIRE</td>\n",
       "      <td>CH1 4DS</td>\n",
       "      <td>1.686184</td>\n",
       "      <td>1304.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>P81099</th>\n",
       "      <td>DR THM MACKENZIE &amp; PARTNERS</td>\n",
       "      <td>HASLINGDEN HEALTH CENTRE</td>\n",
       "      <td>MANCHESTER RD HASLINGDEN</td>\n",
       "      <td>ROSSENDALE</td>\n",
       "      <td>LANCASHIRE</td>\n",
       "      <td>BB4 5SL</td>\n",
       "      <td>1.682912</td>\n",
       "      <td>1782.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>100 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                   name                     addr_1  \\\n",
       "code                                                                 \n",
       "Y01852        NATIONAL ENHANCED SERVICE            NYE BEVAN HOUSE   \n",
       "Y03006         OUTREACH SERVICE NH / RH  PCC 69 CHURCH STREET WEST   \n",
       "Y03668  BRISDOC HEALTHCARE SERVICES OOH    KNOWLE WEST HEALTH PARK   \n",
       "G81703           H&R P C SPECIAL SCHEME   STATION PLAZA HEALTH CTR   \n",
       "Y04997                   HMR BARDOC OOH  MOORGATE PRIMARY CARE CTR   \n",
       "...                                 ...                        ...   \n",
       "D81024                    THOMAS WALKER      THOMAS WALKER SURGERY   \n",
       "A81033        OAKFIELD MEDICAL PRACTICE     OAKFIELDS MED PRACTICE   \n",
       "P81684          DR DP CHARLES' PRACTICE         HARROWSIDE SURGERY   \n",
       "N81121        NORTHGATE VILLAGE SURGERY           FOUNTAINS HEALTH   \n",
       "P81099      DR THM MACKENZIE & PARTNERS   HASLINGDEN HEALTH CENTRE   \n",
       "\n",
       "                           addr_2         borough       village post_code  \\\n",
       "code                                                                        \n",
       "Y01852               MACLURE ROAD        ROCHDALE    LANCASHIRE  OL11 1DN   \n",
       "Y03006                  RADCLIFFE      MANCHESTER           NaN   M26 2SP   \n",
       "Y03668       DOWNTON ROAD  KNOWLE         BRISTOL           NaN   BS4 1WH   \n",
       "G81703           STATION APPROACH        HASTINGS   EAST SUSSEX  TN34 1BA   \n",
       "Y04997              22 DERBY ROAD            BURY    LANCASHIRE   BL9 0NJ   \n",
       "...                           ...             ...           ...       ...   \n",
       "D81024  THOMAS WALKER MEDICAL CTR  PRINCES STREET  PETERBOROUGH   PE1 2QP   \n",
       "A81033  1 TRINITY MEWS N. ORMESBY   MIDDLESBROUGH           NaN   TS3 6AL   \n",
       "P81684    STH SHORE PCC LYTHAM RD       BLACKPOOL           NaN   FY4 1TJ   \n",
       "N81121            DELAMERE STREET         CHESTER      CHESHIRE   CH1 4DS   \n",
       "P81099   MANCHESTER RD HASLINGDEN      ROSSENDALE    LANCASHIRE   BB4 5SL   \n",
       "\n",
       "          z-score   count  \n",
       "code                       \n",
       "Y01852  11.695818     7.0  \n",
       "Y03006   7.339043     2.0  \n",
       "Y03668   6.150582    60.0  \n",
       "G81703   5.123032    36.0  \n",
       "Y04997   4.958866   321.0  \n",
       "...           ...     ...  \n",
       "D81024   1.696924  1377.0  \n",
       "A81033   1.694832  1055.0  \n",
       "P81684   1.691316  1353.0  \n",
       "N81121   1.686184  1304.0  \n",
       "P81099   1.682912  1782.0  \n",
       "\n",
       "[100 rows x 8 columns]"
      ]
     },
     "execution_count": 91,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "unique_practices.sort_values('z-score', ascending=False).head(100)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 92,
   "metadata": {},
   "outputs": [],
   "source": [
    "results = unique_practices[['name', 'z-score', 'count']].nlargest(100, 'z-score')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 93,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>name</th>\n",
       "      <th>z-score</th>\n",
       "      <th>count</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>Y01852</th>\n",
       "      <td>NATIONAL ENHANCED SERVICE</td>\n",
       "      <td>11.695818</td>\n",
       "      <td>7.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y03006</th>\n",
       "      <td>OUTREACH SERVICE NH / RH</td>\n",
       "      <td>7.339043</td>\n",
       "      <td>2.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y03668</th>\n",
       "      <td>BRISDOC HEALTHCARE SERVICES OOH</td>\n",
       "      <td>6.150582</td>\n",
       "      <td>60.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>G81703</th>\n",
       "      <td>H&amp;R P C SPECIAL SCHEME</td>\n",
       "      <td>5.123032</td>\n",
       "      <td>36.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>Y04997</th>\n",
       "      <td>HMR BARDOC OOH</td>\n",
       "      <td>4.958866</td>\n",
       "      <td>321.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "                                   name    z-score  count\n",
       "code                                                     \n",
       "Y01852        NATIONAL ENHANCED SERVICE  11.695818    7.0\n",
       "Y03006         OUTREACH SERVICE NH / RH   7.339043    2.0\n",
       "Y03668  BRISDOC HEALTHCARE SERVICES OOH   6.150582   60.0\n",
       "G81703           H&R P C SPECIAL SCHEME   5.123032   36.0\n",
       "Y04997                   HMR BARDOC OOH   4.958866  321.0"
      ]
     },
     "execution_count": 93,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 94,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Error!\n",
      "You have been rate limited for exceeding the limit of 3 per 1 minute.\n",
      "Please slow down your submission rate.\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__script_anomalies(results)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 5: script_growth\n",
    "\n",
    "Another way to identify anomalies is by comparing current data to historical data. In the case of identifying sites of drug abuse, we might compare a practice's current rate of opioid prescription to their rate 5 or 10 years ago. Unless the nature of the practice has changed, the profile of drugs they prescribe should be relatively stable. We might also want to identify trends through time for business reasons, identifying drugs that are gaining market share. That's what we'll do in this question.\n",
    "\n",
    "We'll load in beneficiary data from 6 months earlier, June 2016, and calculate the percent growth in prescription rate from June 2016 to January 2017 for each `bnf_name`. We'll return the 50 items with largest growth and the 50 items with the largest shrinkage (i.e. negative percent growth) as a list of tuples sorted by growth rate in descending order in the format `(script_name, growth_rate, raw_2016_count)`. You'll notice that many of the 50 fastest growing items have low counts of prescriptions in 2016. Filter out any items that were prescribed less than 50 times."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 95,
   "metadata": {},
   "outputs": [],
   "source": [
    "scripts16 = pd.read_csv('dw-data/201606scripts_sample.csv.gz')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 96,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Calculate (X_1 - X_0) / X_0 = (X_1 / X_0 -1)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 97,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "GlucoRX FinePoint Needles Pen Inj Screw     1532\n",
       "3m Health Care_Cavilon Durable Barrier C     825\n",
       "Fluclox Sod_Cap 500mg                        796\n",
       "Amoxicillin_Cap 500mg                        790\n",
       "Prednisolone_Tab 5mg                         786\n",
       "                                            ... \n",
       "Heparin Sod_Inj 1 000u/ml 1ml Amp              1\n",
       "Welland_Lge Post-Op Drnbl Ileo Bag + S/B       1\n",
       "Jade_Cone Top Rubb Curved Lge                  1\n",
       "Sterogyl_Oral Soln 100 000u/5ml                1\n",
       "Vanilla Blush_Supp/Vest Unisex Blk XXLge       1\n",
       "Name: bnf_name, Length: 13540, dtype: int64"
      ]
     },
     "execution_count": 97,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts16['bnf_name'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 98,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "GlucoRX FinePoint Needles Pen Inj Screw     1718\n",
       "3m Health Care_Cavilon Durable Barrier C     816\n",
       "Prednisolone_Tab 5mg                         785\n",
       "Fluclox Sod_Cap 500mg                        783\n",
       "Amoxicillin_Cap 500mg                        777\n",
       "                                            ... \n",
       "Ultrasun_Extreme Lot SPF 50+                   1\n",
       "M.Sauer_Comfort Sheath Med (Diam 28mm)         1\n",
       "Scanpor 1.25cm x 10m Surg Adh Tape Perm        1\n",
       "Renasys G Gauze Dress Kit + Soft Port Sm       1\n",
       "Neon Verifine Needles Pen Inj Screw On 1       1\n",
       "Name: bnf_name, Length: 13471, dtype: int64"
      ]
     },
     "execution_count": 98,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts['bnf_name'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 99,
   "metadata": {},
   "outputs": [],
   "source": [
    "pct_growth = scripts['bnf_name'].value_counts() / scripts16['bnf_name'].value_counts() - 1\n",
    "pct_growth.name = 'growth_rate'"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 100,
   "metadata": {},
   "outputs": [],
   "source": [
    "#Method chaining\n",
    "result = (pct_growth.to_frame()\n",
    "          .assign(raw_count = scripts16['bnf_name'].value_counts())\n",
    "          .query('raw_count > = 50')\n",
    "          .dropna()\n",
    "          .sort_values('growth_rate', ascending=False)\n",
    "          .reset_index()\n",
    "          .rename({'index':'bnf_name'}, axis=1))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 101,
   "metadata": {},
   "outputs": [],
   "source": [
    "#result['raw_count'] = raw_count = scripts16['bnf_name'].value_counts()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [],
   "source": [
    "#result = (result\n",
    "#          .sort_values('pct_growth', ascending=False)\n",
    "#          .query('raw_count > 50')\n",
    "#          .dropna()\n",
    "#          .reset_index())\n",
    "#result.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 103,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>growth_rate</th>\n",
       "      <th>raw_count</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Butec_Transdermal Patch 5mcg/hr</td>\n",
       "      <td>3.467742</td>\n",
       "      <td>62.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Butec_Transdermal Patch 10mcg/hr</td>\n",
       "      <td>3.000000</td>\n",
       "      <td>69.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Fostair NEXThaler_Inh 200mcg/6mcg (120D)</td>\n",
       "      <td>1.430233</td>\n",
       "      <td>86.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Pneumococcal_Vac 0.5ml Vl (23 Valent)</td>\n",
       "      <td>1.269430</td>\n",
       "      <td>193.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Spiolto Respimat_Inha2.5/2.5mcg(60D)+Dev</td>\n",
       "      <td>1.269231</td>\n",
       "      <td>52.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>Trulicity_Inj 1.5mg/0.5ml Pf Pen</td>\n",
       "      <td>1.185185</td>\n",
       "      <td>54.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>CosmoCol_Paed Oral Pdr Sach 6.9g</td>\n",
       "      <td>1.177419</td>\n",
       "      <td>62.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>Dulaglutide_Inj 1.5mg/0.5ml Pf Dev</td>\n",
       "      <td>0.963415</td>\n",
       "      <td>82.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>ViATIM_Vac D/Chamber 160u/25mcg 1ml Pfs</td>\n",
       "      <td>0.912000</td>\n",
       "      <td>125.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>Empagliflozin_Tab 25mg</td>\n",
       "      <td>0.896000</td>\n",
       "      <td>125.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>CareSens Lancets 0.31mm/30 Gauge</td>\n",
       "      <td>0.895522</td>\n",
       "      <td>67.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>Fostair_Inh 200mcg/6mcg (120D) CFF</td>\n",
       "      <td>0.861660</td>\n",
       "      <td>253.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>Orbis Nor Saline Sod Chlor 0.9% Nsl Dps</td>\n",
       "      <td>0.858824</td>\n",
       "      <td>85.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>Umeclidinium Brom_Inh 65mcg (30D)</td>\n",
       "      <td>0.827586</td>\n",
       "      <td>87.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>Ultibro Breezhaler_Pdr Inh Cap + Dev</td>\n",
       "      <td>0.801653</td>\n",
       "      <td>121.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>Medihoney_Barrier Crm</td>\n",
       "      <td>0.784091</td>\n",
       "      <td>88.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>Fluoxetine HCl_Oral Soln 20mg/5ml S/F</td>\n",
       "      <td>0.780822</td>\n",
       "      <td>73.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>TEE2 (Reagent)_Strips</td>\n",
       "      <td>0.777778</td>\n",
       "      <td>81.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>Zaluron XL_Tab 400mg</td>\n",
       "      <td>0.758621</td>\n",
       "      <td>58.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>Laxido_Paed Plain Oral Pdr Sach 6.9g</td>\n",
       "      <td>0.758621</td>\n",
       "      <td>174.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>Prednisolone_Oral Soln 5mg/5ml Ud</td>\n",
       "      <td>0.726027</td>\n",
       "      <td>73.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>Buprenorphine_Patch 15mcg/hr (7day)</td>\n",
       "      <td>0.715596</td>\n",
       "      <td>109.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>Coloplast_SenSura Mio Maxi Drnbl Bag S/C</td>\n",
       "      <td>0.703704</td>\n",
       "      <td>81.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>Octenisan_Antimicrobial Wsh Lot</td>\n",
       "      <td>0.702703</td>\n",
       "      <td>74.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>Duaklir Genuair_340mcg/12mcg (60D)</td>\n",
       "      <td>0.671053</td>\n",
       "      <td>152.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>Sod Chlor_Inh Soln 0.9% 2.5ml Ud Amp</td>\n",
       "      <td>0.641975</td>\n",
       "      <td>162.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>Coloplast_SenSura Mio Maxi Drnbl Bag L/C</td>\n",
       "      <td>0.627451</td>\n",
       "      <td>51.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>Flutiform_Inha 50/5mcg (120 D)</td>\n",
       "      <td>0.625000</td>\n",
       "      <td>88.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>Ins Degludec_100u/ml 3ml Pf Pen</td>\n",
       "      <td>0.616667</td>\n",
       "      <td>60.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>CareSens Lancets 0.36mm/28 Gauge</td>\n",
       "      <td>0.611111</td>\n",
       "      <td>90.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3455</th>\n",
       "      <td>Vital 1.5kcal_Liq (Vanilla)</td>\n",
       "      <td>-0.546667</td>\n",
       "      <td>75.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3456</th>\n",
       "      <td>Oxybutynin HCl_Oral Soln 2.5mg/5ml S/F</td>\n",
       "      <td>-0.557377</td>\n",
       "      <td>61.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3457</th>\n",
       "      <td>Prazosin HCl_Tab 500mcg</td>\n",
       "      <td>-0.558140</td>\n",
       "      <td>86.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3458</th>\n",
       "      <td>Artificial Saliva_Spy 50ml</td>\n",
       "      <td>-0.558685</td>\n",
       "      <td>213.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3459</th>\n",
       "      <td>Sunsense_Ultra Lot Spf 50+</td>\n",
       "      <td>-0.565217</td>\n",
       "      <td>368.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3460</th>\n",
       "      <td>Telfast 120_Tab 120mg</td>\n",
       "      <td>-0.569892</td>\n",
       "      <td>93.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3461</th>\n",
       "      <td>Otrivine-Antistin_Eye Dps</td>\n",
       "      <td>-0.572464</td>\n",
       "      <td>138.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3462</th>\n",
       "      <td>Fexofenadine HCl_Tab 30mg</td>\n",
       "      <td>-0.595960</td>\n",
       "      <td>297.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3463</th>\n",
       "      <td>Mag Trisil_Mix</td>\n",
       "      <td>-0.611940</td>\n",
       "      <td>67.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3464</th>\n",
       "      <td>Glibenclamide_Tab 5mg</td>\n",
       "      <td>-0.616438</td>\n",
       "      <td>146.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3465</th>\n",
       "      <td>Co-Danthrusate_Cap 50mg/60mg</td>\n",
       "      <td>-0.629630</td>\n",
       "      <td>81.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3466</th>\n",
       "      <td>Ketotifen Fumar_Eye Dps 250mcg/ml</td>\n",
       "      <td>-0.684211</td>\n",
       "      <td>57.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3467</th>\n",
       "      <td>Uvistat_Sun Crm Spf 50</td>\n",
       "      <td>-0.691729</td>\n",
       "      <td>133.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3468</th>\n",
       "      <td>Haelan_Tape 7.5cm x 50cm</td>\n",
       "      <td>-0.713043</td>\n",
       "      <td>115.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3469</th>\n",
       "      <td>Haelan_Tape 7.5cm x 20cm</td>\n",
       "      <td>-0.720000</td>\n",
       "      <td>100.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3470</th>\n",
       "      <td>Beconase_Hayfever Nsl Spy 50mcg (180 D)</td>\n",
       "      <td>-0.738462</td>\n",
       "      <td>65.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3471</th>\n",
       "      <td>Uvistat_Sun Crm Spf 30</td>\n",
       "      <td>-0.764706</td>\n",
       "      <td>68.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3472</th>\n",
       "      <td>Deep Freeze_Cold Gel 2%</td>\n",
       "      <td>-0.775862</td>\n",
       "      <td>58.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3473</th>\n",
       "      <td>Adizem-SR_Tab 120mg</td>\n",
       "      <td>-0.826923</td>\n",
       "      <td>52.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3474</th>\n",
       "      <td>Anugesic HC_Crm</td>\n",
       "      <td>-0.854167</td>\n",
       "      <td>96.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3475</th>\n",
       "      <td>Sunsense_Sunsensitive Crm SPF 50+</td>\n",
       "      <td>-0.856209</td>\n",
       "      <td>153.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3476</th>\n",
       "      <td>Hepatyrix_Vac 1440u/25mcg/ml 1ml Pfs</td>\n",
       "      <td>-0.875000</td>\n",
       "      <td>216.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3477</th>\n",
       "      <td>Climagest_Tab 2mg</td>\n",
       "      <td>-0.893939</td>\n",
       "      <td>66.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3478</th>\n",
       "      <td>Climaval_Tab 2mg</td>\n",
       "      <td>-0.901515</td>\n",
       "      <td>132.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3479</th>\n",
       "      <td>Orphenadrine HCl_Tab 50mg</td>\n",
       "      <td>-0.911765</td>\n",
       "      <td>102.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3480</th>\n",
       "      <td>Hydroxyzine HCl_Oral Soln 10mg/5ml</td>\n",
       "      <td>-0.914894</td>\n",
       "      <td>94.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3481</th>\n",
       "      <td>Ovysmen_Tab</td>\n",
       "      <td>-0.925373</td>\n",
       "      <td>67.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3482</th>\n",
       "      <td>Climaval_Tab 1mg</td>\n",
       "      <td>-0.926471</td>\n",
       "      <td>136.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3483</th>\n",
       "      <td>Climesse_Tab</td>\n",
       "      <td>-0.942029</td>\n",
       "      <td>69.0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3484</th>\n",
       "      <td>Polyalc_Eye Dps 1.4%</td>\n",
       "      <td>-0.996324</td>\n",
       "      <td>272.0</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>100 rows × 3 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "                                      bnf_name  growth_rate  raw_count\n",
       "0              Butec_Transdermal Patch 5mcg/hr     3.467742       62.0\n",
       "1             Butec_Transdermal Patch 10mcg/hr     3.000000       69.0\n",
       "2     Fostair NEXThaler_Inh 200mcg/6mcg (120D)     1.430233       86.0\n",
       "3        Pneumococcal_Vac 0.5ml Vl (23 Valent)     1.269430      193.0\n",
       "4     Spiolto Respimat_Inha2.5/2.5mcg(60D)+Dev     1.269231       52.0\n",
       "...                                        ...          ...        ...\n",
       "3480        Hydroxyzine HCl_Oral Soln 10mg/5ml    -0.914894       94.0\n",
       "3481                               Ovysmen_Tab    -0.925373       67.0\n",
       "3482                          Climaval_Tab 1mg    -0.926471      136.0\n",
       "3483                              Climesse_Tab    -0.942029       69.0\n",
       "3484                      Polyalc_Eye Dps 1.4%    -0.996324      272.0\n",
       "\n",
       "[100 rows x 3 columns]"
      ]
     },
     "execution_count": 103,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "script_growth = pd.concat([result.head(50), result.tail(50)])\n",
    "script_growth "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [],
   "source": [
    "script_growth_ans = script_growth[['bnf_name', 'growth_rate', 'raw_count']]"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [],
   "source": [
    "script_growth = [(\"Butec_Transdermal Patch 5mcg\\/hr\", 3.4677419355, 62.0)] * 100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 106,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Error!\n",
      "You have been rate limited for exceeding the limit of 3 per 1 minute.\n",
      "Please slow down your submission rate.\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__script_growth(script_growth_ans)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Question 6: rare_scripts\n",
    "\n",
    "Does a practice's prescription costs originate from routine care or from reliance on rarely prescribed treatments? Commonplace treatments can carry lower costs than rare treatments because of efficiencies in large-scale production. While some specialist practices can't help but avoid prescribing rare medicines because there are no alternatives, some practices may be prescribing a unnecessary amount of brand-name products when generics are available. Let's identify practices whose costs disproportionately originate from rarely prescribed items.\n",
    "\n",
    "First we have to identify which `'bnf_code'` are rare. To do this, find the probability $p$ of a prescription having a particular `'bnf_code'` if the `'bnf_code'` was randomly chosen from the unique options in the beneficiary data. We will call a `'bnf_code'` rare if it is prescribed at a rate less than $0.1p$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 107,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Plan of Attack:\n",
    "# 1. Find the uniform probability\n",
    "# 2. Find frequencies for each drug(bnf_code) = number of prescriptions of that kind / number of prescriptions\n",
    "# 3. Flag BNF codes that are deemed rare"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 108,
   "metadata": {},
   "outputs": [],
   "source": [
    "p = 1 / scripts['bnf_code'].nunique()   # or len(scripts['bnf_code'].umique())\n",
    "rates = scripts['bnf_code'].value_counts() / len(scripts)\n",
    "rare_codes = rates < 0.1 * p\n",
    "scripts = scripts.set_index('bnf_code')\n",
    "scripts['rare'] = rare_codes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 109,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "      <th>rare</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>bnf_code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0106020C0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>Bisacodyl_Tab E/C 5mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.39</td>\n",
       "      <td>0.47</td>\n",
       "      <td>12</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0106040M0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>Movicol Plain_Paed Pdr Sach 6.9g</td>\n",
       "      <td>1</td>\n",
       "      <td>4.38</td>\n",
       "      <td>4.07</td>\n",
       "      <td>30</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0301011R0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>Salbutamol_Inha 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>1.50</td>\n",
       "      <td>1.40</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0304010G0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>Chlorphenamine Mal_Oral Soln 2mg/5ml</td>\n",
       "      <td>1</td>\n",
       "      <td>2.62</td>\n",
       "      <td>2.44</td>\n",
       "      <td>150</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>0401020K0</th>\n",
       "      <td>N85639</td>\n",
       "      <td>Diazepam_Tab 2mg</td>\n",
       "      <td>1</td>\n",
       "      <td>0.16</td>\n",
       "      <td>0.26</td>\n",
       "      <td>6</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "          practice                              bnf_name  items   nic  \\\n",
       "bnf_code                                                                \n",
       "0106020C0   N85639                 Bisacodyl_Tab E/C 5mg      1  0.39   \n",
       "0106040M0   N85639      Movicol Plain_Paed Pdr Sach 6.9g      1  4.38   \n",
       "0301011R0   N85639    Salbutamol_Inha 100mcg (200 D) CFF      1  1.50   \n",
       "0304010G0   N85639  Chlorphenamine Mal_Oral Soln 2mg/5ml      1  2.62   \n",
       "0401020K0   N85639                      Diazepam_Tab 2mg      1  0.16   \n",
       "\n",
       "           act_cost  quantity   rare  \n",
       "bnf_code                              \n",
       "0106020C0      0.47        12  False  \n",
       "0106040M0      4.07        30  False  \n",
       "0301011R0      1.40         1  False  \n",
       "0304010G0      2.44       150  False  \n",
       "0401020K0      0.26         6  False  "
      ]
     },
     "execution_count": 109,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 110,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Number of rare prescriptions:11570\n"
     ]
    }
   ],
   "source": [
    "print(f\"Number of rare prescriptions:{scripts['rare'].sum()}\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 111,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x7f9d7e98e710>"
      ]
     },
     "execution_count": 111,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAu4AAAHwCAYAAAD5Keq8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAWJQAAFiUBSVIk8AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjAsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+17YcXAAAgAElEQVR4nO3de5iXdZ3/8Rc4gBAEqCgbIKCFti5uRCqUaCGJgtYF6KbpgNGWXVsi27YKpf46YOKu1oIRHromhTys5aldXEAWTGwvFINVNnUxBQULJdEEoUFkfn90MS2BqczhOx94PP7Jvvfp/Z17cJ5ze39vWtXV1dUFAABo0VpXegAAAOCtCXcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACVFV6gJZk/fqNDdq+W7dOjbIfyuPc77uc+32Xc7/vcu73XY157nfs651wxR0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAApQVekBSMZPXdig7WsmDW2kSQAAaKlccQcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACVDXGTubOnZulS5fmiSeeyJNPPpnXXnstp59+eq666qo33WbZsmWZOXNmHn300dTW1ubQQw/NmDFjUl1dnf3222+32yxatCg1NTV5/PHHs3379rz3ve/Npz/96YwaNaox3gYAALRYjRLuM2fOzJNPPpkOHTqke/fueeaZZ/7s+gsWLMiECRPSrl27nHrqqencuXMWLVqUK664IsuWLcv06dN32eZHP/pRvvWtb6VLly75xCc+kTZt2mTevHmZNGlSVq5cmYsvvrgx3goAALRIjRLukydPTvfu3dO7d+88/PDDGTt27Juuu2nTplx66aVp3bp1Zs2alf79+ydJJk6cmHHjxmXevHmZM2dORo4cWb/N2rVrc+WVV6ZLly6544470rNnzyTJF7/4xZxxxhmpqanJySefnAEDBjTG2wEAgBanUe5xHzRoUPr06ZNWrVq95bpz587Nhg0bMnLkyPpoT5J27drlwgsvTJLceuutO21zxx13ZOvWrTnnnHPqoz1JOnfunPPPPz9JcttttzXGWwEAgBapUa64vxNLlixJkgwZMmSXZcccc0zat2+f5cuXZ+vWrWnbtu1bbnPCCSfstE5DdOvWqcH7aMz9tNTj8eaci32Xc7/vcu73Xc79vqtS577ZnyqzatWqJEmfPn12WVZVVZWePXtm27ZtWbNmzdva5uCDD06HDh2ybt26bNmypUlmBgCASmv2K+6bNm1KknTqtPvfVDp27JgkefXVV9/RNps3b87GjRvTvn37PZ5t/fqNe7xt8sffvhq6n3equY/Hrip17qk8537f5dzvu5z7fVdjnvs9uWrfYp/j/nbul9+hrq7uHW8DAAAlafZw33FFfePG3f+msrur62+1zWuvvbbTegAAsLdp9nDv27dvkmT16tW7LNu2bVvWrl2bqqqq9OrV621t8+KLL2bz5s3p3r17g26TAQCAlqzZw33QoEFJksWLF++ybOnSpdmyZUsGDBhQ/0SZt9rmgQce2GkdAADYGzV7uJ9yyinp2rVr5syZkxUrVtS/Xltbm2nTpiVJzj777J22GT16dNq2bZubb745a9eurX/9d7/7Xa677rokyVlnndUM0wMAQGU0ylNlFixYkAULFiRJ1q9fnyT57//+70yaNClJ0rVr11x88cVJ/nAf+pQpUzJhwoSMHTs2I0aMSOfOnbNw4cKsWrUqw4cPz4gRI3baf69evXLRRRdlypQpGTNmTEaMGJE2bdpk3rx5WbduXcaPH+9vTQUAYK/WKOH+xBNP5K677trptTVr1tQ/i71Hjx714Z4kw4YNy+zZs3Pttddm/vz5qa2tTe/evTN58uRUV1fv9ukw1dXV6dGjR2pqanL33Xenrq4uhx9+eCZOnJhRo0Y1xtsAAIAWq1XdjmcpUrHnuI+furBBx62ZNLRB29Nwnum773Lu913O/b7Lud93eY47AADwloQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGqKnnw+++/P7NmzcqvfvWrvPLKK+nWrVuOOuqofOYzn8mAAQN2WX/ZsmWZOXNmHn300dTW1ubQQw/NmDFjUl1dnf32268C7wAAAJpHxcL9n//5n/ODH/wgXbp0ybBhw9K1a9c899xzWbhwYebPn58rr7wyn/zkJ+vXX7BgQSZMmJB27drl1FNPTefOnbNo0aJcccUVWbZsWaZPn16ptwIAAE2uIuG+fv361NTU5KCDDspPf/rTHHjggfXLlixZknHjxmX69On14b5p06Zceumlad26dWbNmpX+/fsnSSZOnJhx48Zl3rx5mTNnTkaOHFmJtwMAAE2uIve4//rXv8727dtz9NFH7xTtSTJo0KC8613vyoYNG+pfmzt3bjZs2JCRI0fWR3uStGvXLhdeeGGS5NZbb22e4QEAoAIqEu69e/dOmzZtsmLFip0CPUmWLl2a1157LR/+8IfrX1uyZEmSZMiQIbvs65hjjkn79u2zfPnybN26tWkHBwCACqnIrTJdunTJV77ylUydOjUjR47MsGHD0qVLl/p73D/ykY/km9/8Zv36q1atSpL06dNnl31VVVWlZ8+eeeqpp7JmzZocfvjhezxXt26d9njbpthPSz0eb8652Hc59/su537f5dzvuyp17iv24dTzzjsvPXv2zFe/+tXcfvvt9a/37t07o0aN2ukWmk2bNiVJOnXa/RepY8eOSZJXX321CScGAIDKqVi433DDDfnud7+b6urqnHvuuTnooIPyzDPP5Dvf+U6+8pWv5IknnshFF130jvbZqlWrBs20fv3GBm2/47evhu7nnWru47GrSp17Ks+533c59/su537f1Zjnfk+u2lfkHveHHnooV111VYYOHZrJkyenV69ead++fY466qh873vfyyGHHJIf/vCHWbNmTZI/XlHfuHH3X6S3uiIPAAClq0i433///UmS4447bpdl7du3z9FHH53t27fn8ccfT5L07ds3SbJ69epd1t+2bVvWrl2bqqqq9OrVq8lmBgCASqrIrTI7nv7yp0+U2WHH623atEnyh0dE/tu//VsWL16c0047bad1ly5dmi1btuSYY45J27Ztm3BqACjX+KkL93jbmklDG3ESYE9V5Ir7wIEDkyS33357XnjhhZ2W/exnP8uyZcvSrl27DBgwIElyyimnpGvXrpkzZ05WrFhRv25tbW2mTZuWJDn77LObaXoAAGh+Fbnifsopp+THP/5x/uu//iunnnpqPv7xj+eggw7K008/nfvvvz91dXX5h3/4h3Tt2jXJH+5xnzJlSiZMmJCxY8dmxIgR6dy5cxYuXJhVq1Zl+PDhGTFiRCXeCgAANIuKhHvr1q1z/fXX5+abb869996b++67L7///e/TuXPnnHjiiamurs7xxx+/0zbDhg3L7Nmzc+2112b+/Pmpra1N7969M3ny5FRXVzf4iTIAANCSVexxkG3atMl5552X8847721vM3DgwNxwww1NNxQAALRQFbnHHQAAeGeEOwAAFKBit8oAQEN4vCGwr3HFHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACuA57gBQiIY8ux4onyvuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAWoqvQAVFZD/vrsmklDG3ESAAD+HFfcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACuBxkAA0iMfK7v0aco4T5xkaiyvuAABQAOEOAAAFEO4AAFAA97gDtBD74r3iDb13GmBf4oo7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGqKj0AADS38VMXNmj7mklDG2kSgLfPFXcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiA57hTEQ15hrLnJ5ej1PNc6tw0H98jQCW44g4AAAUQ7gAAUADhDgAABXCPO7DXacj9xwDQUrniDgAABRDuAABQALfKAEAzcisXsKdccQcAgAJU/Ir7I488kptuuinLly/PK6+8ki5duqRfv34ZN25cTjzxxJ3WXbZsWWbOnJlHH300tbW1OfTQQzNmzJhUV1dnv/32q9A7AACAplfRcP/+97+fadOmpWvXrvnYxz6Wbt265eWXX87jjz+ehx56aKdwX7BgQSZMmJB27drl1FNPTefOnbNo0aJcccUVWbZsWaZPn17BdwIAAE2rYuH+H//xH5k2bVo+/OEP55prrknHjh13Wv7666/X//OmTZty6aWXpnXr1pk1a1b69++fJJk4cWLGjRuXefPmZc6cORk5cmSzvgeAlqIh903XTBraiJPArnx/QuOoyD3u27dvz1VXXZX27dvn6quv3iXak6RNmzb1/zx37txs2LAhI0eOrI/2JGnXrl0uvPDCJMmtt97a9IMDAECFVOSK+7Jly7J27doMHz487373u3P//fdn5cqVadeuXY4++ugMGDBgp/WXLFmSJBkyZMgu+zrmmGPSvn37LF++PFu3bk3btm2b5T0AAEBzqki4/8///E+S5KCDDsqoUaOycuXKnZYfc8wxmT59eg444IAkyapVq5Ikffr02WVfVVVV6dmzZ5566qmsWbMmhx9++B7P1a1bpz3etin201KPt68e9+1oybOVptSvZYlzlzgz+46W/P3ZkmejaVXq3Fck3F966aUkyW233ZaePXvmxhtvzNFHH51f//rXmTp1ah588MFceOGFmT17dpI/3OOeJJ067f6LtONWm1dffbUZpgeaw+n/cE+lRwCAFqUi4f7GG28kSerq6jJ9+vQceeSRSZL3ve99mTFjRoYPH56HH344y5cv3+W2mT+nVatWDZpr/fqNDdp+x29fDd3PO9Xcx9tXj/vnVOrc0/KU+D1Q4szsO1ri96d/5++7GvPc78lV+4p8OLVz585Jkl69etVH+w77779/jj/++CTJY489luSPV9Q3btz9F+mtrsgDAEDpKhLuffv2TfLmof3ud787SVJbW7vT+qtXr95l3W3btmXt2rWpqqpKr169mmBaAACovIqE+4c+9KFUVVXl2WefzdatW3dZ/tRTTyVJevTokSQZNGhQkmTx4sW7rLt06dJs2bIlAwYM8EQZAAD2WhUJ9wMOOCCnnnpqNm7cmBkzZuy07Oc//3kefPDBdOrUqf7xj6ecckq6du2aOXPmZMWKFfXr1tbWZtq0aUmSs88+u/neAAAANLOK/c2pkydPzmOPPZZrr702jzzySI4++ug8//zzWbBgQfbbb79861vfqr9lpmPHjpkyZUomTJiQsWPHZsSIEencuXMWLlyYVatWZfjw4RkxYkSl3goAADS5ioX7gQcemNtvvz0zZ87Mfffdl0cffTTvete7cuKJJ+b888/PBz7wgZ3WHzZsWGbPnp1rr7028+fPT21tbXr37p3Jkyenurq6wU+UAQCAlqxi4Z4kXbp0yeTJkzN58uS3tf7AgQNzww03NPFUAADQ8lTkHncAAOCdEe4AAFCAit4qA7C3GT91YaVHeMdKnBlgX+SKOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAE8DhL4szwqEKikhvw7qGbS0EacBCrPFXcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAogHAHAIACCHcAACiAcAcAgAIIdwAAKIBwBwCAAgh3AAAoQFWlBwCa3vipCys9AgDQQK64AwBAAYQ7AAAUwK0y0EzcrgIANIQr7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAWoqvQAAABNYfzUhXu8bc2koY04CTQOV9wBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAApQVekBoLmNn7pwj7etmTS0EScBAHj7XHEHAIACtJhwv/vuu3PEEUfkiCOOyI9//OPdrrNo0aJUV1dn4MCBGTBgQM4888zcddddzTwpAAA0vxYR7r/5zW8yZcqUdOjQ4U3X+dGPfpQvfOELWblyZT7xiU/kzDPPzIsvvphJkyblyiuvbMZpAQCg+VX8Hve6urpMnjw5Xbp0ycc//vHU1NTsss7atWtz5ZVXpkuXLrnjjjvSs2fPJMkXv/jFnHHGGampqcnJJ5+cAQMGNPf47GMacn88AEBDVPyK+6xZs7JkyZJcccUVb3rF/Y477sjWrVtzzjnn1Ed7knTu3Dnnn39+kuS2225rlnkBAKASKnrF/emnn87VV1+dsWPH5phjjsmSJUt2u96O14cMGbLLshNOOGGndRqiW7dODd5HY+6npR5vXz0uAPuOt/Ozxs+jfVelzn3Fwn3btm35x3/8x/zFX/xFvvzlL//ZdVetWpUk6dOnzy7LDj744HTo0CHr1q3Lli1b0r59+6YYlxbk9H+4p9IjAAA0u4qF+4wZM/LEE0/klltuyf777/9n1920aVOSpFOn3f9207Fjx2zevDkbN25sULivX79xj7dN/vjbV0P380419/EqfVwAaGp/7mdcpX7eU3mNee735Kp9Re5xf+yxx3LdddflM5/5TKN8oLSuri5J0qpVqwbvCwAAWqJmD/cdt8j06dMnEydOfFvbdOzYMUmycePuf7t57bXXdloPAAD2Ns1+q8zmzZuzevXqJEn//v13u84ll1ySSy65JGPHjs3Xvva19O3bNy+//HJWr16drl277rTuiy++mM2bN6d79+7ubwcAYK/V7OHetm3bnHHGGbtd9vjjj+fxxx/PwIED07dv3/rbaAYNGpRly5Zl8eLFu9xa88ADD9SvAwAAe6tmD/f9998/l19++W6XXXPNNXn88cczatSonHnmmfWvjx49Oj/4wQ9y8803Z/To0fXPcv/d736X6667Lkly1llnNf3wAABQIRX/m1Pfjl69euWiiy7KlClTMmbMmIwYMSJt2rTJvHnzsm7duowfP97fmgoAwF6tiHBPkurq6vTo0SM1NTW5++67U1dXl8MPPzwTJ07MqFGjKj0eAAA0qRYV7hdccEEuuOCCN10+dOjQDB06tBknAgCAlqEiz3EHAADeGeEOAAAFaFG3ygAAtATjpy5s0PY1k9zaS+NzxR0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoABVlTjoyy+/nAULFuT+++/PypUr88ILL6RNmzbp169fRo8enTFjxqR1611/p1i2bFlmzpyZRx99NLW1tTn00EMzZsyYVFdXZ7/99qvAOwEAgOZRkXCfO3duvv71r6dbt2457rjj8p73vCe//e1vc9999+WSSy7J4sWLM23atLRq1ap+mwULFmTChAlp165dTj311HTu3DmLFi3KFVdckWXLlmX69OmVeCsAANAsKhLuffr0ycyZM/PRj350pyvrX/7yl3PmmWdm3rx5mT9/foYPH54k2bRpUy699NK0bt06s2bNSv/+/ZMkEydOzLhx4zJv3rzMmTMnI0eOrMTbAQDYyfipC/d425pJQxtxEvYmFbnHffDgwRk6dOgut8N069YtZ511VpLk4Ycfrn997ty52bBhQ0aOHFkf7UnSrl27XHjhhUmSW2+9tRkmBwCAymhxH06tqvrDfwT4v/esL1myJEkyZMiQXdY/5phj0r59+yxfvjxbt25tniEBAKCZVeRWmTezbdu23HPPPUl2jvRVq1Yl+cMtNn+qqqoqPXv2zFNPPZU1a9bk8MMP3+Pjd+vWaY+3bYr9tNTjVfq4ALA38/O15avUOWpRV9yvvvrqrFy5MieeeOJO4b5p06YkSadOu/8idezYMUny6quvNv2QAABQAS3mivusWbNSU1OTww47LP/0T/+0R/v4v0+h2RPr129s0PY7fvtq6H7eqeY+XqWPCwB7Mz9fW67GbL09uWrfIq6433zzzbn88svz3ve+N7NmzUqXLl12Wr7jivrGjbv/Ir3VFXkAAChdxcP9xhtvzDe/+c3069cvs2bNSrdu3XZZp2/fvkmS1atX77Js27ZtWbt2baqqqtKrV6+mHhcAACqiouF+/fXX54orrsj73//+3HTTTTnwwAN3u96gQYOSJIsXL95l2dKlS7Nly5YMGDAgbdu2bdJ5AQCgUioW7jNmzMjVV1+do446KjfeeGMOOOCAN133lFNOSdeuXTNnzpysWLGi/vXa2tpMmzYtSXL22Wc3+cwAAFApFflw6l133ZXp06dnv/32y4c+9KHMnj17l3V69OiR0aNHJ/nDPe5TpkzJhAkTMnbs2IwYMSKdO3fOwoULs2rVqgwfPjwjRoxo7rcBAADNpiLhvnbt2iTJG2+8kZtuumm36xx77LH14Z4kw4YNy+zZs3Pttddm/vz5qa2tTe/evTN58uRUV1c3+IkyAADQklUk3C+44IJccMEF73i7gQMH5oYbbmiCiQAAoGWr+FNlAACAtybcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAACiDcAQCgAMIdAAAKINwBAKAAwh0AAAog3AEAoADCHQAAClBV6QEAAPij8VMXVuS4NZOGVuS4vH2uuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABqio9AAAAlTd+6sI93rZm0tBGnIQ344o7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUoKrSAwAAULbxUxc2aPuaSUMbaZK9myvuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABRDuAABQAOEOAAAFEO4AAFAA4Q4AAAUQ7gAAUADhDgAABaiq9AAAAOzbxk9duMfb1kwa2oiTtGyuuAMAQAGKuuK+bt26TJs2LYsXL84rr7ySgw8+OCeddFK+9KUvpXPnzpUeDwAAmkwx4f7cc8/lrLPOyksvvZSTTjophx12WB577LHMmjUrixcvzq233pquXbtWekwAAGgSxYT7N77xjbz00ku55JJLUl1dXf/6FVdckRtvvDHf/e53881vfrOCEwIA0Nz2pfvji7jHfc2aNXnwwQfTo0ePnHPOOTstu+CCC9KhQ4f89Kc/zebNmys0IQAANK0iwn3JkiVJkuOPPz6tW+88cseOHfPBD34wW7ZsyaOPPlqJ8QAAoMkVcavMM888kyTp06fPbpf37t07Dz74YFatWpXBgwfv8XG6deu0x9s2xX5a6vEqfVwAgMawpy1TqQYqItw3bdqUJOnUafdfpB2vb9y4sdlmakz/dvUn97ljV/I9AwCUqIhbZd5KXV1dkqRVq1YVngQAAJpGEeHesWPHJG9+RX3HFfkd6wEAwN6miHA/7LDDkiSrV6/e7fJnn302SdK3b9/mGgkAAJpVEeF+3HHHJUkefPDBbN++fadlmzZtyrJly7L//vvnr//6rysxHgAANLkiwv3QQw/N8ccfn+effz4333zzTsuuueaabN68OZ/85CfToUOHCk0IAABNq1Xdjk92tnDPPfdczjrrrLz00ks56aSTcvjhh+fRRx/NQw89lD59+uS2225L165dKz0mAAA0iWLCPUl+85vfZPr06Vm8eHFeeeWVdOvWLSeddFK+9KUvpUuXLpUeDwAAmkxR4Q4AAPuqIu5xBwCAfZ1wBwCAAgh3AAAogHAHAIACCHcAACiAcGUEG58AAArWSURBVAcAgAJUVXqA0r3++uu55ZZb8uSTT+bxxx/P008/nddffz1TpkzJmWee+bb2sXXr1owePTpPPfVUDjnkkDzwwANNPDWNYU/O/S9+8Yv853/+Zx566KE8//zz2bRpUw4++OAMHjw4n//859O7d+9mfhfsiYb8ub/rrrty88035+mnn07r1q3zl3/5lxk/fnw+9rGPNdP0NKWtW7fmxz/+ce66666sWbMmW7duTffu3fORj3wkn/nMZ9KjR49Kj0gTqqury913350777wz//u//5vf//73Oeigg9K/f/9MnDgxffv2rfSINIOvfvWrueOOO5Ik8+fPb9Sf7cK9gbZs2ZJvf/vbSZKDDjooBx10UH7zm9+8o3185zvfyfPPP98U49GE9uTcT5gwIRs2bMiAAQNy+umnp6qqKsuXL89PfvKT3HvvvampqcmAAQOaY3waYE//3F955ZWpqalJ9+7dc+aZZ+b111/Pvffemy984Qu59NJLc+655zb16DShbdu2Zdy4cVm2bFkOO+ywnHbaaWnbtm1WrFiR2bNn5+67785tt92W9773vZUelSZQW1ubCy+8MIsWLUrfvn1z2mmn5V3veldefPHFPPLII1m9erVw3wcsXLgwd9xxRzp06JDNmzc3/gHqaJDa2tq6+++/v+6FF16oq6urq5s+fXpdv3796m6//fa3tf2SJUvqjjjiiLpbbrmlrl+/fnVDhgxpynFpRHty7q+77rq6devW7fL6zJkz6/r161d32mmnNdm8NJ49Ofe/+MUv6vr161c3bNiwuldeeaX+9TVr1tQde+yxdX/1V39Vt2bNmiafnaZz77331vXr169u3LhxdW+88cZOy6ZNm1bXr1+/ukmTJlVoOpra17/+9bp+/frVXX311buc/7q6urqtW7dWYCqa00svvVT34Q9/uG7ixIl15557bl2/fv3qVq9e3ajHcI97A7Vt2zYnnnhiDj744He87aZNmzJ58uQMHjw4Z599dhNMR1Pak3P/+c9/Pocccsgur3/uc5/L/vvvn5UrV+bll19uzDFpAnty7m+77bYkyRe+8IV07ty5/vWePXvm05/+dLZu3Zo777yz0Wel+axZsyZJ8tGPfjStW+/84/Wkk05KEn++91LPPfdcbrvttvTv3z9///d/v8v5T5I2bdpUYDKa06WXXpokueyyy5rsGMK9gqZMmZLf/e53ufzyyys9ChXWqlWr7LfffklS/7/sXZYsWZIkGTJkyC7LTjjhhJ3WoUzve9/7kiQPPPBAtm/fvtOyRYsWJUkGDx7c7HPR9P793/8927dvz6hRo7Jp06bcc889ue666/Kv//qvefbZZys9Hs3gzjvvzIIFC/KNb3wjXbt2bbLjuMe9Qu67777cddddmTJlSt7znvdUehwqbO7cuXnttdfygQ98IO9+97srPQ6NbPPmzXnhhRfSoUOH3V6l3/HBpdWrVzfzZDSmj370ozn55JMzf/78nH766Rk8eHDatGmTX/7yl1m2bFmqq6t9jmEvtWLFiiTJxo0bM2zYsLzyyiv1y1q1apWzzz47l1xyiQsze6nnn38+l19+eT7xiU9k2LBhTXos4V4Bv/3tb3PZZZflhBNOeNtPnmHvtWbNmnzrW99KVVVVLr744kqPQxPYuHFjkqRTp067Xb7j9VdffbXZZqLxtWrVKtOnT8+MGTPy/e9/P7/61a/qlw0ePDinnXaacNtLbdiwIUkyffr0DB48OBdffHF69OiRxx57LP/v//2/3HLLLTnggANywQUXVHhSGtv27dszadKkdOjQIZdcckmTH0+4Jxk6dOg7eqrL6aefnquuumqPj3fJJZdk27ZtmTJlyh7vg8bR3Of+T7300kv53Oc+lw0bNuSyyy7LBz/4wUbbN39epc/97rRq1apJ989ba8j3RW1tbS666KI88MADueyyy3LSSSelffv2+cUvfpHLL7885557bv7lX/6lya/IsWcacu7feOONJEm3bt0yY8aM7L///kn+8Avb9OnTM2rUqPzwhz/M+eefn7Zt2zb+8DRIQ879jTfemIcffjjXX3/9Tp9fairCPUmvXr3e0R+kPfkg6g533313Fi1alCuvvHK3H1KkeTXnuf9TL730UsaNG5dVq1bla1/7Ws4555xG2zdvrTnP/Y4r6juuvP+pt7oiT/NpyPfF9ddfn7lz5+ZrX/tazjrrrPrXTzzxxBxyyCH55Cc/mW9/+9vCvYVqyLnfEWxDhgypj/YdjjzyyPTs2TPPPfdcnnnmmRx55JGNMzCNZk/P/erVq/Pd7343o0ePzoknnthU4+1EuCe56aabmu1Yv/zlL5MkF1988W5vi3jhhRdyxBFHJEmWLl3qfucm1pzn/v968cUXc9555+WZZ57JZZddJtoroDnPfYcOHXLIIYfkhRdeyIsvvrjLLwE7PrzWp0+fZpuJ3WvI98WOD6Aed9xxuyw78sgj06VLlzz//PN5+eWXm/TDa+yZhpz7vn375sEHH3zTX753/Cz//e9/v8fHoOns6bn/1a9+Vf9EsDd7KtjJJ5+cJJkxY0aj/NIu3JvZgAED3vSB/D/5yU/Svn37jBw5Mkn857S91Lp16zJu3Lg8++yz+cY3vpFPfepTlR6JZjBo0KDcc889Wbx4ccaMGbPTsh1/W/KgQYMqMRqN5PXXX0/yx/ud/6+tW7dm06ZNSTwWcG80aNCgzJ49O0899dQuy7Zu3Vr/y7m/OXfv0qNHj5xxxhm7Xfazn/0s69evzymnnJKOHTs22rkX7s1sxIgRGTFixG6X/eQnP8m73/1uj4fci/3617/O2LFj6z+B/qcBx97rrLPOyj333JNrr702w4YNq/9P62vXrs0tt9yStm3bZvTo0RWekoYYOHBgVq5cmeuuuy4DBw7c6eLLNddck23btqV///7p2LFjBaekKZxwwgnp1atXHnzwwfz85z/PRz7ykfplM2bMyMaNG3PsscemW7duFZySxvb+97//TZuturo669evz5e//OX6J4c1hlZ1dXV1jba3fdT111+fZ555JknyxBNP5Mknn8yAAQPq/7P3wIED39bTY4444ogccsgh9VffaPne6bnf8QGYo446Kh/72Md2u89Ro0alZ8+eTT47DbMnf+6nTp2aH/7wh+nevXuGDx+e119/Pffee29eeeWVXHrppR4VWLgXXnghf/M3f5N169alR48e9fc7L1u2LI899lj233//3HjjjRkwYEClR6UJPPLII/nsZz+b119/PcOGDUuPHj2yYsWKLF26NAcccEBuueWW9O3bt9Jj0kyqq6vz8MMPZ/78+Y0a7q64N4LFixfn4Ycf3um15cuXZ/ny5fX/32Mf907v9Nzv+NT6L3/5y/rPO/ypY489VrgXYE/+3E+aNClHHHFEfvSjH+X2229Pq1atctRRR+Wzn/3sm/4iRzkOOeSQ3HXXXbnhhhty//33584770xdXV26deuW0aNH52//9m9z+OGHV3pMmsiHPvSh3HHHHfne976Xhx56KAsXLsyBBx6YT33qU/m7v/u7dO/evdIjshdwxR0AAArQutIDAAAAb024AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABRAuAMAQAGEOwAAFEC4AwBAAYQ7AAAUQLgDAEABhDsAABTg/wPZCfJ0UebRXAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<Figure size 864x576 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "np.log(rates).hist(bins=40)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now for each practice, calculate the proportion of costs that originate from prescription of rare treatments (i.e. rare `'bnf_code'`). Use the `'act_cost'` field for this calculation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 112,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Filter to only include the rare prescriptions\n",
    "# Group by practice\n",
    "# Aggregate to calculate the sum of actual cost\n",
    "\n",
    "rare_cost_total = scripts.query(\"rare==True\").groupby('practice')['act_cost'].sum()\n",
    "all_cost_total = scripts.groupby('practice')['act_cost'].sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 113,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "90"
      ]
     },
     "execution_count": 113,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rare_cost_prop = (rare_cost_total / all_cost_total)\n",
    "rare_cost_prop.isnull().sum()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 114,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "{'A89621',\n",
       " 'B81685',\n",
       " 'C85617',\n",
       " 'G81703',\n",
       " 'N83612',\n",
       " 'N85639',\n",
       " 'N85647',\n",
       " 'P81793',\n",
       " 'Y00016',\n",
       " 'Y00043',\n",
       " 'Y00234',\n",
       " 'Y00418',\n",
       " 'Y00459',\n",
       " 'Y00581',\n",
       " 'Y00599',\n",
       " 'Y00620',\n",
       " 'Y00675',\n",
       " 'Y00828',\n",
       " 'Y00860',\n",
       " 'Y00908',\n",
       " 'Y00934',\n",
       " 'Y00992',\n",
       " 'Y01130',\n",
       " 'Y01174',\n",
       " 'Y01262',\n",
       " 'Y01634',\n",
       " 'Y01667',\n",
       " 'Y01716',\n",
       " 'Y01852',\n",
       " 'Y01894',\n",
       " 'Y01943',\n",
       " 'Y02318',\n",
       " 'Y02496',\n",
       " 'Y02532',\n",
       " 'Y02533',\n",
       " 'Y02696',\n",
       " 'Y02851',\n",
       " 'Y02947',\n",
       " 'Y03006',\n",
       " 'Y03010',\n",
       " 'Y03077',\n",
       " 'Y03179',\n",
       " 'Y03408',\n",
       " 'Y03514',\n",
       " 'Y03640',\n",
       " 'Y03668',\n",
       " 'Y03712',\n",
       " 'Y03780',\n",
       " 'Y03839',\n",
       " 'Y03860',\n",
       " 'Y03863',\n",
       " 'Y04030',\n",
       " 'Y04080',\n",
       " 'Y04147',\n",
       " 'Y04168',\n",
       " 'Y04354',\n",
       " 'Y04426',\n",
       " 'Y04495',\n",
       " 'Y04510',\n",
       " 'Y04531',\n",
       " 'Y04588',\n",
       " 'Y04603',\n",
       " 'Y04657',\n",
       " 'Y04681',\n",
       " 'Y04692',\n",
       " 'Y04831',\n",
       " 'Y04913',\n",
       " 'Y04921',\n",
       " 'Y04922',\n",
       " 'Y04923',\n",
       " 'Y04972',\n",
       " 'Y05131',\n",
       " 'Y05192',\n",
       " 'Y05233',\n",
       " 'Y05269',\n",
       " 'Y05274',\n",
       " 'Y05327',\n",
       " 'Y05366',\n",
       " 'Y05371',\n",
       " 'Y05374',\n",
       " 'Y05401',\n",
       " 'Y05439',\n",
       " 'Y05457',\n",
       " 'Y05488',\n",
       " 'Y05540',\n",
       " 'Y05566',\n",
       " 'Y05570',\n",
       " 'Y05583',\n",
       " 'Y05597',\n",
       " 'Y05670'}"
      ]
     },
     "execution_count": 114,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "set(all_cost_total.index) - set(rare_cost_total.index)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 115,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>practice</th>\n",
       "      <th>bnf_name</th>\n",
       "      <th>items</th>\n",
       "      <th>nic</th>\n",
       "      <th>act_cost</th>\n",
       "      <th>quantity</th>\n",
       "      <th>rare</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>bnf_code</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0301011R0</th>\n",
       "      <td>Y05366</td>\n",
       "      <td>Salbutamol_Inha B/A 100mcg (200 D) CFF</td>\n",
       "      <td>1</td>\n",
       "      <td>6.3</td>\n",
       "      <td>5.84</td>\n",
       "      <td>1</td>\n",
       "      <td>False</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "          practice                                bnf_name  items  nic  \\\n",
       "bnf_code                                                                 \n",
       "0301011R0   Y05366  Salbutamol_Inha B/A 100mcg (200 D) CFF      1  6.3   \n",
       "\n",
       "           act_cost  quantity   rare  \n",
       "bnf_code                              \n",
       "0301011R0      5.84         1  False  "
      ]
     },
     "execution_count": 115,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "scripts.query('practice == \"Y05366\"')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we will calculate a z-score for each practice based on this proportion.\n",
    "First take the difference of `rare_cost_prop` and the proportion of costs originating from rare treatments across all practices."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 116,
   "metadata": {},
   "outputs": [],
   "source": [
    "relative_rare_cost_prop = rare_cost_prop - scripts.query('rare == True')['act_cost'].sum() / scripts['act_cost'].sum()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we will estimate the standard errors (i.e. the denominator of the z-score) by simply taking the standard deviation of this difference."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 117,
   "metadata": {},
   "outputs": [],
   "source": [
    "standard_errors = relative_rare_cost_prop.std()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Finally compute the z-scores. Return the practices with the top 100 z-scores in the form `(post_code, practice_name, z-score)`. Note that some practice codes will correspond with multiple names. In this case, use the first match when sorting names alphabetically."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 118,
   "metadata": {},
   "outputs": [],
   "source": [
    "rare_scores = relative_rare_cost_prop / standard_errors"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 119,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.axes._subplots.AxesSubplot at 0x7f9d7fcf9588>"
      ]
     },
     "execution_count": 119,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAvEAAAHwCAYAAAAvjDDZAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAAWJQAAFiUBSVIk8AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4xLjAsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy+17YcXAAAgAElEQVR4nO3df1jVZZ7/8RfKD0EMMDELUBQHa11tyDBs/DEh+QPLBtDNHx2d7Nq1a02lthRndL9t0pKTXl1gptbsyVDTq13MpmzBGDDBScUwtSUXKzBwJfyRCUKgcr5/dHEmBkwP58jh1ufjuua6ps/nvj+8P+/Q8zp39/kcD5vNZhMAAAAAY3RxdwEAAAAAHEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADOPp7gI6k1OnatxdwhUFB/eQ1Llr7GzoWfvQN8fRM8fRs/ahb46jZ46jZ+3jaN+ax7cXK/EAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYTzdXQCkOS/lOTXfmhLrokoAAABgAlbiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAwxDiAQAAAMMQ4gEAAADDEOIBAAAAw3i68mIHDhzQW2+9pYMHD+rcuXMKDAxUZGSkZs+erTFjxrQYW1xcrLVr1+rQoUNqaGhQ3759lZSUJIvFoq5du7Z5/fz8fFmtVpWUlKipqUkDBw7UjBkzlJCQ4MrbAAAAADo1l4X41157Tenp6QoKCtIDDzyg4OBgfffddyopKdG+fftahPjc3FwtWLBAPj4+mjhxogICApSfn6+0tDQVFxcrIyOj1fU3bdqk5cuXKzAwUJMnT5aXl5dycnKUkpKi0tJSLV682FW3AgAAAHRqLgnx//3f/6309HTdf//9Wr16tfz9/Vucv3jxov3/19bWatmyZerSpYsyMzM1ZMgQSVJycrJmz56tnJwc7dixQ5MmTbLPqays1IoVKxQYGKisrCyFhoZKkubNm6cpU6bIarVq3LhxioqKcsXtAAAAAJ2a03vim5qatHLlSvn6+mrVqlWtArwkeXl52f9/dna2zp49q0mTJtkDvCT5+Pho4cKFkqQtW7a0mJ+VlaXGxkbNnDnTHuAlKSAgQHPnzpUkbd261dlbAQAAAIzg9Ep8cXGxKisrNX78eN1yyy3atWuXSktL5ePjo6FDh7ZaHd+7d68kadSoUa2uFR0dLV9fXx08eFCNjY3y9va+6pzRo0e3GAMAAADc6JwO8Z9//rkkqVevXkpISFBpaWmL89HR0crIyFDPnj0lSWVlZZKk8PDw1sV4eio0NFTHjh1TRUWFIiIirjqnd+/e8vPzU1VVlerr6+Xr69vuewkO7tHuue5kat0dhf60D31zHD1zHD1rH/rmOHrmOHrWPh3VN6e305w5c0bSj9tZGhoatGHDBhUXF+uDDz7QyJEjVVRUZN8mI/24J16SevRo+wabt+OcP3/e4Tk1NTVO3g0AAADQ+Tm9En/58mVJks1mU0ZGhu68805J0i9+8QutWbNG48eP1/79+3Xw4EGHPnjq4eFxzWNtNpvDc9py6pSZbwJMrft6a34nTH8cQ98cR88cR8/ah745jp45jp61j6N9c3bF3umV+ICAAElSWFiYPcA369atm0aOHClJOnz4sKSrr5q3tep+tTkXLlxoMQ4AAAC4kTkd4vv37y/pyltdbrnlFklSQ0NDi/Hl5eWtxl66dEmVlZXy9PRUWFhYq5/R1pzq6mrV1dWpT58+Tu2HBwAAAEzhdIi/99575enpqePHj6uxsbHV+WPHjkmSQkJCJEkxMTGSpIKCglZji4qKVF9fr6ioKPuTaa42Z/fu3S3GAAAAADc6p0N8z549NXHiRNXU1GjNmjUtzu3Zs0eFhYXq0aOH/fGQEyZMUFBQkHbs2KEjR47YxzY0NCg9PV2SNH369BbXSUxMlLe3tzZv3qzKykr78e+//17r16+XJE2bNs3ZWwEAAACM4JJvbF2yZIkOHz6sdevW6cCBAxo6dKhOnDih3Nxcde3aVcuXL7dvq/H391dqaqoWLFigWbNmKT4+XgEBAcrLy1NZWZnGjx+v+Pj4FtcPCwvTokWLlJqaqqSkJMXHx8vLy0s5OTmqqqrSnDlz+LZWAAAA3DRcEuJvvfVWvfPOO1q7dq0++ugjHTp0SN27d9eYMWM0d+5c/fKXv2wxPi4uThs3btS6deu0c+dONTQ0qF+/flqyZIksFkubT5mxWCwKCQmR1WrV9u3bZbPZFBERoeTkZCUkJLjiNgAAAAAjeNian88Itz1Kac5LeU7Nt6bEuqiSGwuPyGof+uY4euY4etY+9M1x9Mxx9Kx9jHvEJAAAAICORYgHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAM4+mKi8TGxurEiRNtnuvVq5f27NnT6nhxcbHWrl2rQ4cOqaGhQX379lVSUpIsFou6du3a5rXy8/NltVpVUlKipqYmDRw4UDNmzFBCQoIrbgMAAAAwgktCvCT16NFDs2fPbnXcz8+v1bHc3FwtWLBAPj4+mjhxogICApSfn6+0tDQVFxcrIyOj1ZxNmzZp+fLlCgwM1OTJk+Xl5aWcnBylpKSotLRUixcvdtWtAAAAAJ2ay0L8Lbfcovnz5191XG1trZYtW6YuXbooMzNTQ4YMkSQlJydr9uzZysnJ0Y4dOzRp0iT7nMrKSq1YsUKBgYHKyspSaGioJGnevHmaMmWKrFarxo0bp6ioKFfdDgAAANBpdfie+OzsbJ09e1aTJk2yB3hJ8vHx0cKFCyVJW7ZsaTEnKytLjY2Nmjlzpj3AS1JAQIDmzp0rSdq6dWsHVA8AAAC4n8tW4hsbG/Xee+/p5MmT8vX11aBBgxQdHd1qf/vevXslSaNGjWp1jejoaPn6+urgwYNqbGyUt7f3VeeMHj26xRgAAADgRueyEH/q1CktWrSoxbHQ0FClpaVp+PDh9mNlZWWSpPDw8NbFeHoqNDRUx44dU0VFhSIiIq46p3fv3vLz81NVVZXq6+vl6+vb7nsIDu7R7rnuZGrdHYX+tA99cxw9cxw9ax/65jh65jh61j4d1TeXbKdJTEzUhg0btGfPHn322Wd6//339eijj+rEiRP6x3/8Rx09etQ+tra2VtKPH4Rti7+/vyTp/PnzDs+pqalx/mYAAACATs4lK/FPPfVUi3+OjIzUCy+8oO7du8tqtWr16tVas2aNQ9f08PC45rE2m83hOW05dcrMNwGm1n29Nb8Tpj+OoW+Oo2eOo2ftQ98cR88cR8/ax9G+Obtif10/2Dpt2jRJ0oEDB+zHrrZq3taq+9XmXLhwocU4AAAA4EZ2XUP8rbfeKkmqq6uzH+vfv78kqby8vNX4S5cuqbKyUp6engoLC7umOdXV1aqrq1OfPn2c2g8PAAAAmOK6hviDBw9KUotAHhMTI0kqKChoNb6oqEj19fWKioqyP5nmanN2797dYgwAAABwo3M6xB87dkznzp1rdfzEiRNavny5JGny5Mn24xMmTFBQUJB27NihI0eO2I83NDQoPT1dkjR9+vQW10pMTJS3t7c2b96syspK+/Hvv/9e69evl/TXrTsAAADAjc7pD7ZmZ2fr9ddf13333afQ0FB1795dFRUV2rVrlxoaGjRmzBjNmTPHPt7f31+pqalasGCBZs2apfj4eAUEBCgvL09lZWUaP3684uPjW/yMsLAwLVq0SKmpqUpKSlJ8fLy8vLyUk5OjqqoqzZkzh29rBQAAwE3D6RB/3333qaysTCUlJfrss89UX1+vHj16aNiwYXrkkUf0yCOPtHpqTFxcnDZu3Kh169Zp586damhoUL9+/bRkyRJZLJY2nzJjsVgUEhIiq9Wq7du3y2azKSIiQsnJyUpISHD2NgAAAABjOB3ihw8f3uLLnK7VsGHD9MYbbzg0JzY2VrGxsQ7/LAAAAOBGcl0/2AoAAADA9QjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYa5LiN++fbsGDRqkQYMG6T//8z/bHJOfny+LxaJhw4YpKipKU6dO1bvvvvuz13333Xc1ZcoURUVFadiwYbJYLMrPz78etwAAAAB0Wi4P8SdPnlRqaqr8/PyuOGbTpk168sknVVpaqsmTJ2vq1Kmqrq5WSkqKVqxY0eacFStWKCUlRadOndLUqVM1efJklZaW6sknn9SmTZtcfRsAAABAp+XpyovZbDYtWbJEgYGBevDBB2W1WluNqays1IoVKxQYGKisrCyFhoZKkubNm6cpU6bIarVq3LhxioqKss8pLi6W1WpV37599V//9V8KCAiQJD3xxBNKSkrSihUr9Otf/9p+LQAAAOBG5tKV+MzMTO3du1dpaWlXXInPyspSY2OjZs6c2SJ0BwQEaO7cuZKkrVu3tpjT/M9PPvmkPcBLUmhoqGbMmKHGxkZt27bNlbcCAAAAdFouC/FfffWVVq1apVmzZik6OvqK4/bu3StJGjVqVKtzo0ePbjHGmTkAAADAjcol22kuXbqk5557TrfffrueeeaZnx1bVlYmSQoPD291rnfv3vLz81NVVZXq6+vl6+ururo6ffvtt/Lz81Pv3r1bzenXr58kqby83On7CA7u4fQ13MHUujsK/Wkf+uY4euY4etY+9M1x9Mxx9Kx9OqpvLgnxa9as0RdffKG3335b3bp1+9mxtbW1kqQePdq+QX9/f9XV1ammpka+vr6qqan52fHNx8+fP9/e8gEAAACjOB3iDx8+rPXr1+vxxx9v8WHU9rLZbJIkDw8Ph+Y5Or4tp07VOH0NdzC17uut+Z0w/XEMfXMcPXMcPWsf+uY4euY4etY+jvbN2RV7p/bEN2+jCQ8PV3Jy8jXN8ff3lyT7CvvfunDhQotxzSvtVxp/tZV6AAAA4Ebj1Ep8XV2dfS/6kCFD2hyzdOlSLV26VLNmzdLvf/979e/fX999953Ky8sVFBTUYmx1dbXq6urUp08f+fr6SpL8/Px022236dtvv1V1dXWrffHHjx+X1PYeewAAAOBG5FSI9/b21pQpU9o8V1JSopKSEg0bNkz9+/e3b7WJiYlRcXGxCgoKWm2/2b17t33MT8XExOi9995TQUGBkpKSrmkOAAAAcKNyKsR369ZNL774YpvnVq9erZKSEiUkJGjq1Kn244mJifrjH/+ozZs3KzEx0f6s+O+//17r16+XJE2bNq3FtaZNm6b33ntP69atU1xcnP1Z8ZWVlXr77bfl7e2txMREZ24FAAAAMIZLv7H1WoSFhWnRokVKTU1VUlKS4uPj5eXlpZycHFVVVWnOnDmtVujvuecePf7443rzzTc1efJkjR8/XhcvXtSHH36oc+fOadmyZXxbKwAAAG4aHR7iJclisSgkJERWq1Xbt2+XzWZTRESEkpOTlZCQ0OaclJQUDRo0SJs2bdI777wjDw8PDR48WE888YQeeOCBDr4DAAAAwH2uW4ifP3++5s+ff8XzsbGxio2NdeiaCQkJVwz5AAAAwM3CqUdMAgAAAOh4hHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwnq64yMsvv6zPP/9c5eXl+u6779StWzfdcccdiouL08yZMxUUFNRqTnFxsdauXatDhw6poaFBffv2VVJSkiwWi7p27drmz8nPz5fValVJSYmampo0cOBAzZgxQwkJCa64DQAAAMAILlmJf+utt1RfX6/7779fs2bN0sMPP6yuXbtq9erVmjx5sk6ePNlifG5urh577DEdOHBAcXFxmjFjhi5evKi0tDQ9/fTTbf6MTZs26cknn1RpaakmT56sqVOnqrq6WikpKVqxYoUrbgMAAAAwgktW4j/99FP5+Pi0Ov7KK69o3bp1Wr9+vZ5//nlJUm1trZYtW6YuXbooMzNTQ4YMkSQlJydr9uzZysnJ0Y4dOzRp0iT7dSorK7VixQoFBgYqKytLoaGhkqR58+ZpypQpslqtGjdunKKiolxxOwAAAECn5pKV+LYCvCRNnDhRknT8+HH7sezsbJ09e1aTJk2yB/jmayxcuFCStGXLlhbXycrKUmNjo2bOnGkP8JIUEBCguXPnSpK2bt3qilsBAAAAOr3r+sHWvLw8SdKgQYPsx/bu3StJGjVqVKvx0dHR8vX11cGDB9XY2HhNc0aPHt1iDAAAAHCjc8l2mmb/8R//obq6OtXU1Ojzzz/Xp59+qkGDBumf/umf7GPKysokSeHh4a2L8fRUaGiojh07poqKCkVERFx1Tu/eveXn56eqqirV19fL19e33fUHB/do91x3MrXujkJ/2oe+OY6eOY6etQ99cxw9cxw9a5+O6ptLQ7zVatXp06ft/zxq1Ci99NJL6tmzp/1YbW2tJKlHj7Zv0N/fX5J0/vx5h+Y0v3lwJsQDAAAAJnBpiN+zZ48k6fTp0zp48KBWrlyp3/zmN1q/fr0GDx7s0LU8PDyueazNZnN4TltOnapxar67mFr39db8Tpj+OIa+OY6eOY6etQ99cxw9cxw9ax9H++bsiv112RPfq1cvPfjgg7JarTp37pwWL15sP9e80l5T0/YNtrXqfrU5Fy5caDEOAAAAuJFd1w+2hoSEaODAgTp27JjOnj0rSerfv78kqby8vNX4S5cuqbKyUp6engoLC7Mf/7k51dXVqqurU58+fdhKAwAAgJvCdQ3x0o8hW5L9W1hjYmIkSQUFBa3GFhUVqb6+XlFRUfL29rYf/7k5u3fvbjEGAAAAuNE5HeK/+uornTp1qtXxpqYmvfLKKzpz5oyioqIUEBAgSZowYYKCgoK0Y8cOHTlyxD6+oaFB6enpkqTp06e3uFZiYqK8vb21efNmVVZW2o9///33Wr9+vSRp2rRpzt4KAAAAYASnP9haUFCgl19+Wffee6/69u2rwMBAnT59WkVFRaqoqFBwcLBSU1Pt4/39/ZWamqoFCxZo1qxZio+PV0BAgPLy8lRWVqbx48crPj6+xc8ICwvTokWLlJqaqqSkJMXHx8vLy0s5OTmqqqrSnDlz+LZWAAAA3DScDvH333+//uEf/kHFxcU6evSo/TGP4eHheuSRR2SxWBQYGNhiTlxcnDZu3Kh169Zp586damhoUL9+/bRkyRJZLJY2nzJjsVgUEhIiq9Wq7du3y2azKSIiQsnJyUpISHD2NgAAAABjOB3iIyMj9f/+3/9zeN6wYcP0xhtvODQnNjZWsbGxDv8sAAAA4EZy3T/YCgAAAMC1CPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhPJ29wHfffafc3Fzt2rVLpaWl+vbbb+Xl5aXIyEglJiYqKSlJXbq0fq9QXFystWvX6tChQ2poaFDfvn2VlJQki8Wirl27tvmz8vPzZbVaVVJSoqamJg0cOFAzZsxQQkKCs7cBAAAAGMPpEJ+dna3nn39ewcHBuu+++3THHXfo9OnT+uijj7R06VIVFBQoPT1dHh4e9jm5ublasGCBfHx8NHHiRAUEBCg/P19paWkqLi5WRkZGq5+zadMmLV++XIGBgZo8ebK8vLyUk5OjlJQUlZaWavHixc7eCgAAAGAEp0N8eHi41q5dq1//+tctVtyfeeYZTZ06VTk5Odq5c6fGjx8vSaqtrdWyZcvUpUsXZWZmasiQIZKk5ORkzZ49Wzk5OdqxY4cmTZpkv1ZlZaVWrFihwMBAZWVlKTQ0VJI0b948TZkyRVarVePGjVNUVJSztwMAAAB0ek7viR8xYoRiY2NbbZkJDg7WtGnTJEn79++3H8/OztbZs2c1adIke4CXJB8fHy1cuFCStGXLlhbXysrKUmNjo2bOnGkP8JIUEBCguXPnSpK2bt3q7K0AAAAARriuH2z19Pxxof+ne9z37t0rSRo1alSr8dHR0fL19dXBgwfV2Nh4TXNGjx7dYgwAAABwo3N6O82VXLp0Se+9956kluG7rKxM0o/bcFoV4+mp0NBQHTt2TBUVFYqIiLjqnN69e8vPz09VVVWqr6+Xr69vu2sODu7R7rnuZGrdHYX+tA99cxw9cxw9ax/65jh65jh61j4d1bfrthK/atUqlZaWasyYMS1CfG1trSSpR4+2b9Df31+SdP78eYfn1NTUOF84AAAA0Mldl5X4zMxMWa1WDRgwQH/4wx/adY2fPs3mamw2m8Nz2nLqlJlvAkyt+3prfidMfxxD3xxHzxxHz9qHvjmOnjmOnrWPo31zdsXe5Svxmzdv1osvvqiBAwcqMzNTgYGBLc5fbdW8rVX3q825cOFCi3EAAADAjcylIX7Dhg164YUXFBkZqczMTAUHB7ca079/f0lSeXl5q3OXLl1SZWWlPD09FRYWdk1zqqurVVdXpz59+ji1Hx4AAAAwhctC/Ouvv660tDTdddddeuutt3Trrbe2OS4mJkaSVFBQ0OpcUVGR6uvrFRUVJW9v72uas3v37hZjAAAAgBudS0L8mjVrtGrVKg0ePFgbNmxQz549rzh2woQJCgoK0o4dO3TkyBH78YaGBqWnp0uSpk+f3mJOYmKivL29tXnzZlVWVtqPf//991q/fr0k2Z9JDwAAANzonP5g67vvvquMjAx17dpV9957rzZu3NhqTEhIiBITEyX9uG89NTVVCxYs0KxZsxQfH6+AgADl5eWprKxM48ePV3x8fIv5YWFhWrRokVJTU5WUlKT4+Hh5eXkpJydHVVVVmjNnDt/WCgAAgJuG0yG+eWX88uXLeuutt9ocM3z4cHuIl6S4uDht3LhR69at086dO9XQ0KB+/fppyZIlslgsbT5lxmKxKCQkRFarVdu3b5fNZlNERISSk5OVkJDg7G0AAAAAxnA6xM+fP1/z5893eN6wYcP0xhtvODQnNjZWsbGxDv8sAAAA4EZy3b7sCQAAAMD1QYgHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADOnToycAABb7SURBVEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAMQ4gHAAAADEOIBwAAAAxDiAcAAAAM4+mKi2RnZ6uoqEhffPGFjh49qgsXLujhhx/WypUrrzinuLhYa9eu1aFDh9TQ0KC+ffsqKSlJFotFXbt2bXNOfn6+rFarSkpK1NTUpIEDB2rGjBlKSEhwxW0AAAAARnBJiF+7dq2OHj0qPz8/9enTR19//fXPjs/NzdWCBQvk4+OjiRMnKiAgQPn5+UpLS1NxcbEyMjJazdm0aZOWL1+uwMBATZ48WV5eXsrJyVFKSopKS0u1ePFiV9wKAAAA0Om5JMQvWbJEffr0Ub9+/bR//37NmjXrimNra2u1bNkydenSRZmZmRoyZIgkKTk5WbNnz1ZOTo527NihSZMm2edUVlZqxYoVCgwMVFZWlkJDQyVJ8+bN05QpU2S1WjVu3DhFRUW54nYAAACATs0le+JjYmIUHh4uDw+Pq47Nzs7W2bNnNWnSJHuAlyQfHx8tXLhQkrRly5YWc7KystTY2KiZM2faA7wkBQQEaO7cuZKkrVu3uuJWAAAAgE6vwz/YunfvXknSqFGjWp2Ljo6Wr6+vDh48qMbGxmuaM3r06BZjAAAAgBudS7bTOKKsrEySFB4e3uqcp6enQkNDdezYMVVUVCgiIuKqc3r37i0/Pz9VVVWpvr5evr6+7a4tOLhHu+e6k6l1dxT60z70zXH0zHH0rH3om+PomePoWft0VN86fCW+trZWktSjR9s36O/vL0k6f/68w3NqampcVicAAADQWXX4Svy1upb99c1sNpvDc9py6pSZbwJMrft6a34nTH8cQ98cR88cR8/ah745jp45jp61j6N9c3bFvsNX4q+2at7WqvvV5ly4cKHFOAAAAOBG1uEhvn///pKk8vLyVucuXbqkyspKeXp6Kiws7JrmVFdXq66uTn369HFqPzwAAABgig4P8TExMZKkgoKCVueKiopUX1+vqKgoeXt7X9Oc3bt3txgDAAAA3Og6PMRPmDBBQUFB2rFjh44cOWI/3tDQoPT0dEnS9OnTW8xJTEyUt7e3Nm/erMrKSvvx77//XuvXr5ckTZs2rQOqBwAAANzPJR9szc3NVW5uriTp1KlTkqTPPvtMKSkpkqSgoCAtXrxY0o/71lNTU7VgwQLNmjVL8fHxCggIUF5ensrKyjR+/HjFx8e3uH5YWJgWLVqk1NRUJSUlKT4+Xl5eXsrJyVFVVZXmzJnDt7UCAADgpuGSEP/FF1/o3XffbXGsoqJCFRUVkqSQkBB7iJekuLg4bdy4UevWrdPOnTvV0NCgfv36acmSJbJYLG0+ZcZisSgkJERWq1Xbt2+XzWZTRESEkpOTlZCQ4IrbAAAAAIzgkhA/f/58zZ8/36E5w4YN0xtvvOHQnNjYWMXGxjo0BwAAALjRdPieeAAAAADOIcQDAAAAhiHEAwAAAIYhxAMAAACGIcQDAAAAhiHEAwAAAIYhxAMAAACGcclz4uFec17Ka/dcawrP3QcAADANK/EAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGE83V0A3GvOS3ntnmtNiXVhJQAAALhWhHi0G28AAAAA3IPtNAAAAIBhjFqJr6qqUnp6ugoKCnTu3Dn17t1bY8eO1VNPPaWAgAB3lwcAAAB0CGNC/DfffKNp06bpzJkzGjt2rAYMGKDDhw8rMzNTBQUF2rJli4KCgtxdJgAAAHDdGRPi/+3f/k1nzpzR0qVLZbFY7MfT0tK0YcMGvfLKK3rhhRfcWCEAAADQMYzYE19RUaHCwkKFhIRo5syZLc7Nnz9ffn5++tOf/qS6ujo3VQgAAAB0HCNW4vfu3StJGjlypLp0afm+w9/fX/fcc48KCwt16NAhjRgxwh0lwkHOPNnGWc48GcdddfM0H8c4++/JxH7ztCgAuLkYEeK//vprSVJ4eHib5/v166fCwkKVlZU5FeKDg3u0ey7M4c43EO3l7O/mw//ynosqccz7qx5xy891Vnv7beq/J3f+3cffu+1D3xxHzxznSM+c/fvLmdcLZ3729Xid6qjfNSNCfG1trSSpR4+2m9J8vKampsNqciVTgw7McbP9jpl6v6bWDQDu/PvrZv2704g98Vdjs9kkSR4eHm6uBAAAALj+jAjx/v7+kq680t68Ut88DgAAALiRGRHiBwwYIEkqLy9v8/zx48clSf379++okgAAAAC3MSLE33fffZKkwsJCNTU1tThXW1ur4uJidevWTXfffbc7ygMAAAA6lBEhvm/fvho5cqROnDihzZs3tzi3evVq1dXV6ZFHHpGfn5+bKgQAAAA6joet+VOhndw333yjadOm6cyZMxo7dqwiIiJ06NAh7du3T+Hh4dq6dauCgoLcXSYAAABw3RkT4iXp5MmTysjIUEFBgc6dO6fg4GCNHTtWTz31lAIDA91dHgAAANAhjArxAAAAAAzZEw8AAADgrwjxAAAAgGEI8QAAAIBhCPEAAACAYQjxAAAAgGEI8QAAAIBhPN1dAH5eVVWV0tPT7c/G7927t/3Z+AEBAe4ur1P57rvvlJubq127dqm0tFTffvutvLy8FBkZqcTERCUlJalLF963Xovt27dr8eLFkqTU1FRNnTrVzRV1XgcOHNBbb72lgwcP6ty5cwoMDFRkZKRmz56tMWPGuLu8TmfXrl3KzMzUl19+af++j8GDB+vxxx9XVFSUu8tzm+zsbBUVFemLL77Q0aNHdeHCBT388MNauXLlFecUFxdr7dq1OnTokBoaGtS3b18lJSXJYrGoa9euHVi9+zjSt/Lycu3cuVOFhYU6fvy4zpw5o1tuuUV33323Zs+erZiYGDfcQcdrz+/aT/3ud79TVlaWJGnnzp3q16/f9Sy3U2hPz2w2m7Zv365t27bpf//3f/XDDz+oV69eGjJkiJKTk9W/f3+n6yLEd2J/+y21AwYM0OHDh5WZmamCggJt2bKFb6n9iezsbD3//PMKDg7WfffdpzvuuEOnT5/WRx99pKVLl6qgoEDp6eny8PBwd6md2smTJ5Wamio/Pz/V1dW5u5xO7bXXXlN6erqCgoL0wAMPKDg4WN99951KSkq0b98+QvzfePnll/XHP/5RgYGBiouLU1BQkL755hvl5eVp586dWrFihR555BF3l+kWa9eu1dGjR+Xn56c+ffro66+//tnxubm5WrBggXx8fDRx4kQFBAQoPz9faWlpKi4uVkZGRgdV7l6O9C09PV0ffvihBg4cqDFjxiggIEBlZWXKy8tTXl6efv/732vWrFkdWL17OPq79lN5eXnKysq66V4fHO1ZQ0ODFi5cqPz8fPXv318PPfSQunfvrurqah04cEDl5eUuCfGyodOaM2eOLTIy0paZmdni+L//+7/bIiMjbcuWLXNTZZ3TX/7yF9uf//xn2+XLl1scr66uto0ZM8YWGRlpy87OdlN1ZmhqarLNnj3bNnbsWNtLL71ki4yMtL3zzjvuLqtT+vDDD22RkZG23/72t7aamppW5xsbG91QVedVXV1tu/POO23333+/7fTp0y3OffLJJ7bIyEhbbGysm6pzv08++cRWVlZma2pqsu3du9cWGRlp+5d/+Zc2x9bU1NhiYmJsgwcPth0+fNh+/IcffrA9+uijtsjISNsHH3zQUaW7lSN9y8rKsv3P//xPq+P79u2zDR482DZ48GDbt99+e71LdjtHevZTZ86csd1///225ORk22OPPWaLjIy0lZeXd0DF7udoz55//nlbZGSkbdWqVa0yic3mutcH9hZ0UhUVFSosLFRISIhmzpzZ4tz8+fPl5+enP/3pTzfVO+GrGTFihGJjY1ttmQkODta0adMkSfv373dHacbIzMzU3r17lZaWJj8/P3eX02k1NTVp5cqV8vX11apVq+Tv799qjJeXlxsq67z+7//+T01NTRo6dKhuvfXWFudiYmLUvXt3nT171k3VuV9MTIzCw8Ov6b8UZmdn6+zZs5o0aZKGDBliP+7j46OFCxdKkrZs2XLdau1MHOlbYmKi/u7v/q7V8eHDh2v48OG6ePGiDh48eD3K7FQc6dlPLVu2TJL0r//6r9ejrE7NkZ5988032rp1q4YMGaKnn366zW28rnp9YDtNJ7V3715J0siRI1v9Avj7++uee+5RYWGhDh06pBEjRrijRKN4ev74q36z7BNtj6+++kqrVq3SrFmzFB0dbf8dRGvFxcWqrKzU+PHjdcstt9g/h+Hj46OhQ4fe1Hu7r6Rfv37y8vLSkSNHdPbsWfXs2dN+rqioSBcuXFBcXJwbKzRH85/NUaNGtToXHR0tX19fHTx4UI2NjfL29u7o8ozEa8TP27Ztm3Jzc7VmzRq28V7FBx98oKamJiUkJKi2tlZ5eXmqqqpSYGCgYmJiXPoZAkJ8J9W83yo8PLzN8/369VNhYaHKysoI8Vdx6dIlvffee5LaftHDjz167rnndPvtt+uZZ55xdzmd3ueffy5J6tWrlxISElRaWtrifHR0tDIyMloE1ZtdYGCgnn32Wb300kuaNGmS4uLiFBgYaN8T/6tf/UovvPCCu8s0QllZmaS2Xx88PT0VGhqqY8eOqaKiQhERER1cnXlOnDihTz75RL6+voqOjnZ3OZ3OiRMn9OKLL2ry5Mm80b4GR44ckSTV1NQoLi5O586ds5/z8PDQ9OnTtXTpUpe8YWQ7TSdVW1srSerRo0eb55uP19TUdFhNplq1apVKS0s1ZswYQvwVrFmzRl988YVeeukldevWzd3ldHpnzpyRJG3dulUNDQ3asGGDiouL9cEHH2jkyJEqKiqyb2vAX/32t7/Vq6++qsuXL+udd97R66+/ruzsbN1+++1KSEhotc0Gbbva60Pz9q7z5893WE2mamxs1LPPPqvGxkae+taGpqYmpaSkyM/PT0uXLnV3OUZo3haYkZGhv//7v9f777+v4uJibdiwQX379tXbb7+t1157zSU/ixBvKJvNJkk8aeUqMjMzZbVaNWDAAP3hD39wdzmd0uHDh7V+/fqb/hF/jrh8+bKkH/8cZmRkaMSIEerevbt+8YtfaM2aNerTp4/2799/U+yvdcQbb7yhBQsWKCEhQbm5ufrss8+0bds2hYWF6dlnn+XPqIvx+vDzLl++rOeee07FxcWKj4/XE0884e6SOp0NGzZo//79Sk1N5Q3ONWp+fQgODtaaNWsUGRmp7t27a8SIEcrIyFCXLl305ptvqrGx0emfRYjvpJpXUq600t68EtPWB+rwo82bN+vFF1/UwIEDlZmZqcDAQHeX1Ok0b6MJDw9XcnKyu8sxRvOLWVhYmO68884W57p166aRI0dK+vENEn60b98+rVy5UrGxsVqyZInCwsLk6+urwYMH69VXX9Vtt92mN998UxUVFe4utdO71teHK63U468BPjs7WxMnTtTLL7/Mm56/UV5erldeeUWJiYk8LtcBza8Po0aNavVftu+8806FhobqwoULDj3a80oI8Z3UgAEDJP34h6gtx48flyTXPGf0BrRhwwa98MILioyMVGZmpoKDg91dUqdUV1en8vJyffXVVxoyZIgGDRpk/9+rr74qSVq6dKkGDRqkF1980c3Vdh7Nf+6uFJJuueUWST8+Kxg/2rVrlyTpvvvua3XO19dXQ4cOVVNTk0pKSjq4MvM0//619fpw6dIlVVZWytPTU2FhYR1cmRkuXbqkZ555Rjt27NBDDz2kVatW2T/Yir/68ssv1djYqG3btrV4bRg0aJD9SW/jxo3ToEGDlJub6+ZqO49rfX344YcfnP5Z/NZ2Us0vdIWFhWpqamrxhJra2loVFxerW7duuvvuu91VYqf1+uuva9WqVbrrrrtktVr5cOHP8Pb21pQpU9o8V1JSopKSEg0bNkz9+/dnq81P3HvvvfL09NTx48fbfALIsWPHJEkhISHuKK9Tav5Px1d6jGTzcR7NeXUxMTF6//33VVBQoIceeqjFuaKiItXX1ys6Opon07ShsbFRycnJ+vOf/6zf/OY3SktL45u8ryAkJOSKrw8ff/yxTp06pQkTJsjf35+/634iJiZGGzdutL8O/FRjY6N9EdYVPSPEd1J9+/bVyJEjVVhYqM2bN8tisdjPrV69WnV1dXr00Ud5lvffWLNmjTIyMjR48GBZrVa20FxFt27drrjCvnr1apWUlCghIUFTp07t4Mo6t549e2rixIl6//33tWbNGj399NP2c3v27FFhYaF69OjBB6l/YtiwYdq0aZPeeecdTZs2Tbfddpv93Mcff6zi4mL5+PjwZvEaTJgwQStXrtSOHTv02GOP2Z8V39DQoPT0dEnS9OnT3Vlip9T84dWPP/5YU6ZM0fLlywnwP+Ouu+664uuDxWLRqVOn9Mwzz7j0kYk3gtGjRyssLEyFhYXas2ePfvWrX9nPrVmzRjU1NRo+fLhLdgh42Jo/IYlO55tvvtG0adN05swZjR07VhERETp06JD27dun8PBwbd26lee1/sS7776rlJQUde3aVY899lib/ykrJCREiYmJbqjOPKtXr9arr76q1NRUQnwbzpw5o+nTp+v48eO69957NXToUJ04cUK5ubny8PDQypUrNXHiRHeX2Wk0NTXpiSee0F/+8hd1795dDz74oHr16qWvvvpKu3btks1m0+9+9zvNnj3b3aW6RW5urn1LwqlTp1RYWKiwsDDde++9kqSgoCAtXry4xfgFCxbIx8dH8fHxCggIUF5ensrKyjR+/Hilp6ffFHu8HenbkiVLtG3bNgUFBWnGjBlt9mf48OFtbvm6kTj6u9YWi8Wi/fv3a+fOnTdFiHe0ZwcOHNATTzyhixcvKi4uTiEhITpy5IiKiorUs2dPvf322y7ZDk2I7+ROnjypjIwMFRQU6Ny5cwoODtbYsWP11FNPscr8N5pD588ZPny4Nm7c2EEVmY0Qf3Xnzp3T2rVr9dFHH6m6ulrdu3fXPffco7lz5+qXv/ylu8vrdC5evKjNmzfrww8/1JdffqkffvhBAQEBGjp0qCwWi/0DwTejq/39FRISory8vBbHPv30U61bt06fffaZGhoa1K9fPyUlJclisdw0X1rkSN+ag+fPeeqppzR//nyX1tjZtOd37W/dbCG+PT378ssv9eqrr2rfvn2qqanRrbfeqjFjxuif//mf1adPH5fURYgHAAAADMNmMAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMIR4AAAAwDCEeAAAAMAwhHgAAADAMP8fzdeuZgeLZngAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<Figure size 864x576 with 1 Axes>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "rare_scores.hist(bins=40)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 126,
   "metadata": {},
   "outputs": [],
   "source": [
    "unique_practices['rare_scores'] = rare_scores\n",
    "\n",
    "rare_scripts = (unique_practices\n",
    " .sort_values('rare_scores', ascending=False)\n",
    " .reset_index()\n",
    " .loc[:, ['code', 'name', 'rare_scores']]\n",
    " .head(100))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 127,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>code</th>\n",
       "      <th>name</th>\n",
       "      <th>rare_scores</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>Y03472</td>\n",
       "      <td>CONSULTANT DIABETES TEAM</td>\n",
       "      <td>15.488407</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>Y05320</td>\n",
       "      <td>DMC COMMUNITY DERMATOLOGY RBWF</td>\n",
       "      <td>14.408360</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>Y04404</td>\n",
       "      <td>OUTPATIENTS JUBILEE HEALTH CENTRE</td>\n",
       "      <td>7.183052</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>Y03484</td>\n",
       "      <td>DMC COMMUNITY DERMATOLOGY CLINIC</td>\n",
       "      <td>6.940271</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>Y04424</td>\n",
       "      <td>DMC HEALTHCARE</td>\n",
       "      <td>6.513022</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "     code                               name  rare_scores\n",
       "0  Y03472           CONSULTANT DIABETES TEAM    15.488407\n",
       "1  Y05320     DMC COMMUNITY DERMATOLOGY RBWF    14.408360\n",
       "2  Y04404  OUTPATIENTS JUBILEE HEALTH CENTRE     7.183052\n",
       "3  Y03484   DMC COMMUNITY DERMATOLOGY CLINIC     6.940271\n",
       "4  Y04424                     DMC HEALTHCARE     6.513022"
      ]
     },
     "execution_count": 127,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "rare_scripts.head()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 121,
   "metadata": {},
   "outputs": [],
   "source": [
    "#rare_scripts = [(\"Y03472\", \"CONSULTANT DIABETES TEAM\", 16.2626871247)] * 100"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 128,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "==================\n",
      "Your score:  1.0\n",
      "==================\n"
     ]
    }
   ],
   "source": [
    "grader.score.dw__rare_scripts(rare_scripts)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Copyright &copy; 2020 The Data Incubator.  All rights reserved.*"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.9.0"
  },
  "nbclean": true
 },
 "nbformat": 4,
 "nbformat_minor": 1
}