IBM-DS0321EN-SkillsNetwork_labs_module_4_SpaceX_Ma.ipynb

{"metadata": {"language_info": {"codemirror_mode": {"name": "python", "version": 3}, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8"}, "kernelspec": {"name": "python", "display_name": "Pyolite", "language": "python"}}, "nbformat_minor": 5, "nbformat": 4, "cells": [{"cell_type": "markdown", "source": "<p style=\"text-align:center\">\n    <a href=\"https://skills.network/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork26802033-2022-01-01\" target=\"_blank\">\n    <img src=\"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/assets/logos/SN_web_lightmode.png\" width=\"200\" alt=\"Skills Network Logo\"  />\n    </a>\n</p>\n", "metadata": {}, "id": "41092b48-3d26-4826-9516-ccaea45f5040"}, {"cell_type": "markdown", "source": "# **Space X  Falcon 9 First Stage Landing Prediction**\n", "metadata": {}, "id": "a7b195fb-7957-4e70-9739-a26fc8eb95bb"}, {"cell_type": "markdown", "source": "## Assignment:  Machine Learning Prediction\n", "metadata": {}, "id": "3b088492-0aa6-4e07-a816-0b74dbc58203"}, {"cell_type": "markdown", "source": "Estimated time needed: **60** minutes\n", "metadata": {}, "id": "19c6c99b-e968-4d6e-a07a-38307d36ed2b"}, {"cell_type": "markdown", "source": "Space X advertises Falcon 9 rocket launches on its website with a cost of 62 million dollars; other providers cost upward of 165 million dollars each, much of the savings is because Space X can reuse the first stage. Therefore if we can determine if the first stage will land, we can determine the cost of a launch. This information can be used if an alternate company wants to bid against space X for a rocket launch.   In this lab, you will create a machine learning pipeline  to predict if the first stage will land given the data from the preceding labs.\n", "metadata": {}, "id": "a4bec0cd-b2fe-48ff-8a60-44d57af5473c"}, {"cell_type": "markdown", "source": "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/landing_1.gif)\n", "metadata": {}, "id": "9b9e79e6-8497-49ce-b2e1-e914bf87726c"}, {"cell_type": "markdown", "source": "Several examples of an unsuccessful landing are shown here:\n", "metadata": {}, "id": "0fc39343-e511-4f02-aaaa-930eb60428d7"}, {"cell_type": "markdown", "source": "![](https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBMDeveloperSkillsNetwork-DS0701EN-SkillsNetwork/api/Images/crash.gif)\n", "metadata": {}, "id": "d8f06dd0-f33f-4d53-9a20-580a42011408"}, {"cell_type": "markdown", "source": "Most unsuccessful landings are planed. Space X; performs a controlled landing in the oceans.\n", "metadata": {}, "id": "ef614108-fd8d-4344-948a-39d131d671df"}, {"cell_type": "markdown", "source": "## Objectives\n", "metadata": {}, "id": "21c1b9fb-9eed-461b-8c77-5c0950a00e6f"}, {"cell_type": "markdown", "source": "Perform exploratory  Data Analysis and determine Training Labels\n\n*   create a column for the class\n*   Standardize the data\n*   Split into training data and test data\n\n\\-Find best Hyperparameter for SVM, Classification Trees and Logistic Regression\n\n*   Find the method performs best using test data\n", "metadata": {}, "id": "25fe0855-ff49-4adb-8954-6c46fab06877"}, {"cell_type": "markdown", "source": "## Import Libraries and Define Auxiliary Functions\n", "metadata": {}, "id": "28d653b1-3b9a-429e-80e0-02bd16de722e"}, {"cell_type": "code", "source": "import piplite\nawait piplite.install(['numpy'])\nawait piplite.install(['pandas'])\nawait piplite.install(['seaborn'])", "metadata": {}, "execution_count": 1, "outputs": [], "id": "4818736e-9044-4cbe-9367-8b21b0246077"}, {"cell_type": "markdown", "source": "We will import the following libraries for the lab\n", "metadata": {}, "id": "e3bd986c-7b04-48d7-bdbe-1e3067039e5f"}, {"cell_type": "code", "source": "# Pandas is a software library written for the Python programming language for data manipulation and analysis.\nimport pandas as pd\n# NumPy is a library for the Python programming language, adding support for large, multi-dimensional arrays and matrices, along with a large collection of high-level mathematical functions to operate on these arrays\nimport numpy as np\n# Matplotlib is a plotting library for python and pyplot gives us a MatLab like plotting framework. We will use this in our plotter function to plot data.\nimport matplotlib.pyplot as plt\n#Seaborn is a Python data visualization library based on matplotlib. It provides a high-level interface for drawing attractive and informative statistical graphics\nimport seaborn as sns\n# Preprocessing allows us to standarsize our data\nfrom sklearn import preprocessing\n# Allows us to split our data into training and testing data\nfrom sklearn.model_selection import train_test_split\n# Allows us to test parameters of classification algorithms and find the best one\nfrom sklearn.model_selection import GridSearchCV\n# Logistic Regression classification algorithm\nfrom sklearn.linear_model import LogisticRegression\n# Support Vector Machine classification algorithm\nfrom sklearn.svm import SVC\n# Decision Tree classification algorithm\nfrom sklearn.tree import DecisionTreeClassifier\n# K Nearest Neighbors classification algorithm\nfrom sklearn.neighbors import KNeighborsClassifier", "metadata": {}, "execution_count": 2, "outputs": [], "id": "8513bd32-b465-4ded-8bd1-75315990d233"}, {"cell_type": "markdown", "source": "This function is to plot the confusion matrix.\n", "metadata": {}, "id": "2a2bf13b-19b1-43d6-a2cd-d2f20bd69fb5"}, {"cell_type": "code", "source": "def plot_confusion_matrix(y,y_predict):\n    \"this function plots the confusion matrix\"\n    from sklearn.metrics import confusion_matrix\n\n    cm = confusion_matrix(y, y_predict)\n    ax= plt.subplot()\n    sns.heatmap(cm, annot=True, ax = ax); #annot=True to annotate cells\n    ax.set_xlabel('Predicted labels')\n    ax.set_ylabel('True labels')\n    ax.set_title('Confusion Matrix'); \n    ax.xaxis.set_ticklabels(['did not land', 'land']); ax.yaxis.set_ticklabels(['did not land', 'landed']) \n    plt.show() ", "metadata": {}, "execution_count": 3, "outputs": [], "id": "1f30279e-9d5e-4df5-a814-8053d099c511"}, {"cell_type": "markdown", "source": "## Load the dataframe\n", "metadata": {}, "id": "c0abf51b-e8f8-4fa5-8275-1205554ba883"}, {"cell_type": "markdown", "source": "Load the data\n", "metadata": {}, "id": "e6b453e1-b094-4508-a4e1-5159ee52d46e"}, {"cell_type": "code", "source": "from js import fetch\nimport io\n\nURL1 = \"https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_2.csv\"\nresp1 = await fetch(URL1)\ntext1 = io.BytesIO((await resp1.arrayBuffer()).to_py())\ndata = pd.read_csv(text1)", "metadata": {}, "execution_count": 4, "outputs": [], "id": "303c7783-faac-4ca0-98a5-df6c89c65df4"}, {"cell_type": "code", "source": "data.head()", "metadata": {}, "execution_count": 5, "outputs": [{"execution_count": 5, "output_type": "execute_result", "data": {"text/plain": "   FlightNumber        Date BoosterVersion  PayloadMass Orbit    LaunchSite  \\\n0             1  2010-06-04       Falcon 9  6104.959412   LEO  CCAFS SLC 40   \n1             2  2012-05-22       Falcon 9   525.000000   LEO  CCAFS SLC 40   \n2             3  2013-03-01       Falcon 9   677.000000   ISS  CCAFS SLC 40   \n3             4  2013-09-29       Falcon 9   500.000000    PO   VAFB SLC 4E   \n4             5  2013-12-03       Falcon 9  3170.000000   GTO  CCAFS SLC 40   \n\n       Outcome  Flights  GridFins  Reused   Legs LandingPad  Block  \\\n0    None None        1     False   False  False        NaN    1.0   \n1    None None        1     False   False  False        NaN    1.0   \n2    None None        1     False   False  False        NaN    1.0   \n3  False Ocean        1     False   False  False        NaN    1.0   \n4    None None        1     False   False  False        NaN    1.0   \n\n   ReusedCount Serial   Longitude   Latitude  Class  \n0            0  B0003  -80.577366  28.561857      0  \n1            0  B0005  -80.577366  28.561857      0  \n2            0  B0007  -80.577366  28.561857      0  \n3            0  B1003 -120.610829  34.632093      0  \n4            0  B1004  -80.577366  28.561857      0  ", "text/html": "<div>\n<style scoped>\n    .dataframe tbody tr th:only-of-type {\n        vertical-align: middle;\n    }\n\n    .dataframe tbody tr th {\n        vertical-align: top;\n    }\n\n    .dataframe thead th {\n        text-align: right;\n    }\n</style>\n<table border=\"1\" class=\"dataframe\">\n  <thead>\n    <tr style=\"text-align: right;\">\n      <th></th>\n      <th>FlightNumber</th>\n      <th>Date</th>\n      <th>BoosterVersion</th>\n      <th>PayloadMass</th>\n      <th>Orbit</th>\n      <th>LaunchSite</th>\n      <th>Outcome</th>\n      <th>Flights</th>\n      <th>GridFins</th>\n      <th>Reused</th>\n      <th>Legs</th>\n      <th>LandingPad</th>\n      <th>Block</th>\n      <th>ReusedCount</th>\n      <th>Serial</th>\n      <th>Longitude</th>\n      <th>Latitude</th>\n      <th>Class</th>\n    </tr>\n  </thead>\n  <tbody>\n    <tr>\n      <th>0</th>\n      <td>1</td>\n      <td>2010-06-04</td>\n      <td>Falcon 9</td>\n      <td>6104.959412</td>\n      <td>LEO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0003</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>1</th>\n      <td>2</td>\n      <td>2012-05-22</td>\n      <td>Falcon 9</td>\n      <td>525.000000</td>\n      <td>LEO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0005</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>2</th>\n      <td>3</td>\n      <td>2013-03-01</td>\n      <td>Falcon 9</td>\n      <td>677.000000</td>\n      <td>ISS</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B0007</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>3</th>\n      <td>4</td>\n      <td>2013-09-29</td>\n      <td>Falcon 9</td>\n      <td>500.000000</td>\n      <td>PO</td>\n      <td>VAFB SLC 4E</td>\n      <td>False Ocean</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B1003</td>\n      <td>-120.610829</td>\n      <td>34.632093</td>\n      <td>0</td>\n    </tr>\n    <tr>\n      <th>4</th>\n      <td>5</td>\n      <td>2013-12-03</td>\n      <td>Falcon 9</td>\n      <td>3170.000000</td>\n      <td>GTO</td>\n      <td>CCAFS SLC 40</td>\n      <td>None None</td>\n      <td>1</td>\n      <td>False</td>\n      <td>False</td>\n      <td>False</td>\n      <td>NaN</td>\n      <td>1.0</td>\n      <td>0</td>\n      <td>B1004</td>\n      <td>-80.577366</td>\n      <td>28.561857</td>\n      <td>0</td>\n    </tr>\n  </tbody>\n</table>\n</div>"}, "metadata": {}}], "id": "2bbe74d1-22a0-4164-a154-7b61fd30db7f"}, {"cell_type": "code", "source": "URL2 = 'https://cf-courses-data.s3.us.cloud-object-storage.appdomain.cloud/IBM-DS0321EN-SkillsNetwork/datasets/dataset_part_3.csv'\nresp2 = await fetch(URL2)\ntext2 = io.BytesIO((await resp2.arrayBuffer()).to_py())\nX = pd.read_csv(text2)", "metadata": {}, "execution_count": 6, "outputs": [], "id": "0ca7bbd2-ed4e-4eef-8f27-be9309caed78"}, {"cell_type": "code", "source": "X.head(100)", "metadata": {}, "execution_count": 7, "outputs": [{"execution_count": 7, "output_type": "execute_result", "data": {"text/plain": "    FlightNumber   PayloadMass  Flights  Block  ReusedCount  Orbit_ES-L1  \\\n0            1.0   6104.959412      1.0    1.0          0.0          0.0   \n1            2.0    525.000000      1.0    1.0          0.0          0.0   \n2            3.0    677.000000      1.0    1.0          0.0          0.0   \n3            4.0    500.000000      1.0    1.0          0.0          0.0   \n4            5.0   3170.000000      1.0    1.0          0.0          0.0   \n..           ...           ...      ...    ...          ...          ...   \n85          86.0  15400.000000      2.0    5.0          2.0          0.0   \n86          87.0  15400.000000      3.0    5.0          2.0          0.0   \n87          88.0  15400.000000      6.0    5.0          5.0          0.0   \n88          89.0  15400.000000      3.0    5.0          2.0          0.0   \n89          90.0   3681.000000      1.0    5.0          0.0          0.0   \n\n    Orbit_GEO  Orbit_GTO  Orbit_HEO  Orbit_ISS  ...  Serial_B1058  \\\n0         0.0        0.0        0.0        0.0  ...           0.0   \n1         0.0        0.0        0.0        0.0  ...           0.0   \n2         0.0        0.0        0.0        1.0  ...           0.0   \n3         0.0        0.0        0.0        0.0  ...           0.0   \n4         0.0        1.0        0.0        0.0  ...           0.0   \n..        ...        ...        ...        ...  ...           ...   \n85        0.0        0.0        0.0        0.0  ...           0.0   \n86        0.0        0.0        0.0        0.0  ...           1.0   \n87        0.0        0.0        0.0        0.0  ...           0.0   \n88        0.0        0.0        0.0        0.0  ...           0.0   \n89        0.0        0.0        0.0        0.0  ...           0.0   \n\n    Serial_B1059  Serial_B1060  Serial_B1062  GridFins_False  GridFins_True  \\\n0            0.0           0.0           0.0             1.0            0.0   \n1            0.0           0.0           0.0             1.0            0.0   \n2            0.0           0.0           0.0             1.0            0.0   \n3            0.0           0.0           0.0             1.0            0.0   \n4            0.0           0.0           0.0             1.0            0.0   \n..           ...           ...           ...             ...            ...   \n85           0.0           1.0           0.0             0.0            1.0   \n86           0.0           0.0           0.0             0.0            1.0   \n87           0.0           0.0           0.0             0.0            1.0   \n88           0.0           1.0           0.0             0.0            1.0   \n89           0.0           0.0           1.0             0.0            1.0   \n\n    Reused_False  Reused_True  Legs_False  Legs_True  \n0            1.0          0.0         1.0        0.0  \n1            1.0          0.0         1.0        0.0  \n2            1.0          0.0         1.0        0.0  \n3            1.0          0.0         1.0        0.0  \n4            1.0          0.0         1.0        0.0  \n..           ...          ...         ...        ...  \n85           0.0          1.0         0.0        1.0  \n86           0.0          1.0         0.0        1.0  \n87           0.0          1.0         0.0        1.0  \n88           0.0          1.0         0.0        1.0  \n89           1.0          0.0         0.0        1.0  \n\n[90 rows x 83 columns]", "text/html": "<div>\n<style scoped>\n    .dataframe tbody tr th:only-of-type {\n        vertical-align: middle;\n    }\n\n    .dataframe tbody tr th {\n        vertical-align: top;\n    }\n\n    .dataframe thead th {\n        text-align: right;\n    }\n</style>\n<table border=\"1\" class=\"dataframe\">\n  <thead>\n    <tr style=\"text-align: right;\">\n      <th></th>\n      <th>FlightNumber</th>\n      <th>PayloadMass</th>\n      <th>Flights</th>\n      <th>Block</th>\n      <th>ReusedCount</th>\n      <th>Orbit_ES-L1</th>\n      <th>Orbit_GEO</th>\n      <th>Orbit_GTO</th>\n      <th>Orbit_HEO</th>\n      <th>Orbit_ISS</th>\n      <th>...</th>\n      <th>Serial_B1058</th>\n      <th>Serial_B1059</th>\n      <th>Serial_B1060</th>\n      <th>Serial_B1062</th>\n      <th>GridFins_False</th>\n      <th>GridFins_True</th>\n      <th>Reused_False</th>\n      <th>Reused_True</th>\n      <th>Legs_False</th>\n      <th>Legs_True</th>\n    </tr>\n  </thead>\n  <tbody>\n    <tr>\n      <th>0</th>\n      <td>1.0</td>\n      <td>6104.959412</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>1</th>\n      <td>2.0</td>\n      <td>525.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>2</th>\n      <td>3.0</td>\n      <td>677.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>3</th>\n      <td>4.0</td>\n      <td>500.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>4</th>\n      <td>5.0</td>\n      <td>3170.000000</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n    </tr>\n    <tr>\n      <th>...</th>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n      <td>...</td>\n    </tr>\n    <tr>\n      <th>85</th>\n      <td>86.0</td>\n      <td>15400.000000</td>\n      <td>2.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>86</th>\n      <td>87.0</td>\n      <td>15400.000000</td>\n      <td>3.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>87</th>\n      <td>88.0</td>\n      <td>15400.000000</td>\n      <td>6.0</td>\n      <td>5.0</td>\n      <td>5.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>88</th>\n      <td>89.0</td>\n      <td>15400.000000</td>\n      <td>3.0</td>\n      <td>5.0</td>\n      <td>2.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n    <tr>\n      <th>89</th>\n      <td>90.0</td>\n      <td>3681.000000</td>\n      <td>1.0</td>\n      <td>5.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>...</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n      <td>1.0</td>\n      <td>0.0</td>\n      <td>0.0</td>\n      <td>1.0</td>\n    </tr>\n  </tbody>\n</table>\n<p>90 rows \u00d7 83 columns</p>\n</div>"}, "metadata": {}}], "id": "02af7a31-bf3d-431a-ae95-fd146cd09329"}, {"cell_type": "markdown", "source": "## TASK  1\n", "metadata": {}, "id": "5fc5aab8-54d4-49d9-aff6-0dd579baa44f"}, {"cell_type": "markdown", "source": "Create a NumPy array from the column <code>Class</code> in <code>data</code>, by applying the method <code>to_numpy()</code>  then\nassign it  to the variable <code>Y</code>,make sure the output is a  Pandas series (only one bracket df\\['name of  column']).\n", "metadata": {}, "id": "013d35ed-ebae-4e84-8c60-935e3a699346"}, {"cell_type": "code", "source": "Y=data['Class'].to_numpy()\nY", "metadata": {}, "execution_count": 8, "outputs": [{"execution_count": 8, "output_type": "execute_result", "data": {"text/plain": "array([0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 0, 1, 0, 0, 0, 1, 0, 0, 1, 1, 1,\n       1, 1, 0, 1, 1, 0, 1, 1, 0, 1, 1, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n       1, 0, 0, 0, 1, 1, 0, 0, 1, 1, 1, 1, 1, 1, 1, 0, 0, 1, 1, 1, 1, 1,\n       1, 0, 1, 1, 1, 1, 0, 1, 0, 1, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n       1, 1], dtype=int64)"}, "metadata": {}}], "id": "bc72dffc-1032-4a3a-b84f-d2968b3faffc"}, {"cell_type": "markdown", "source": "## TASK  2\n", "metadata": {}, "id": "4d79f1ca-2636-4221-895a-4afc091c73b0"}, {"cell_type": "markdown", "source": "Standardize the data in <code>X</code> then reassign it to the variable  <code>X</code> using the transform provided below.\n", "metadata": {}, "id": "324ed6d1-626f-4c23-bf84-efd98f797280"}, {"cell_type": "code", "source": "# students get this \ntransform = preprocessing.StandardScaler()\nX=transform.fit_transform(X)\nX", "metadata": {}, "execution_count": 9, "outputs": [{"execution_count": 9, "output_type": "execute_result", "data": {"text/plain": "array([[-1.71291154e+00, -1.94814463e-16, -6.53912840e-01, ...,\n        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n       [-1.67441914e+00, -1.19523159e+00, -6.53912840e-01, ...,\n        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n       [-1.63592675e+00, -1.16267307e+00, -6.53912840e-01, ...,\n        -8.35531692e-01,  1.93309133e+00, -1.93309133e+00],\n       ...,\n       [ 1.63592675e+00,  1.99100483e+00,  3.49060516e+00, ...,\n         1.19684269e+00, -5.17306132e-01,  5.17306132e-01],\n       [ 1.67441914e+00,  1.99100483e+00,  1.00389436e+00, ...,\n         1.19684269e+00, -5.17306132e-01,  5.17306132e-01],\n       [ 1.71291154e+00, -5.19213966e-01, -6.53912840e-01, ...,\n        -8.35531692e-01, -5.17306132e-01,  5.17306132e-01]])"}, "metadata": {}}], "id": "9067e374-f502-44c6-a628-29186009fd45"}, {"cell_type": "markdown", "source": "We split the data into training and testing data using the  function  <code>train_test_split</code>.   The training data is divided into validation data, a second set used for training  data; then the models are trained and hyperparameters are selected using the function <code>GridSearchCV</code>.\n", "metadata": {}, "id": "a6f007c0-65fe-408a-9af6-febef40b1e1b"}, {"cell_type": "markdown", "source": "## TASK  3\n", "metadata": {}, "id": "c4a2cfde-e37a-475f-95ad-95246535ff18"}, {"cell_type": "markdown", "source": "Use the function train_test_split to split the data X and Y into training and test data. Set the parameter test_size to  0.2 and random_state to 2. The training data and test data should be assigned to the following labels.\n", "metadata": {}, "id": "3b2ff7f9-f969-4ba2-a2bd-17f0b7d6464e"}, {"cell_type": "markdown", "source": "<code>X_train, X_test, Y_train, Y_test</code>\n", "metadata": {}, "id": "5da81a62-3998-436c-b96e-9e7a1db0825f"}, {"cell_type": "code", "source": "X_train,X_test,Y_train,Y_test=train_test_split(X,Y,test_size=0.2,random_state=2)", "metadata": {}, "execution_count": 10, "outputs": [], "id": "bef9d582-2c05-4a6f-ac6a-125766d093c7"}, {"cell_type": "markdown", "source": "we can see we only have 18 test samples.\n", "metadata": {}, "id": "e81b772b-0a2e-4f30-a774-8bff2b8fe8b0"}, {"cell_type": "code", "source": "Y_test.shape", "metadata": {}, "execution_count": 11, "outputs": [{"execution_count": 11, "output_type": "execute_result", "data": {"text/plain": "(18,)"}, "metadata": {}}], "id": "77d6496a-d933-420f-9352-1c95a832b84d"}, {"cell_type": "markdown", "source": "## TASK  4\n", "metadata": {}, "id": "1e778d63-eec7-4bf8-a83e-3397997026fa"}, {"cell_type": "markdown", "source": "Create a logistic regression object  then create a  GridSearchCV object  <code>logreg_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n", "metadata": {}, "id": "06a7589e-a488-431b-b329-c78ea814f020"}, {"cell_type": "code", "source": "parameters ={'C':[0.01,0.1,1],\n             'penalty':['l2'],\n             'solver':['lbfgs']}", "metadata": {}, "execution_count": null, "outputs": [], "id": "93fd1432-7426-4005-8dfe-04380700d42d"}, {"cell_type": "code", "source": "parameters ={\"C\":[0.01,0.1,1],'penalty':['l2'], 'solver':['lbfgs']}# l1 lasso l2 ridge\nlr=LogisticRegression()\nlogreg_cv=GridSearchCV(lr,parameters,cv=10)\nlogreg_cv.fit(X_train,Y_train)", "metadata": {}, "execution_count": 21, "outputs": [{"execution_count": 21, "output_type": "execute_result", "data": {"text/plain": "GridSearchCV(cv=10, estimator=LogisticRegression(),\n             param_grid={'C': [0.01, 0.1, 1], 'penalty': ['l2'],\n                         'solver': ['lbfgs']})"}, "metadata": {}}], "id": "de49af42-d4af-4f3b-bbbb-3b7cc6793c21"}, {"cell_type": "markdown", "source": "We output the <code>GridSearchCV</code> object for logistic regression. We display the best parameters using the data attribute <code>best_params\\_</code> and the accuracy on the validation data using the data attribute <code>best_score\\_</code>.\n", "metadata": {}, "id": "a75d5bed-04e0-447a-a14a-eb0229e8da9e"}, {"cell_type": "code", "source": "print(\"tuned hpyerparameters :(best parameters) \",logreg_cv.best_params_)\nprint(\"accuracy :\",logreg_cv.best_score_)", "metadata": {}, "execution_count": 15, "outputs": [{"name": "stdout", "text": "tuned hpyerparameters :(best parameters)  {'C': 0.01, 'penalty': 'l2', 'solver': 'lbfgs'}\naccuracy : 0.8464285714285713\n", "output_type": "stream"}], "id": "8dfcfcaf-4c12-44f5-b7e4-3d00e56313dc"}, {"cell_type": "markdown", "source": "## TASK  5\n", "metadata": {}, "id": "5df3f620-3e95-406d-b01d-667801f1d09d"}, {"cell_type": "markdown", "source": "Calculate the accuracy on the test data using the method <code>score</code>:\n", "metadata": {}, "id": "8890f2b5-9f2a-478b-8772-078b2e55483d"}, {"cell_type": "code", "source": "print('Accuracy on test data is:{:.3f}'.format(logreg_cv.score(X_test, Y_test)))", "metadata": {}, "execution_count": 17, "outputs": [{"name": "stdout", "text": "Accuracy on test data is:0.833\n", "output_type": "stream"}], "id": "ecd83d0e-92bc-4c73-b6e7-a355725cc4ac"}, {"cell_type": "markdown", "source": "Lets look at the confusion matrix:\n", "metadata": {}, "id": "ef7d820b-6494-448b-99da-ddee09fac04b"}, {"cell_type": "code", "source": "yhat=logreg_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)", "metadata": {}, "execution_count": 18, "outputs": [{"output_type": "display_data", "data": {"text/plain": "<pyolite.display.Image at 0x595ffb0>", "image/png": "iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/YYfK9AAAACXBIWXMAAA9hAAAPYQGoP6dpAABHB0lEQVR4nO3dd3gU5f7+8XsDZBNCGj1BSihiIlUQDtIPCKIgRaV6DE2PggKGJkeRBNAoSBEUEJQi4sFCEwtKFT0g0gJIkxKKdEFAWoDs/P7wx35dAzKQTWaz8355zXWxz06e+WwuV2+eMuMwDMMQAAAAbCPA6gIAAACQvQiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABPzArl271KRJE4WHh8vhcGj+/Ple7X/fvn1yOByaPn26V/vNyRo0aKAGDRpYXQYA3BYCIOAle/bs0b///W+VLl1aQUFBCgsLU+3atfXmm2/q4sWLWXrt+Ph4bdmyRa+88opmzpyp6tWrZ+n1slPnzp3lcDgUFhZ23d/jrl275HA45HA49MYbb9xy/4cPH1ZiYqJSUlK8UC0A5Ay5rS4A8AdffPGFHnvsMTmdTj3xxBOqUKGCLl++rO+//179+/fX1q1bNXny5Cy59sWLF7V69Wq9+OKLevbZZ7PkGiVLltTFixeVJ0+eLOn/ZnLnzq0LFy5o4cKFatu2rcd7s2bNUlBQkC5dunRbfR8+fFhJSUkqVaqUqlSpYvrnvvnmm9u6HgD4AgIgkEmpqalq3769SpYsqWXLlikqKsr9Xs+ePbV792598cUXWXb9EydOSJIiIiKy7BoOh0NBQUFZ1v/NOJ1O1a5dW//9738zBMAPP/xQDz30kObMmZMttVy4cEF58+ZVYGBgtlwPALICU8BAJo0YMULnzp3Te++95xH+rilbtqx69+7tfn316lUNGzZMZcqUkdPpVKlSpfSf//xHaWlpHj9XqlQpNW/eXN9//71q1KihoKAglS5dWu+//777nMTERJUsWVKS1L9/fzkcDpUqVUrSH1On1/78Z4mJiXI4HB5tixcvVp06dRQREaF8+fKpfPny+s9//uN+/0ZrAJctW6a6desqJCREERERatmypbZv337d6+3evVudO3dWRESEwsPD1aVLF124cOHGv9i/6Nixo7766iudPn3a3bZ27Vrt2rVLHTt2zHD+qVOn1K9fP1WsWFH58uVTWFiYmjVrpk2bNrnPWbFihe69915JUpcuXdxTydc+Z4MGDVShQgWtX79e9erVU968ed2/l7+uAYyPj1dQUFCGz9+0aVNFRkbq8OHDpj8rAGQ1AiCQSQsXLlTp0qV13333mTq/e/fuevnll3XPPfdozJgxql+/vpKTk9W+ffsM5+7evVuPPvqo7r//fo0aNUqRkZHq3Lmztm7dKklq06aNxowZI0nq0KGDZs6cqbFjx95S/Vu3blXz5s2VlpamoUOHatSoUXr44Yf1v//9729/bsmSJWratKmOHz+uxMREJSQkaNWqVapdu7b27duX4fy2bdvq999/V3Jystq2bavp06crKSnJdJ1t2rSRw+HQ3Llz3W0ffvih7rrrLt1zzz0Zzt+7d6/mz5+v5s2ba/To0erfv7+2bNmi+vXru8NYbGyshg4dKkl66qmnNHPmTM2cOVP16tVz93Py5Ek1a9ZMVapU0dixY9WwYcPr1vfmm2+qUKFCio+PV3p6uiTpnXfe0TfffKPx48crOjra9GcFgCxnALhtZ86cMSQZLVu2NHV+SkqKIcno3r27R3u/fv0MScayZcvcbSVLljQkGStXrnS3HT9+3HA6nUbfvn3dbampqYYkY+TIkR59xsfHGyVLlsxQw5AhQ4w/f/XHjBljSDJOnDhxw7qvXWPatGnutipVqhiFCxc2Tp486W7btGmTERAQYDzxxBMZrte1a1ePPlu3bm0UKFDghtf88+cICQkxDMMwHn30UaNRo0aGYRhGenq6UbRoUSMpKem6v4NLly4Z6enpGT6H0+k0hg4d6m5bu3Zths92Tf369Q1JxqRJk677Xv369T3avv76a0OSMXz4cGPv3r1Gvnz5jFatWt30MwJAdmMEEMiEs2fPSpJCQ0NNnf/ll19KkhISEjza+/btK0kZ1grGxcWpbt267teFChVS+fLltXfv3tuu+a+urR1csGCBXC6XqZ85cuSIUlJS1LlzZ+XPn9/dXqlSJd1///3uz/lnTz/9tMfrunXr6uTJk+7foRkdO3bUihUrdPToUS1btkxHjx697vSv9Me6wYCAP/4Tl56erpMnT7qntzds2GD6mk6nU126dDF1bpMmTfTvf/9bQ4cOVZs2bRQUFKR33nnH9LUAILsQAIFMCAsLkyT9/vvvps7fv3+/AgICVLZsWY/2okWLKiIiQvv37/doL1GiRIY+IiMj9dtvv91mxRm1a9dOtWvXVvfu3VWkSBG1b99eH3/88d+GwWt1li9fPsN7sbGx+vXXX3X+/HmP9r9+lsjISEm6pc/y4IMPKjQ0VB999JFmzZqle++9N8Pv8hqXy6UxY8aoXLlycjqdKliwoAoVKqTNmzfrzJkzpq9ZrFixW9rw8cYbbyh//vxKSUnRuHHjVLhwYdM/CwDZhQAIZEJYWJiio6P1008/3dLP/XUTxo3kypXruu2GYdz2Na6tT7smODhYK1eu1JIlS/Svf/1LmzdvVrt27XT//fdnODczMvNZrnE6nWrTpo1mzJihefPm3XD0T5JeffVVJSQkqF69evrggw/09ddfa/Hixbr77rtNj3RKf/x+bsXGjRt1/PhxSdKWLVtu6WcBILsQAIFMat68ufbs2aPVq1ff9NySJUvK5XJp165dHu3Hjh3T6dOn3Tt6vSEyMtJjx+w1fx1llKSAgAA1atRIo0eP1rZt2/TKK69o2bJlWr58+XX7vlbnzp07M7y3Y8cOFSxYUCEhIZn7ADfQsWNHbdy4Ub///vt1N85c8+mnn6phw4Z677331L59ezVp0kSNGzfO8DsxG8bNOH/+vLp06aK4uDg99dRTGjFihNauXeu1/gHAWwiAQCYNGDBAISEh6t69u44dO5bh/T179ujNN9+U9McUpqQMO3VHjx4tSXrooYe8VleZMmV05swZbd682d125MgRzZs3z+O8U6dOZfjZazdE/uutaa6JiopSlSpVNGPGDI9A9dNPP+mbb75xf86s0LBhQw0bNkxvvfWWihYtesPzcuXKlWF08ZNPPtGhQ4c82q4F1euF5Vs1cOBAHThwQDNmzNDo0aNVqlQpxcfH3/D3CABW4UbQQCaVKVNGH374odq1a6fY2FiPJ4GsWrVKn3zyiTp37ixJqly5suLj4zV58mSdPn1a9evX148//qgZM2aoVatWN7zFyO1o3769Bg4cqNatW6tXr166cOGCJk6cqDvvvNNjE8TQoUO1cuVKPfTQQypZsqSOHz+uCRMm6I477lCdOnVu2P/IkSPVrFkz1apVS926ddPFixc1fvx4hYeHKzEx0Wuf468CAgL00ksv3fS85s2ba+jQoerSpYvuu+8+bdmyRbNmzVLp0qU9zitTpowiIiI0adIkhYaGKiQkRDVr1lRMTMwt1bVs2TJNmDBBQ4YMcd+WZtq0aWrQoIEGDx6sESNG3FJ/AJClLN6FDPiNn3/+2XjyySeNUqVKGYGBgUZoaKhRu3ZtY/z48calS5fc5125csVISkoyYmJijDx58hjFixc3Bg0a5HGOYfxxG5iHHnoow3X+evuRG90GxjAM45tvvjEqVKhgBAYGGuXLlzc++OCDDLeBWbp0qdGyZUsjOjraCAwMNKKjo40OHToYP//8c4Zr/PVWKUuWLDFq165tBAcHG2FhYUaLFi2Mbdu2eZxz7Xp/vc3MtGnTDElGamrqDX+nhuF5G5gbudFtYPr27WtERUUZwcHBRu3atY3Vq1df9/YtCxYsMOLi4ozcuXN7fM769esbd99993Wv+ed+zp49a5QsWdK45557jCtXrnic9/zzzxsBAQHG6tWr//YzAEB2chjGLazABgAAQI7HGkAAAACbIQACAADYDAEQAADAZgiAAAAgU1auXKkWLVooOjpaDodD8+fPd7935coVDRw4UBUrVlRISIiio6P1xBNP6PDhw9YVDAIgAADInPPnz6ty5cp6++23M7x34cIFbdiwQYMHD9aGDRs0d+5c7dy5Uw8//LAFleIadgEDAACvcTgcmjdvnlq1anXDc9auXasaNWpo//79133mObIeI4AAACBbnTlzRg6HQxEREVaXYls8CQQAAGSQlpaW4TGGTqdTTqczU/1eunRJAwcOVIcOHRQWFpapvnD7CICZ1LXUo1aXAADIIabu+zTLr3Hl171e6Sf5rfeVlJTk0TZkyJBMPerxypUratu2rQzD0MSJEzNZITKDAAgAgD9xpXulm0GDBikhIcGjLTOjf9fC3/79+7Vs2TJG/yxGAAQAwJ8YLq90443p3muuhb9du3Zp+fLlKlCggFf6xe0jAAIAgEw5d+6cdu/e7X6dmpqqlJQU5c+fX1FRUXr00Ue1YcMGff7550pPT9fRo0clSfnz51dgYKBVZdsat4HJJNYAAgDMypY1gEe2e6WfPFGxps9dsWKFGjZsmKE9Pj5eiYmJiomJue7PLV++XA0aNLjdEpEJjAACAOBHDC9NAd+KBg0a6O/Gkxhr8j3cBxAAAMBmGAEEAMCfuLJ/BBA5DwEQAAB/YsEUMHIepoABAABshhFAAAD8iZduBA3/RgAEAMCfMAUME5gCBgAAsBlGAAEA8CfsAoYJBEAAAPyIFTeCRs5DAAQAwJ8wAggTWAMIAABgM4wAAgDgT5gChgkEQAAA/An3AYQJTAEDAADYDCOAAAD4E6aAYQIBEAAAf8IuYJjAFDAAAIDNMAIIAIA/YQoYJhAAAQDwJ0wBwwSmgAEAAGyGEUAAAPyIYXAfQNwcARAAAH/CGkCYQAAEAMCfsAYQJrAGEAAAwGYYAQQAwJ8wBQwTCIAAAPgTF5tAcHNMAQMAANgMI4AAAPgTpoBhAgEQAAB/wi5gmMAUMAAAgM0wAggAgD9hChgmEAABAPAnTAHDBKaAAQAAbIYRQAAA/AkjgDCBAAgAgB8xDG4EjZsjAAIA4E8YAYQJrAEEAACwGUYAAQDwJ9wGBiYQAAEA8CdMAcMEpoABAABshhFAAAD8CVPAMIEACACAP2EKGCYwBQwAAGAzjAACAOBPmAKGCQRAAAD8CVPAMIEpYAAAAJthBBAAAH/CCCBM8OsAGBkZKYfDYercU6dOZXE1AABkA9YAwgS/DoBjx451//nkyZMaPny4mjZtqlq1akmSVq9era+//lqDBw+2qEIAALyMEUCY4DAMw7C6iOzwyCOPqGHDhnr22Wc92t966y0tWbJE8+fPv61+u5Z61AvVAQDsYOq+T7P8Ghc/e8Mr/QQ/3M8r/cA32WYTyNdff60HHnggQ/sDDzygJUuWWFARAABZwHB554Bfs00ALFCggBYsWJChfcGCBSpQoIAFFQEAkAVcLu8ct2DlypVq0aKFoqOj5XA4MsyqGYahl19+WVFRUQoODlbjxo21a9cuL35o3Cq/XgP4Z0lJSerevbtWrFihmjVrSpLWrFmjRYsWacqUKRZXBwBAznX+/HlVrlxZXbt2VZs2bTK8P2LECI0bN04zZsxQTEyMBg8erKZNm2rbtm0KCgqyoGLYJgB27txZsbGxGjdunObOnStJio2N1ffff+8OhAAA5HgWTN82a9ZMzZo1u+57hmFo7Nixeumll9SyZUtJ0vvvv68iRYpo/vz5at++fXaWiv/PNgFQkmrWrKlZs2ZZXQYAAFnHS7uA09LSlJaW5tHmdDrldDpvqZ/U1FQdPXpUjRs3dreFh4erZs2aWr16NQHQIrYKgC6XS7t379bx48fl+ssXpF69ehZVBQCA70lOTlZSUpJH25AhQ5SYmHhL/Rw9elSSVKRIEY/2IkWKuN9D9rNNAPzhhx/UsWNH7d+/X3+9843D4VB6erpFlQEA4EVeGgEcNGiQEhISPNpudfQPvss2AfDpp59W9erV9cUXXygqKsr0E0IAAMhRvHR739uZ7r2eokWLSpKOHTumqKgod/uxY8dUpUqVTPeP22ObALhr1y59+umnKlu2rNWlAABgGzExMSpatKiWLl3qDnxnz57VmjVr9Mwzz1hbnI3ZJgDWrFlTu3fvJgACAPybBY+CO3funHbv3u1+nZqaqpSUFOXPn18lSpRQnz59NHz4cJUrV859G5jo6Gi1atUq22vFH2wTAJ977jn17dtXR48eVcWKFZUnTx6P9ytVqmRRZQAAeJEFAXDdunVq2LCh+/W1tYPx8fGaPn26BgwYoPPnz+upp57S6dOnVadOHS1atIh7AFrINs8CDgjI+NATh8MhwzAytQmEZwEDAMzKlmcBf/CiV/oJfvwVr/QD32SbEcDU1FSrSwAAAPAJtgmAJUuWtLoEAACyngVTwMh5bBMAr9m2bZsOHDigy5cve7Q//PDDFlUEAIAX2WNlFzLJNgFw7969at26tbZs2eJe+yfJfT9AbgQNAADsIuPOCD/Vu3dvxcTE6Pjx48qbN6+2bt2qlStXqnr16lqxYoXV5QEA4B0ul3cO+DXbjACuXr1ay5YtU8GCBRUQEKCAgADVqVNHycnJ6tWrlzZu3Gh1iQAAZB7hDSbYZgQwPT1doaGhkqSCBQvq8OHDkv7YHLJz504rSwMAAMhWthkBrFChgjZt2qSYmBjVrFlTI0aMUGBgoCZPnqzSpUtbXR4AAN5hMAKIm7NNAHzppZd0/vx5SdLQoUPVvHlz1a1bVwUKFNBHH31kcXUAAHiH4WIXMG7ONgGwadOm7j+XLVtWO3bs0KlTpxQZGeneCQwAAGAHtgmA15M/f36rSwAAwLvYBAIT/DoAtmnTxvS5c+fOzcJKAADIJqwBhAl+HQDDw8OtLgEAgOzFGkCY4NcBcNq0aVaXAAAA4HP8OgACAGA7rAGECQRAAAD8CQEQJtjmSSAAAAD4AyOAAAD4E4NNILg52wTA999/X+3atZPT6fRov3z5smbPnq0nnnjCosqQGQ0eb6KGnZqq4B2FJEmHdh3UwnGfasuKjRZXBliH74XNMQUMExyGYY+/KuTKlUtHjhxR4cKFPdpPnjypwoULKz09/bb67VrqUW+Uh9tUuVE1udJdOrbviBwOh2o/0kAPPPWwEh/qr8O7frG6PMASfC9819R9n2b5NS6MftIr/eRNmOKVfuCbbDMCaBjGdR/59ssvv3C/wBxs09L1Hq/nvvFfNXi8icpUvZP/0cG2+F7YHPcBhAl+HwCrVq0qh8Mhh8OhRo0aKXfu//vI6enpSk1N1QMPPGBhhfAWR0CA7n2olpzBQdqz4WerywF8At8LG+JJIDDB7wNgq1atJEkpKSlq2rSp8uXL534vMDBQpUqV0iOPPGJRdfCGYuVL6MW5ryiPM1BpFy7prX+P0OHdjHLA3vheAPg7tlkDOGPGDLVr105BQUG33UdaWprS0tI82p6rGK9cjlyZLQ+ZkCtPbhWILqjg0Lyq/uA/VK9dI73ebgj/s4Ot8b3wTdmyBvD1Ll7pJ+9Anqblz/x+BPCa+Ph4SdL69eu1fft2SdLdd9+tqlWrmu4jOTlZSUlJHm1VwmNVNSLOe4XilqVfuarj+49Kkvb/tFcxlcqqcdcH9f5/JltcGWAdvhf2ZbALGCbYJgAeP35c7du314oVKxQRESFJOn36tBo2bKjZs2erUKFCN+1j0KBBSkhI8Gh7rmJ8VpSLTHAEOJQ7MI/VZQA+he+FjbAJBCbY5kkgzz33nH7//Xdt3bpVp06d0qlTp/TTTz/p7Nmz6tWrl6k+nE6nwsLCPA6mf631yICOurNGrArcUUjFypfQIwM6qvw/7tYP87+zujTAMnwvANyMbUYAFy1apCVLlig2NtbdFhcXp7fffltNmjSxsDJkRliBcHUf/ZzCC0Xq4u8X9MuO/Rr9xHBt+36z1aUBluF7YXPsAoYJtgmALpdLefJknP7IkyePXKyXyLGmDZxodQmAz+F7YXNMAcME20wB//Of/1Tv3r11+PBhd9uhQ4f0/PPPq1GjRhZWBgAAkL1sEwDfeustnT17VqVKlVKZMmVUpkwZxcTE6OzZsxo/frzV5QEA4B0ul3cO+DXbTAEXL15cGzZs0JIlS7Rjxw5JUmxsrBo3bmxxZQAAeBFTwDDBNgFQkhwOh+6//37df//9VpcCAABgGVsFwKVLl2rp0qU6fvx4ho0fU6dOtagqAAC8iF3AMME2ATApKUlDhw5V9erVFRUVJYfDYXVJAAB4H1PAMME2AXDSpEmaPn26/vWvf1ldCgAAgKVsEwAvX76s++67z+oyAADIUjwLGGbY5jYw3bt314cffmh1GQAAZC2X4Z0Dfs02I4CXLl3S5MmTtWTJElWqVCnDU0FGjx5tUWUAAHgR4Q0m2CYAbt68WVWqVJEk/fTTTx7vsSEEAADYiW0C4PLly60uAQCArMdtYGCCbQIgAAC2wBQwTLDNJhAAAAD8gRFAAAD8iMEIIEwgAAIA4E8IgDCBKWAAAACb8esRwM8++8z0uQ8//HAWVgIAQDbhSSAwwa8DYKtWrTxeOxwOGYbh8fqa9PT07CoLAICswxQwTPDrKWCXy+U+vvnmG1WpUkVfffWVTp8+rdOnT+vLL7/UPffco0WLFlldKgAAQLbx6xHAP+vTp48mTZqkOnXquNuaNm2qvHnz6qmnntL27dstrA4AAC9hBBAm+PUI4J/t2bNHERERGdrDw8O1b9++bK8HAICsYBiGV45bkZ6ersGDBysmJkbBwcEqU6aMhg0bdsv9IPvYZgTw3nvvVUJCgmbOnKkiRYpIko4dO6b+/furRo0aFlcHAICXWDAC+Prrr2vixImaMWOG7r77bq1bt05dunRReHi4evXqle314OZsEwCnTp2q1q1bq0SJEipevLgk6eDBgypXrpzmz59vbXEAAORgq1atUsuWLfXQQw9JkkqVKqX//ve/+vHHHy2uDDdimwBYtmxZbd68WYsXL9aOHTskSbGxsWrcuLHHbmAAAHI0C0YA77vvPk2ePFk///yz7rzzTm3atEnff/+9Ro8ene21wBzbBEDpj9u+NGnSRE2aNLG6FAAAsoS3HgWXlpamtLQ0jzan0ymn05nh3BdeeEFnz57VXXfdpVy5cik9PV2vvPKKOnXq5JVa4H1+HQDHjRunp556SkFBQRo3btzfnssaBQAA/k9ycrKSkpI82oYMGaLExMQM53788ceaNWuWPvzwQ919991KSUlRnz59FB0drfj4+GyqGLfCYfjxFp2YmBitW7dOBQoUUExMzA3Pczgc2rt3721do2upR2+3PACAzUzd92mWX+NMfCOv9BM0+UvTI4DFixfXCy+8oJ49e7rbhg8frg8++MC97Aq+xa9HAFNTU6/7ZwAA/JaXngR3o7B3PRcuXFBAgOed5XLlyiUXj6XzWX4dAAEAQNZr0aKFXnnlFZUoUUJ33323Nm7cqNGjR6tr165Wl4Yb8OsAmJCQYPpcdioBAPyBtzaB3Irx48dr8ODB6tGjh44fP67o6Gj9+9//1ssvv5zttcAcvw6AGzdu9Hi9YcMGXb16VeXLl5ck/fzzz8qVK5eqVatmRXkAAHifBQEwNDRUY8eO1dixY7P92rg9fh0Aly9f7v7z6NGjFRoaqhkzZigyMlKS9Ntvv6lLly6qW7euVSUCAABkO9s8C3jUqFFKTk52hz9JioyM1PDhwzVq1CgLKwMAwItcXjrg1/x6BPDPzp49qxMnTmRoP3HihH7//XcLKgIAwPusWAOInMc2I4CtW7dWly5dNHfuXP3yyy/65ZdfNGfOHHXr1k1t2rSxujwAALyDEUCYYJsRwEmTJqlfv37q2LGjrly5IknKnTu3unXrppEjR1pcHQAAQPaxTQDMmzevJkyYoJEjR2rPnj2SpDJlyigkJMTiygAA8B6mgGGGbQLgNSEhIapUqZLVZQAAkDWYvoUJtlkDCAAAgD/YbgQQAAB/ZjACCBMIgAAA+BMCIExgChgAAMBmGAEEAMCPMAUMMwiAAAD4EwIgTGAKGAAAwGYYAQQAwI8wBQwzCIAAAPgRAiDMIAACAOBHCIAwgzWAAAAANsMIIAAA/sRwWF0BcoAcFwBPnz6tiIgIq8sAAMAnMQUMM3x6Cvj111/XRx995H7dtm1bFShQQMWKFdOmTZssrAwAACDn8ukAOGnSJBUvXlyStHjxYi1evFhfffWVmjVrpv79+1tcHQAAvsdwObxywL/59BTw0aNH3QHw888/V9u2bdWkSROVKlVKNWvWtLg6AAB8D1PAMMOnRwAjIyN18OBBSdKiRYvUuHFjSZJhGEpPT7eyNAAAgBzLp0cA27Rpo44dO6pcuXI6efKkmjVrJknauHGjypYta3F1AAD4HoNdwDDBpwPgmDFjVKpUKR08eFAjRoxQvnz5JElHjhxRjx49LK4OAADfwxQwzPDpAJgnTx7169cvQ/vzzz9vQTUAAAD+wecC4GeffWb63IcffjgLKwEAIOdhBy/M8LkA2KpVK1PnORwONoIAAPAXhmF1BcgJfC4AulwsXgAA4HYxAggzfPo2MH926dIlq0sAAADwCz4dANPT0zVs2DAVK1ZM+fLl0969eyVJgwcP1nvvvWdxdQAA+B6eBAIzfDoAvvLKK5o+fbpGjBihwMBAd3uFChX07rvvWlgZAAC+yTC8c8C/+XQAfP/99zV58mR16tRJuXLlcrdXrlxZO3bssLAyAACAnMvnNoH82aFDh677xA+Xy6UrV65YUBEAAL6N6VuY4dMjgHFxcfruu+8ytH/66aeqWrWqBRUBAODbDMPhlQP+zadHAF9++WXFx8fr0KFDcrlcmjt3rnbu3Kn3339fn3/+udXlAQAA5Eg+PQLYsmVLLVy4UEuWLFFISIhefvllbd++XQsXLtT9999vdXkAAPgcw+WdA/7Np0cAJalu3bpavHix1WUAAJAjuJi+hQk+HwAlad26ddq+fbukP9YFVqtWzeKKAAAAci6fDoC//PKLOnTooP/973+KiIiQJJ0+fVr33XefZs+erTvuuMPaAgEA8DFs4IAZPr0GsHv37rpy5Yq2b9+uU6dO6dSpU9q+fbtcLpe6d+9udXkAAPgcngQCM3x6BPDbb7/VqlWrVL58eXdb+fLlNX78eNWtW9fCygAA8E08xQNm+PQIYPHixa97w+f09HRFR0dbUBEAAEDO59MBcOTIkXruuee0bt06d9u6devUu3dvvfHGGxZWBgCAb2IKGGb43BRwZGSkHI7/+xfv/PnzqlmzpnLn/qPUq1evKnfu3OratatatWplUZUAAPgmbgMDM3wuAI4dO9bqEgAAAPyazwXA+Ph4q0sAACDH4jYwMMPnAuCNXLp0SZcvX/ZoCwsLs6gaAAB8E7uAYYZPbwI5f/68nn32WRUuXFghISGKjIz0OAAAAHDrfDoADhgwQMuWLdPEiRPldDr17rvvKikpSdHR0Xr//fetLg8AAJ/jMhxeOeDffDoALly4UBMmTNAjjzyi3Llzq27dunrppZf06quvatasWVaXBwCAzzEMh1eOW3Xo0CE9/vjjKlCggIKDg1WxYkWP27jBt/h0ADx16pRKly4t6Y/1fqdOnZIk1alTRytXrrSyNAAA8P/99ttvql27tvLkyaOvvvpK27Zt06hRo1iu5cN8ehNI6dKllZqaqhIlSuiuu+7Sxx9/rBo1amjhwoWKiIiwujwAAHyOFZtAXn/9dRUvXlzTpk1zt8XExGR/ITDNp0cAu3Tpok2bNkmSXnjhBb399tsKCgrS888/r/79+1tcHQAAvsdbawDT0tJ09uxZjyMtLe261/zss89UvXp1PfbYYypcuLCqVq2qKVOmZPMnx61wGEbO2TC+f/9+rV+/XmXLllWlSpWsLkeSlDuwmNUlAD7n4uHvrC4B8El5CpbO8musLdbaK/188WRlJSUlebQNGTJEiYmJGc4NCgqSJCUkJOixxx7T2rVr1bt3b02aNIn7+/qoHBUAfREBEMiIAAhcX04KgJX2zs4w4ud0OuV0OjOcGxgYqOrVq2vVqlXutl69emnt2rVavXq1V+qBd/ncGsBx48aZPrdXr15ZWAkAADmPt27hcqOwdz1RUVGKi4vzaIuNjdWcOXO8Ugu8z+cC4JgxY0yd53A4CIAAAPyFFdN6tWvX1s6dOz3afv75Z5UsWdKCamCGzwXA1NRUq0sAAAC34Pnnn9d9992nV199VW3bttWPP/6oyZMna/LkyVaXhhvwuQAIAABunxVP8bj33ns1b948DRo0SEOHDlVMTIzGjh2rTp06ZXstMIcACACAH7mdp3h4Q/PmzdW8eXNLro1b59P3AQQAAID3MQIIAIAfcVldAHIEAiAAAH7EkDVTwMhZfH4K+LvvvtPjjz+uWrVq6dChQ5KkmTNn6vvvv7e4MgAAgJzJpwPgnDlz1LRpUwUHB2vjxo3uO5KfOXNGr776qsXVAQDge1yGdw74N58OgMOHD9ekSZM0ZcoU5cmTx91eu3ZtbdiwwcLKAADwTS45vHLAv/n0GsCdO3eqXr16GdrDw8N1+vTp7C8IAAAfxxpAmOHTI4BFixbV7t27M7R///33Kl066x+oDQAA4I98OgA++eST6t27t9asWSOHw6HDhw9r1qxZ6tevn5555hmrywMAwOe4vHTAv/n0FPALL7wgl8ulRo0a6cKFC6pXr56cTqf69eun5557zuryAADwOUwBwwyHYRg+v9fn8uXL2r17t86dO6e4uDjly5fP6pLccgcWs7oEwOdcPPyd1SUAPilPwaxfvvRNkfZe6afJsdle6Qe+yadHAK8JDAxUXFyc1WUAAODzmL6FGT4dABs2bCiH48ZD2cuWLcvGagAA8H0EQJjh0wGwSpUqHq+vXLmilJQU/fTTT4qPj7emKAAAgBzOpwPgmDFjrtuemJioc+fOZXM1AAD4PjaBwAyfvg3MjTz++OOaOnWq1WUAAOBzXA7vHPBvOTIArl69WkFBQVaXAQAAkCP59BRwmzZtPF4bhqEjR45o3bp1Gjx4sEVVAQDgu3iOL8zw6QAYHh7u8TogIEDly5fX0KFD1aRJE4uqAgDAd/n8zX3hE3w2AKanp6tLly6qWLGiIiMjrS4HAIAcgdvAwAyfXQOYK1cuNWnSRKdPn7a6FAAAAL/iswFQkipUqKC9e/daXQYAADmGy+HwygH/5tMBcPjw4erXr58+//xzHTlyRGfPnvU4AACAJ8NLB/ybT64BHDp0qPr27asHH3xQkvTwww97PBLOMAw5HA6lp6dbVSIAAECO5ZMBMCkpSU8//bSWL19udSkAAOQobAKBGT4ZAA3jj8Hn+vXrW1wJAAA5C0/xgBk+uwbQwQJUAACALOGTI4CSdOedd940BJ46dSqbqgEAIGfgSSAww2cDYFJSUoYngQAAgL/HDl6Y4bMBsH379ipcuLDVZQAAkKOwBhBm+OQaQNb/AQAAZB2fHAG8tgsYAADcGm4DAzN8MgC6XPzrCwDA7WAIBWb45BQwAAAAso5PjgACAIDbwyYQmEEABADAj7CICmYwBQwAAGAzjAACAOBHGAGEGQRAAAD8iMEaQJjAFDAAAIDNMAIIAIAfYQoYZhAAAQDwIwRAmEEABADAj/AkEJjBGkAAAACbYQQQAAA/wpNAYAYBEAAAP8IaQJjBFDAAAIDNMAIIAIAfYQQQZhAAAQDwI+wChhlMAQMAANgMI4AAAPgRdgHDDEYAAQDwIy4vHbfrtddek8PhUJ8+fTLRC7IaARAAAHjF2rVr9c4776hSpUpWl4KbIAACAOBHDC8dt+rcuXPq1KmTpkyZosjIyMx+DGQxAiAAAH7EJcMrR1pams6ePetxpKWl3fC6PXv21EMPPaTGjRtn46fF7SIAAgDgR7y1BjA5OVnh4eEeR3Jy8nWvOXv2bG3YsOGG78P3sAsYAABkMGjQICUkJHi0OZ3ODOcdPHhQvXv31uLFixUUFJRd5SGTCIAAAPgRb90I2ul0Xjfw/dX69et1/Phx3XPPPe629PR0rVy5Um+99ZbS0tKUK1cuL1UFbyEAAgDgR7L7UXCNGjXSli1bPNq6dOmiu+66SwMHDiT8+SgCIAAAuG2hoaGqUKGCR1tISIgKFCiQoR2+gwAIAIAf4UkgMIMACACAH3F5bRXg7VuxYoXVJeAmuA0MAACAzTACCACAH7F+/A85AQEQAAA/kt27gJEzMQUMAABgM7YYAdy8ebPpcytVqpSFlQAAkLV8YRMIfJ8tAmCVKlXkcDhkGIYcjr/fH5+enp5NVQEA4H3EP5hhiyng1NRU7d27V6mpqZozZ45iYmI0YcIEbdy4URs3btSECRNUpkwZzZkzx+pSAQDIFJeXDvg3W4wAlixZ0v3nxx57TOPGjdODDz7obqtUqZKKFy+uwYMHq1WrVhZUCAAAkH1sEQD/bMuWLYqJicnQHhMTo23btllQEQAA3sMaQJhhiyngP4uNjVVycrIuX77sbrt8+bKSk5MVGxtrYWUAAGSe4aUD/s12I4CTJk1SixYtdMcdd7h3/G7evFkOh0MLFy60uDoAAICsZ7sAWKNGDe3du1ezZs3Sjh07JEnt2rVTx44dFRISYnF1AABkDhs4YIbtAqAkhYSE6KmnnrK6DAAAvM5gAhcm2G4NoCTNnDlTderUUXR0tPbv3y9JGjNmjBYsWGBxZQAAAFnPdgFw4sSJSkhIULNmzfTbb7+5b/wcGRmpsWPHWlscAACZxH0AYYbtAuD48eM1ZcoUvfjii8qd+/9mwKtXr64tW7ZYWBkAAJnnkuGVA/7NdgEwNTVVVatWzdDudDp1/vx5CyoCAADIXrYLgDExMUpJScnQvmjRIu4DCADI8bgPIMyw3S7ghIQE9ezZU5cuXZJhGPrxxx/13//+V8nJyXr33XetLg+36Zmn49U34RkVLVpImzdvU+8+g7V2XYrVZQHZYl3KFk378FNt27FbJ06e0pvJg9Wo3n2SpCtXr2r85Bn6bvU6/XL4iPKFhOgf91bV8093UeFCBSyuHFmB6VuYYbsA2L17dwUHB+ull17ShQsX1LFjR0VHR+vNN99U+/btrS4Pt+Gxxx7WGyOHqEfPF/Tj2o3q9Vx3ffnFLMVVqKcTJ05aXR6Q5S5evKTyZUur9UNN1Oc/wz3eu3QpTdt27tG/O3dQ+bKldfb33/Xam+/o2YFJ+njqOIsqRlZiAwfMcBiGYdu/Kly4cEHnzp1T4cKFb7uP3IHFvFgRbseq7xdq7bpN6t3nJUmSw+HQvr1r9faEaRox8m2Lq7Oni4e/s7oE26pQu5nHCOD1bNm+Ux2699HiOTMUVfT2//uHW5enYOksv8aTpR7zSj9T9n3ilX7gm2y3BvDP8ubNm6nwB+vlyZNH99xTSUuX/V/gMAxDS5d9r3/8o5qFlQG+69y5C3I4HAoN5elH/sjw0j/wb7aYAq5ataocDoepczds2JDF1cCbChbMr9y5c+v4sV892o8fP6G7ypexqCrAd6WlXdaYiVP1YOP6ysfjL/0SU8AwwxYBsFWrVu4/X7p0SRMmTFBcXJxq1aolSfrhhx+0detW9ejR42/7SUtLU1pamkebYRimwyUAWOnK1avqO/hVGYahwf2ftbocABayRQAcMmSI+8/du3dXr169NGzYsAznHDx48G/7SU5OVlJSkkebIyCfHLnCvFcsbsmvv57S1atXVbhIQY/2woUL6eixExZVBfiea+Hv8LHjmjruNUb//BjTtzDDdmsAP/nkEz3xxBMZ2h9//HHNmTPnb3920KBBOnPmjMfhCAjNqlJhwpUrV7Rhw2b9s2Edd5vD4dA/G9bRDz+st7AywHdcC38HDh7Wu2NfVUQ4f2n1ZzwKDmbYYgTwz4KDg/W///1P5cqV82j/3//+p6CgoL/9WafTKafT6dHG9K/1xrw5RdPeG6P1GzZr7dqN6vXckwoJCdb0GR9ZXRqQLS5cuKgDvxx2vz50+Jh2/LxH4WGhKlgwvxJefEXbft6tt0ckyeVy6deTpyRJ4WGhypMnj1VlA7CQ7QJgnz599Mwzz2jDhg2qUaOGJGnNmjWaOnWqBg8ebHF1uB2ffPKZChXMr8SX+6lo0ULatGmrHmr+uI4f//XmPwz4gZ927FLX5wa6X48YP1mS1LJZY/Xo9riWf/+DJOnRzj09fm7q+NdV455K2VcosoXLvnd3wy2w5X0AP/74Y7355pvavn27JCk2Nla9e/dW27Ztb7kv7gMIZMR9AIHry477AD5eso1X+vlg/1yv9APfZLsRQElq27btbYU9AAAAf2DLAChJly9f1vHjx+VyeS51LVGihEUVAQCQeTwLGGbYLgDu2rVLXbt21apVqzzar93PLz093aLKAADIPG4DAzNsFwA7d+6s3Llz6/PPP1dUVBS7eAEAfoVbuMAM2wXAlJQUrV+/XnfddZfVpQAAAFjCdgEwLi5Ov/7K7UEAAP6JNYAww3ZPAnn99dc1YMAArVixQidPntTZs2c9DgAAcjLDS//Av9luBLBx48aSpEaNGnm0swkEAADYhe0C4PLly60uAQCALMMmEJhhuwBYv359q0sAACDL2PABX7gNtguA11y4cEEHDhzQ5cuXPdorVeK5mAAAwL/ZLgCeOHFCXbp00VdffXXd91kDCADIydgFDDNstwu4T58+On36tNasWaPg4GAtWrRIM2bMULly5fTZZ59ZXR4AAJni8tIB/2a7EcBly5ZpwYIFql69ugICAlSyZEndf//9CgsLU3Jysh566CGrSwQAAMhSthsBPH/+vAoXLixJioyM1IkTJyRJFStW1IYNG6wsDQCATOM+gDDDdgGwfPny2rlzpySpcuXKeuedd3To0CFNmjRJUVFRFlcHAEDmuGR45YB/s90UcO/evXXkyBFJ0pAhQ/TAAw/ogw8+UGBgoGbMmGFxdQAAZA63gYEZtguAjz/+uPvP1apV0/79+7Vjxw6VKFFCBQsWtLAyAACA7GGLAJiQkGD63NGjR2dhJQAAZC128MIMWwTAjRs3mjrP4XBkcSUAAGQtNnDADFsEQJ7/CwAA8H9stwsYAAB/ZsUu4OTkZN17770KDQ1V4cKF1apVK/cdN+CbCIAAAPgRwzC8ctyKb7/9Vj179tQPP/ygxYsX68qVK2rSpInOnz+fRZ8SmWWLKWAAAJB1Fi1a5PF6+vTpKly4sNavX6969epZVBX+DgEQAAA/4gs3cT5z5owkKX/+/BZXghshAAIA4Ee8tQs4LS1NaWlpHm1Op1NOp/Nvf87lcqlPnz6qXbu2KlSo4JVa4H2sAQQAABkkJycrPDzc40hOTr7pz/Xs2VM//fSTZs+enQ1V4nY5DJ4Zkym5A4tZXQLgcy4e/s7qEgCflKdg6Sy/Rr1ijbzSz+K9X97yCOCzzz6rBQsWaOXKlYqJifFKHcgaTAEDAOBHvDWqY2a6131Nw9Bzzz2nefPmacWKFYS/HIAACACAH7FiE0jPnj314YcfasGCBQoNDdXRo0clSeHh4QoODs72enBzrAEEAACZMnHiRJ05c0YNGjRQVFSU+/joo4+sLg03wAggAAB+xIoRQLYT5DwEQAAA/AhhDGYwBQwAAGAzjAACAOBHfOFJIPB9BEAAAPyIt54EAv/GFDAAAIDNMAIIAIAfYRMIzCAAAgDgR1gDCDOYAgYAALAZRgABAPAjTAHDDAIgAAB+hClgmEEABADAj3AbGJjBGkAAAACbYQQQAAA/4mINIEwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EaaAYQYBEAAAP8IUMMxgChgAAMBmGAEEAMCPMAUMMwiAAAD4EaaAYQZTwAAAADbDCCAAAH6EKWCYQQAEAMCPMAUMMwiAAAD4EcNwWV0CcgDWAAIAANgMI4AAAPgRF1PAMIEACACAHzHYBAITmAIGAACwGUYAAQDwI0wBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAf4UkgMIMACACAH+FJIDCDKWAAAACbYQQQAAA/wiYQmEEABADAj3AbGJhBAAQAwI8wAggzWAMIAABgM4wAAgDgR7gNDMwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EXYBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAfYRcwzCAAAgDgRwzWAMIEpoABAABshhFAAAD8CFPAMIMACACAH2EXMMwgAAIA4EdYAwgzWAMIAABgMwRAAAD8iGEYXjlux9tvv61SpUopKChINWvW1I8//ujlTwdvIQACAOBHrAqAH330kRISEjRkyBBt2LBBlStXVtOmTXX8+PEs+JTILAIgAADItNGjR+vJJ59Uly5dFBcXp0mTJilv3ryaOnWq1aXhOgiAAAD4EcNLR1pams6ePetxpKWlXfealy9f1vr169W4cWN3W0BAgBo3bqzVq1dnzQdFprALOJOuXj5kdQnQH/+hSk5O1qBBg+R0Oq0uB/AZfDfsx1v/X0pMTFRSUpJH25AhQ5SYmJjh3F9//VXp6ekqUqSIR3uRIkW0Y8cOr9QD73IY3DAIfuDs2bMKDw/XmTNnFBYWZnU5gM/gu4HblZaWlmHEz+l0XvcvEocPH1axYsW0atUq1apVy90+YMAAffvtt1qzZk2W14tbwwggAADI4EZh73oKFiyoXLly6dixYx7tx44dU9GiRbOiPGQSawABAECmBAYGqlq1alq6dKm7zeVyaenSpR4jgvAdjAACAIBMS0hIUHx8vKpXr64aNWpo7NixOn/+vLp06WJ1abgOAiD8gtPp1JAhQ1jkDvwF3w1kl3bt2unEiRN6+eWXdfToUVWpUkWLFi3KsDEEvoFNIAAAADbDGkAAAACbIQACAADYDAEQAADAZgiAyJQGDRqoT58+7telSpXS2LFj//ZnHA6H5s+fn6V1mdW5c2e1atUqy68zffp0RUREZPl14N/++n3LComJiapSpUqWXgOA9dgFDK9au3atQkJCrC5DiYmJmj9/vlJSUqwuBQAAn0MAhFcVKlTI6hIAAMBNMAUM086fP68nnnhC+fLlU1RUlEaNGpXhnL9OAe/atUv16tVTUFCQ4uLitHjx4ptep0GDBurVq5cGDBig/Pnzq2jRohkePn7gwAG1bNlS+fLlU1hYmNq2bet+BNH06dOVlJSkTZs2yeFwyOFwaPr06aY+46JFi1SnTh1FRESoQIECat68ufbs2eN+f9++fXI4HJo7d64aNmyovHnzqnLlylq9erVHP9OnT1eJEiWUN29etW7dWidPnjR1fcCsmTNnqnr16goNDVXRokXVsWNHHT9+3P3+ihUr5HA4tHTpUlWvXl158+bVfffdp507d3r089prr6lIkSIKDQ1Vt27ddOnSpez+KAAsQACEaf3799e3336rBQsW6JtvvtGKFSu0YcOGG57vcrnUpk0bBQYGas2aNZo0aZIGDhxo6lozZsxQSEiI1qxZoxEjRmjo0KHu8OhyudSyZUudOnVK3377rRYvXqy9e/eqXbt2kv64GWnfvn11991368iRIzpy5Ij7vZs5f/68EhIStG7dOi1dulQBAQFq3bq1XC6Xx3kvvvii+vXrp5SUFN15553q0KGDrl69Kklas2aNunXrpmeffVYpKSlq2LChhg8fbur6gFlXrlzRsGHDtGnTJs2fP1/79u1T586dM5z34osvatSoUVq3bp1y586trl27ut/7+OOPlZiYqFdffVXr1q1TVFSUJkyYkI2fAoBlDMCE33//3QgMDDQ+/vhjd9vJkyeN4OBgo3fv3u62kiVLGmPGjDEMwzC+/vprI3fu3MahQ4fc73/11VeGJGPevHk3vFb9+vWNOnXqeLTde++9xsCBAw3DMIxvvvnGyJUrl3HgwAH3+1u3bjUkGT/++KNhGIYxZMgQo3Llyjf9XPHx8UbLli1v+P6JEycMScaWLVsMwzCM1NRUQ5Lx7rvvZrj29u3bDcMwjA4dOhgPPvigRz/t2rUzwsPDb1oP8Hfq16/v8X37s7Vr1xqSjN9//90wDMNYvny5IclYsmSJ+5wvvvjCkGRcvHjRMAzDqFWrltGjRw+PfmrWrGnquwMgZ2MEEKbs2bNHly9fVs2aNd1t+fPnV/ny5W/4M9u3b1fx4sUVHR3tbjP7UPBKlSp5vI6KinJPb13rt3jx4u734+LiFBERoe3bt5vq/0Z27dqlDh06qHTp0goLC1OpUqUk/THlfKP6oqKiJMmjvj//niTznxswa/369WrRooVKlCih0NBQ1a9fXxL/rgIwhwAIn5QnTx6P1w6HI8M0bFZo0aKFTp06pSlTpmjNmjVas2aNJOny5cs3rM/hcEhSttQHSH8sVWjatKnCwsI0a9YsrV27VvPmzZPEv6sAzCEAwpQyZcooT5487kAkSb/99pt+/vnnG/5MbGysDh48qCNHjrjbfvjhh0zXcq3fgwcPutu2bdum06dPKy4uTpIUGBio9PT0W+r35MmT2rlzp1566SU1atRIsbGx+u23326rvj//niTvfG7gmh07dujkyZN67bXXVLduXd11110eG0DM4t9VwL64DQxMyZcvn7p166b+/furQIECKly4sF588UUFBNz47xCNGzfWnXfeqfj4eI0cOVJnz57Viy++mOlaGjdurIoVK6pTp04aO3asrl69qh49eqh+/fqqXr26pD92I6empiolJUV33HGHQkND5XQ6/7bfyMhIFShQQJMnT1ZUVJQOHDigF1544Zbr69Wrl2rXrq033nhDLVu21Ndff61Fixbd1mcFrqdEiRIKDAzU+PHj9fTTT+unn37SsGHDbrmf3r17q3Pnzqpevbpq166tWbNmaevWrSpdunQWVA3AlzACCNNGjhypunXrqkWLFmrcuLHq1KmjatWq3fD8gIAAzZs3TxcvXlSNGjXUvXt3vfLKK5muw+FwaMGCBYqMjFS9evXUuHFjlS5dWh999JH7nEceeUQPPPCAGjZsqEKFCum///3vTfsNCAjQ7NmztX79elWoUEHPP/+8Ro4cecv1/eMf/9CUKVP05ptvqnLlyvrmm2/00ksv3XI/wI0UKlRI06dP1yeffKK4uDi99tpreuONN265n3bt2mnw4MEaMGCAqlWrpv379+uZZ57JgooB+BqHYRiG1UUAAAAg+zACCAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAZvo3LmzWrVq5X7doEED9enTJ9vrWLFihRwOh06fPn3DcxwOh+bPn2+6z8TERFWpUiVTde3bt08Oh0MpKSmZ6gcAcgICIGChzp07y+FwyOFwKDAwUGXLltXQoUN19erVLL/23LlzTT8+zExoAwDkHDwLGLDYAw88oGnTpiktLU1ffvmlevbsqTx58mjQoEEZzr18+bICAwO9ct38+fN7pR8AQM7DCCBgMafTqaJFi6pkyZJ65pln1LhxY3322WeS/m/a9pVXXlF0dLTKly8vSTp48KDatm2riIgI5c+fXy1bttS+ffvcfaanpyshIUEREREqUKCABgwYoL8+9fGvU8BpaWkaOHCgihcvLqfTqbJly+q9997Tvn371LBhQ0lSZGSkHA6HOnfuLElyuVxKTk5WTEyMgoODVblyZX366ace1/nyyy915513Kjg4WA0bNvSo06yBAwfqzjvvVN68eVW6dGkNHjxYV65cyXDeO++8o+LFiytv3rxq27atzpw54/H+u+++q9jYWAUFBemuu+7ShAkTbnjN3377TZ06dVKhQoUUHByscuXKadq0abdcOwD4IkYAAR8THByskydPul8vXbpUYWFhWrx4sSTpypUratq0qWrVqqXvvvtOuXPn1vDhw/XAAw9o8+bNCgwM1KhRozR9+nRNnTpVsbGxGjVqlObNm6d//vOfN7zuE088odWrV2vcuHGqXLmyUlNT9euvv6p48eKaM2eOHnnkEe3cuVNhYWEKDg6WJCUnJ+uDDz7QpEmTVK5cOa1cuVKPP/64ChUqpPr16+vgwYNq06aNevbsqaeeekrr1q1T3759b/l3EhoaqunTpys6OlpbtmzRk08+qdDQUA0YMMB9zu7du/Xxxx9r4cKFOnv2rLp166YePXpo1qxZkqRZs2bp5Zdf1ltvvaWqVatq48aNevLJJxUSEqL4+PgM1xw8eLC2bdumr776SgULFtTu3bt18eLFW64dAHySAcAy8fHxRsuWLQ3DMAyXy2UsXrzYcDqdRr9+/dzvFylSxEhLS3P/zMyZM43y5csbLpfL3ZaWlmYEBwcbX3/9tWEYhhEVFWWMGDHC/f6VK1eMO+64w30twzCM+vXrG7179zYMwzB27txpSDIWL1583TqXL19uSDJ+++03d9ulS5eMvHnzGqtWrfI4t1u3bkaHDh0MwzCMQYMGGXFxcR7vDxw4MENffyXJmDdv3g3fHzlypFGtWjX36yFDhhi5cuUyfvnlF3fbV199ZQQEBBhHjhwxDMMwypQpY3z44Yce/QwbNsyoVauWYRiGkZqaakgyNm7caBiGYbRo0cLo0qXLDWsAgJyMEUDAYp9//rny5cunK1euyOVyqWPHjkpMTHS/X7FiRY91f5s2bdLu3bsVGhrq0c+lS5e0Z88enTlzRkeOHFHNmjXd7+XOnVvVq1fPMA18TUpKinLlyqX69eubrnv37t26cOGC7r//fo/2y5cvq2rVqpKk7du3e9QhSbVq1TJ9jWs++ugjjRs3Tnv27NG5c+d09epVhYWFeZxTokQJFStWzOM6LpdLO3fuVGhoqPbs2aNu3brpySefdJ9z9epVhYeHX/eazzzzjB555BFt2LBBTZo0UatWrXTffffdcu0A4IsIgIDFGjZsqIkTJyowMFDR0dHKndvzaxkSEuLx+ty5c6pWrZp7avPPChUqdFs1XJvSvRXnzp2TJH3xxRcewUv6Y12jt6xevVqdOnVSUlKSmjZtqvDwcM2ePVujRo265VqnTJmSIZDmypXruj/TrFkz7d+/X19++aUWL16sRo0aqWfPnnrjjTdu/8MAgI8gAAIWCwkJUdmyZU2ff8899+ijjz5S4cKFM4yCXRMVFaU1a9aoXr16kv4Y6Vq/fr3uueee655fsWJFuVwuffvtt2rcuHGG96+NQKanp7vb4uLi5HQ6deDAgRuOHMbGxro3tFzzww8/3PxD/smqVatUsmRJvfjii+62/fv3ZzjvwIEDOnz4sKKjo93XCQgIUPny5VWkSBFFR0dr79696tSpk+lrFypUSPHx8YqPj1fdunXVv39/AiAAv8AuYCCH6dSpkwoWLKiWLVvqu+++U2pqqlasWKFevXrpl19+kST17t1br732mubPn68dO3aoR48ef3sPv1KlSik+Pl5du3bV/Pnz3X1+/PHHkqSSJUvK4XDo888/14kTJ3Tu3DmFhoaqX79+ev755zVjxgzt2bNHGzZs0Pjx4zVjxgxJ0tNPP61du3apf//+2rlzpz788ENNnz79lj5vuXLldODAAc2ePVt79uzRuHHjNG/evAznBQUFKT4+Xps2bdJ3332nXr16qW3btipatKgkKSkpScnJyRo3bpx+/vlnbdmyRdOmTdPo0aOve92XX35ZCxYs0O7du7V161Z9/vnnio2NvaXaAcBXEQCBHCZv3rxauXKlSpQooTZt2ig2NlbdunXTpUuX3COCffv21b/+9S/Fx8erVq1aCg0NVevWrf+234kTJ+rRRx9Vjx49dNddd+nJJ5/U+fPnJUnFihVTUlKSXnjhBRUpUkTPPvusJGnYsGEaPHiwkpOTFRsbqwceeEBffPGFYmJiJP2xLm/OnDmaP3++KleurEmTJunVV1+9pc/78MMP6/nnn9ezzz6rKlWqaNWqVRo8eHCG88qWLas2bdrowQcfVJMmTVSpUiWP27x0795d7777rqZNm6aKFSuqfv36mj59urvWvwoMDNSgQYNUqVIl1atXT7ly5dLs2bNvqXYA8FUO40arwgEAAOCXGAEEAACwGQIgAACAzRAAAQAAbIYACAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAQAAbIYACAAAYDP/D32GkVATVcrxAAAAAElFTkSuQmCC"}, "metadata": {}}], "id": "d12d8520-4f14-4cbf-af23-23893d3d8854"}, {"cell_type": "markdown", "source": "Examining the confusion matrix, we see that logistic regression can distinguish between the different classes.  We see that the major problem is false positives.\n", "metadata": {}, "id": "6c4f7b4d-7cfb-4ff3-bf60-7b71da3a88c0"}, {"cell_type": "markdown", "source": "## TASK  6\n", "metadata": {}, "id": "93e8f80b-f9e9-43cc-8703-446e4032ce1a"}, {"cell_type": "markdown", "source": "Create a support vector machine object then  create a  <code>GridSearchCV</code> object  <code>svm_cv</code> with cv - 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n", "metadata": {}, "id": "c6f9fa64-44d6-4472-8d1b-e859ad3308a4"}, {"cell_type": "code", "source": "parameters = {'kernel':('linear', 'rbf','poly','rbf', 'sigmoid'),\n              'C': np.logspace(-3, 3, 5),\n              'gamma':np.logspace(-3, 3, 5)}\nsvm = SVC()", "metadata": {}, "execution_count": 24, "outputs": [], "id": "642cfb6b-2c24-4d0d-96ad-e01809716b19"}, {"cell_type": "code", "source": "svm_cv=GridSearchCV(svm,parameters,cv=10)\nsvm_cv.fit(X_train,Y_train)", "metadata": {}, "execution_count": 25, "outputs": [{"execution_count": 25, "output_type": "execute_result", "data": {"text/plain": "GridSearchCV(cv=10, estimator=SVC(),\n             param_grid={'C': array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n       1.00000000e+03]),\n                         'gamma': array([1.00000000e-03, 3.16227766e-02, 1.00000000e+00, 3.16227766e+01,\n       1.00000000e+03]),\n                         'kernel': ('linear', 'rbf', 'poly', 'rbf', 'sigmoid')})"}, "metadata": {}}], "id": "4ac8b9eb-801e-4596-bce7-fa7a980dd5ba"}, {"cell_type": "code", "source": "print(\"tuned hpyerparameters :(best parameters) \",svm_cv.best_params_)\nprint(\"accuracy :\",svm_cv.best_score_)", "metadata": {}, "execution_count": 27, "outputs": [{"name": "stdout", "text": "tuned hpyerparameters :(best parameters)  {'C': 1.0, 'gamma': 0.03162277660168379, 'kernel': 'sigmoid'}\naccuracy : 0.8482142857142856\n", "output_type": "stream"}], "id": "a017bdfd-1c68-4eec-9b88-6900d8971ced"}, {"cell_type": "markdown", "source": "## TASK  7\n", "metadata": {}, "id": "41b16eb3-b7ec-401d-a44a-1d2ab4638af0"}, {"cell_type": "markdown", "source": "Calculate the accuracy on the test data using the method <code>score</code>:\n", "metadata": {}, "id": "97ce1130-daf0-4059-abcf-bdfcc15b5f0b"}, {"cell_type": "code", "source": "print('Accuracy on test data is:{:.3f}'.format(svm_cv.score(X_test, Y_test)))", "metadata": {}, "execution_count": 28, "outputs": [{"name": "stdout", "text": "Accuracy on test data is:0.833\n", "output_type": "stream"}], "id": "7aedad55-850c-4383-b8d1-c2dc61895fe8"}, {"cell_type": "markdown", "source": "We can plot the confusion matrix\n", "metadata": {}, "id": "7d52749c-ace1-4457-b304-f0e459a2d057"}, {"cell_type": "code", "source": "yhat=svm_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)", "metadata": {}, "execution_count": 29, "outputs": [{"output_type": "display_data", "data": {"text/plain": "<pyolite.display.Image at 0x637d638>", "image/png": "iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/YYfK9AAAACXBIWXMAAA9hAAAPYQGoP6dpAABHB0lEQVR4nO3dd3gU5f7+8XsDZBNCGj1BSihiIlUQDtIPCKIgRaV6DE2PggKGJkeRBNAoSBEUEJQi4sFCEwtKFT0g0gJIkxKKdEFAWoDs/P7wx35dAzKQTWaz8355zXWxz06e+WwuV2+eMuMwDMMQAAAAbCPA6gIAAACQvQiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABPzArl271KRJE4WHh8vhcGj+/Ple7X/fvn1yOByaPn26V/vNyRo0aKAGDRpYXQYA3BYCIOAle/bs0b///W+VLl1aQUFBCgsLU+3atfXmm2/q4sWLWXrt+Ph4bdmyRa+88opmzpyp6tWrZ+n1slPnzp3lcDgUFhZ23d/jrl275HA45HA49MYbb9xy/4cPH1ZiYqJSUlK8UC0A5Ay5rS4A8AdffPGFHnvsMTmdTj3xxBOqUKGCLl++rO+//179+/fX1q1bNXny5Cy59sWLF7V69Wq9+OKLevbZZ7PkGiVLltTFixeVJ0+eLOn/ZnLnzq0LFy5o4cKFatu2rcd7s2bNUlBQkC5dunRbfR8+fFhJSUkqVaqUqlSpYvrnvvnmm9u6HgD4AgIgkEmpqalq3769SpYsqWXLlikqKsr9Xs+ePbV792598cUXWXb9EydOSJIiIiKy7BoOh0NBQUFZ1v/NOJ1O1a5dW//9738zBMAPP/xQDz30kObMmZMttVy4cEF58+ZVYGBgtlwPALICU8BAJo0YMULnzp3Te++95xH+rilbtqx69+7tfn316lUNGzZMZcqUkdPpVKlSpfSf//xHaWlpHj9XqlQpNW/eXN9//71q1KihoKAglS5dWu+//777nMTERJUsWVKS1L9/fzkcDpUqVUrSH1On1/78Z4mJiXI4HB5tixcvVp06dRQREaF8+fKpfPny+s9//uN+/0ZrAJctW6a6desqJCREERERatmypbZv337d6+3evVudO3dWRESEwsPD1aVLF124cOHGv9i/6Nixo7766iudPn3a3bZ27Vrt2rVLHTt2zHD+qVOn1K9fP1WsWFH58uVTWFiYmjVrpk2bNrnPWbFihe69915JUpcuXdxTydc+Z4MGDVShQgWtX79e9erVU968ed2/l7+uAYyPj1dQUFCGz9+0aVNFRkbq8OHDpj8rAGQ1AiCQSQsXLlTp0qV13333mTq/e/fuevnll3XPPfdozJgxql+/vpKTk9W+ffsM5+7evVuPPvqo7r//fo0aNUqRkZHq3Lmztm7dKklq06aNxowZI0nq0KGDZs6cqbFjx95S/Vu3blXz5s2VlpamoUOHatSoUXr44Yf1v//9729/bsmSJWratKmOHz+uxMREJSQkaNWqVapdu7b27duX4fy2bdvq999/V3Jystq2bavp06crKSnJdJ1t2rSRw+HQ3Llz3W0ffvih7rrrLt1zzz0Zzt+7d6/mz5+v5s2ba/To0erfv7+2bNmi+vXru8NYbGyshg4dKkl66qmnNHPmTM2cOVP16tVz93Py5Ek1a9ZMVapU0dixY9WwYcPr1vfmm2+qUKFCio+PV3p6uiTpnXfe0TfffKPx48crOjra9GcFgCxnALhtZ86cMSQZLVu2NHV+SkqKIcno3r27R3u/fv0MScayZcvcbSVLljQkGStXrnS3HT9+3HA6nUbfvn3dbampqYYkY+TIkR59xsfHGyVLlsxQw5AhQ4w/f/XHjBljSDJOnDhxw7qvXWPatGnutipVqhiFCxc2Tp486W7btGmTERAQYDzxxBMZrte1a1ePPlu3bm0UKFDghtf88+cICQkxDMMwHn30UaNRo0aGYRhGenq6UbRoUSMpKem6v4NLly4Z6enpGT6H0+k0hg4d6m5bu3Zths92Tf369Q1JxqRJk677Xv369T3avv76a0OSMXz4cGPv3r1Gvnz5jFatWt30MwJAdmMEEMiEs2fPSpJCQ0NNnf/ll19KkhISEjza+/btK0kZ1grGxcWpbt267teFChVS+fLltXfv3tuu+a+urR1csGCBXC6XqZ85cuSIUlJS1LlzZ+XPn9/dXqlSJd1///3uz/lnTz/9tMfrunXr6uTJk+7foRkdO3bUihUrdPToUS1btkxHjx697vSv9Me6wYCAP/4Tl56erpMnT7qntzds2GD6mk6nU126dDF1bpMmTfTvf/9bQ4cOVZs2bRQUFKR33nnH9LUAILsQAIFMCAsLkyT9/vvvps7fv3+/AgICVLZsWY/2okWLKiIiQvv37/doL1GiRIY+IiMj9dtvv91mxRm1a9dOtWvXVvfu3VWkSBG1b99eH3/88d+GwWt1li9fPsN7sbGx+vXXX3X+/HmP9r9+lsjISEm6pc/y4IMPKjQ0VB999JFmzZqle++9N8Pv8hqXy6UxY8aoXLlycjqdKliwoAoVKqTNmzfrzJkzpq9ZrFixW9rw8cYbbyh//vxKSUnRuHHjVLhwYdM/CwDZhQAIZEJYWJiio6P1008/3dLP/XUTxo3kypXruu2GYdz2Na6tT7smODhYK1eu1JIlS/Svf/1LmzdvVrt27XT//fdnODczMvNZrnE6nWrTpo1mzJihefPm3XD0T5JeffVVJSQkqF69evrggw/09ddfa/Hixbr77rtNj3RKf/x+bsXGjRt1/PhxSdKWLVtu6WcBILsQAIFMat68ufbs2aPVq1ff9NySJUvK5XJp165dHu3Hjh3T6dOn3Tt6vSEyMtJjx+w1fx1llKSAgAA1atRIo0eP1rZt2/TKK69o2bJlWr58+XX7vlbnzp07M7y3Y8cOFSxYUCEhIZn7ADfQsWNHbdy4Ub///vt1N85c8+mnn6phw4Z677331L59ezVp0kSNGzfO8DsxG8bNOH/+vLp06aK4uDg99dRTGjFihNauXeu1/gHAWwiAQCYNGDBAISEh6t69u44dO5bh/T179ujNN9+U9McUpqQMO3VHjx4tSXrooYe8VleZMmV05swZbd682d125MgRzZs3z+O8U6dOZfjZazdE/uutaa6JiopSlSpVNGPGDI9A9dNPP+mbb75xf86s0LBhQw0bNkxvvfWWihYtesPzcuXKlWF08ZNPPtGhQ4c82q4F1euF5Vs1cOBAHThwQDNmzNDo0aNVqlQpxcfH3/D3CABW4UbQQCaVKVNGH374odq1a6fY2FiPJ4GsWrVKn3zyiTp37ixJqly5suLj4zV58mSdPn1a9evX148//qgZM2aoVatWN7zFyO1o3769Bg4cqNatW6tXr166cOGCJk6cqDvvvNNjE8TQoUO1cuVKPfTQQypZsqSOHz+uCRMm6I477lCdOnVu2P/IkSPVrFkz1apVS926ddPFixc1fvx4hYeHKzEx0Wuf468CAgL00ksv3fS85s2ba+jQoerSpYvuu+8+bdmyRbNmzVLp0qU9zitTpowiIiI0adIkhYaGKiQkRDVr1lRMTMwt1bVs2TJNmDBBQ4YMcd+WZtq0aWrQoIEGDx6sESNG3FJ/AJClLN6FDPiNn3/+2XjyySeNUqVKGYGBgUZoaKhRu3ZtY/z48calS5fc5125csVISkoyYmJijDx58hjFixc3Bg0a5HGOYfxxG5iHHnoow3X+evuRG90GxjAM45tvvjEqVKhgBAYGGuXLlzc++OCDDLeBWbp0qdGyZUsjOjraCAwMNKKjo40OHToYP//8c4Zr/PVWKUuWLDFq165tBAcHG2FhYUaLFi2Mbdu2eZxz7Xp/vc3MtGnTDElGamrqDX+nhuF5G5gbudFtYPr27WtERUUZwcHBRu3atY3Vq1df9/YtCxYsMOLi4ozcuXN7fM769esbd99993Wv+ed+zp49a5QsWdK45557jCtXrnic9/zzzxsBAQHG6tWr//YzAEB2chjGLazABgAAQI7HGkAAAACbIQACAADYDAEQAADAZgiAAAAgU1auXKkWLVooOjpaDodD8+fPd7935coVDRw4UBUrVlRISIiio6P1xBNP6PDhw9YVDAIgAADInPPnz6ty5cp6++23M7x34cIFbdiwQYMHD9aGDRs0d+5c7dy5Uw8//LAFleIadgEDAACvcTgcmjdvnlq1anXDc9auXasaNWpo//79133mObIeI4AAACBbnTlzRg6HQxEREVaXYls8CQQAAGSQlpaW4TGGTqdTTqczU/1eunRJAwcOVIcOHRQWFpapvnD7CICZ1LXUo1aXAADIIabu+zTLr3Hl171e6Sf5rfeVlJTk0TZkyJBMPerxypUratu2rQzD0MSJEzNZITKDAAgAgD9xpXulm0GDBikhIcGjLTOjf9fC3/79+7Vs2TJG/yxGAAQAwJ8YLq90443p3muuhb9du3Zp+fLlKlCggFf6xe0jAAIAgEw5d+6cdu/e7X6dmpqqlJQU5c+fX1FRUXr00Ue1YcMGff7550pPT9fRo0clSfnz51dgYKBVZdsat4HJJNYAAgDMypY1gEe2e6WfPFGxps9dsWKFGjZsmKE9Pj5eiYmJiomJue7PLV++XA0aNLjdEpEJjAACAOBHDC9NAd+KBg0a6O/Gkxhr8j3cBxAAAMBmGAEEAMCfuLJ/BBA5DwEQAAB/YsEUMHIepoABAABshhFAAAD8iZduBA3/RgAEAMCfMAUME5gCBgAAsBlGAAEA8CfsAoYJBEAAAPyIFTeCRs5DAAQAwJ8wAggTWAMIAABgM4wAAgDgT5gChgkEQAAA/An3AYQJTAEDAADYDCOAAAD4E6aAYQIBEAAAf8IuYJjAFDAAAIDNMAIIAIA/YQoYJhAAAQDwJ0wBwwSmgAEAAGyGEUAAAPyIYXAfQNwcARAAAH/CGkCYQAAEAMCfsAYQJrAGEAAAwGYYAQQAwJ8wBQwTCIAAAPgTF5tAcHNMAQMAANgMI4AAAPgTpoBhAgEQAAB/wi5gmMAUMAAAgM0wAggAgD9hChgmEAABAPAnTAHDBKaAAQAAbIYRQAAA/AkjgDCBAAgAgB8xDG4EjZsjAAIA4E8YAYQJrAEEAACwGUYAAQDwJ9wGBiYQAAEA8CdMAcMEpoABAABshhFAAAD8CVPAMIEACACAP2EKGCYwBQwAAGAzjAACAOBPmAKGCQRAAAD8CVPAMIEpYAAAAJthBBAAAH/CCCBM8OsAGBkZKYfDYercU6dOZXE1AABkA9YAwgS/DoBjx451//nkyZMaPny4mjZtqlq1akmSVq9era+//lqDBw+2qEIAALyMEUCY4DAMw7C6iOzwyCOPqGHDhnr22Wc92t966y0tWbJE8+fPv61+u5Z61AvVAQDsYOq+T7P8Ghc/e8Mr/QQ/3M8r/cA32WYTyNdff60HHnggQ/sDDzygJUuWWFARAABZwHB554Bfs00ALFCggBYsWJChfcGCBSpQoIAFFQEAkAVcLu8ct2DlypVq0aKFoqOj5XA4MsyqGYahl19+WVFRUQoODlbjxo21a9cuL35o3Cq/XgP4Z0lJSerevbtWrFihmjVrSpLWrFmjRYsWacqUKRZXBwBAznX+/HlVrlxZXbt2VZs2bTK8P2LECI0bN04zZsxQTEyMBg8erKZNm2rbtm0KCgqyoGLYJgB27txZsbGxGjdunObOnStJio2N1ffff+8OhAAA5HgWTN82a9ZMzZo1u+57hmFo7Nixeumll9SyZUtJ0vvvv68iRYpo/vz5at++fXaWiv/PNgFQkmrWrKlZs2ZZXQYAAFnHS7uA09LSlJaW5tHmdDrldDpvqZ/U1FQdPXpUjRs3dreFh4erZs2aWr16NQHQIrYKgC6XS7t379bx48fl+ssXpF69ehZVBQCA70lOTlZSUpJH25AhQ5SYmHhL/Rw9elSSVKRIEY/2IkWKuN9D9rNNAPzhhx/UsWNH7d+/X3+9843D4VB6erpFlQEA4EVeGgEcNGiQEhISPNpudfQPvss2AfDpp59W9erV9cUXXygqKsr0E0IAAMhRvHR739uZ7r2eokWLSpKOHTumqKgod/uxY8dUpUqVTPeP22ObALhr1y59+umnKlu2rNWlAABgGzExMSpatKiWLl3qDnxnz57VmjVr9Mwzz1hbnI3ZJgDWrFlTu3fvJgACAPybBY+CO3funHbv3u1+nZqaqpSUFOXPn18lSpRQnz59NHz4cJUrV859G5jo6Gi1atUq22vFH2wTAJ977jn17dtXR48eVcWKFZUnTx6P9ytVqmRRZQAAeJEFAXDdunVq2LCh+/W1tYPx8fGaPn26BgwYoPPnz+upp57S6dOnVadOHS1atIh7AFrINs8CDgjI+NATh8MhwzAytQmEZwEDAMzKlmcBf/CiV/oJfvwVr/QD32SbEcDU1FSrSwAAAPAJtgmAJUuWtLoEAACyngVTwMh5bBMAr9m2bZsOHDigy5cve7Q//PDDFlUEAIAX2WNlFzLJNgFw7969at26tbZs2eJe+yfJfT9AbgQNAADsIuPOCD/Vu3dvxcTE6Pjx48qbN6+2bt2qlStXqnr16lqxYoXV5QEA4B0ul3cO+DXbjACuXr1ay5YtU8GCBRUQEKCAgADVqVNHycnJ6tWrlzZu3Gh1iQAAZB7hDSbYZgQwPT1doaGhkqSCBQvq8OHDkv7YHLJz504rSwMAAMhWthkBrFChgjZt2qSYmBjVrFlTI0aMUGBgoCZPnqzSpUtbXR4AAN5hMAKIm7NNAHzppZd0/vx5SdLQoUPVvHlz1a1bVwUKFNBHH31kcXUAAHiH4WIXMG7ONgGwadOm7j+XLVtWO3bs0KlTpxQZGeneCQwAAGAHtgmA15M/f36rSwAAwLvYBAIT/DoAtmnTxvS5c+fOzcJKAADIJqwBhAl+HQDDw8OtLgEAgOzFGkCY4NcBcNq0aVaXAAAA4HP8OgACAGA7rAGECQRAAAD8CQEQJtjmSSAAAAD4AyOAAAD4E4NNILg52wTA999/X+3atZPT6fRov3z5smbPnq0nnnjCosqQGQ0eb6KGnZqq4B2FJEmHdh3UwnGfasuKjRZXBliH74XNMQUMExyGYY+/KuTKlUtHjhxR4cKFPdpPnjypwoULKz09/bb67VrqUW+Uh9tUuVE1udJdOrbviBwOh2o/0kAPPPWwEh/qr8O7frG6PMASfC9819R9n2b5NS6MftIr/eRNmOKVfuCbbDMCaBjGdR/59ssvv3C/wBxs09L1Hq/nvvFfNXi8icpUvZP/0cG2+F7YHPcBhAl+HwCrVq0qh8Mhh8OhRo0aKXfu//vI6enpSk1N1QMPPGBhhfAWR0CA7n2olpzBQdqz4WerywF8At8LG+JJIDDB7wNgq1atJEkpKSlq2rSp8uXL534vMDBQpUqV0iOPPGJRdfCGYuVL6MW5ryiPM1BpFy7prX+P0OHdjHLA3vheAPg7tlkDOGPGDLVr105BQUG33UdaWprS0tI82p6rGK9cjlyZLQ+ZkCtPbhWILqjg0Lyq/uA/VK9dI73ebgj/s4Ot8b3wTdmyBvD1Ll7pJ+9Anqblz/x+BPCa+Ph4SdL69eu1fft2SdLdd9+tqlWrmu4jOTlZSUlJHm1VwmNVNSLOe4XilqVfuarj+49Kkvb/tFcxlcqqcdcH9f5/JltcGWAdvhf2ZbALGCbYJgAeP35c7du314oVKxQRESFJOn36tBo2bKjZs2erUKFCN+1j0KBBSkhI8Gh7rmJ8VpSLTHAEOJQ7MI/VZQA+he+FjbAJBCbY5kkgzz33nH7//Xdt3bpVp06d0qlTp/TTTz/p7Nmz6tWrl6k+nE6nwsLCPA6mf631yICOurNGrArcUUjFypfQIwM6qvw/7tYP87+zujTAMnwvANyMbUYAFy1apCVLlig2NtbdFhcXp7fffltNmjSxsDJkRliBcHUf/ZzCC0Xq4u8X9MuO/Rr9xHBt+36z1aUBluF7YXPsAoYJtgmALpdLefJknP7IkyePXKyXyLGmDZxodQmAz+F7YXNMAcME20wB//Of/1Tv3r11+PBhd9uhQ4f0/PPPq1GjRhZWBgAAkL1sEwDfeustnT17VqVKlVKZMmVUpkwZxcTE6OzZsxo/frzV5QEA4B0ul3cO+DXbTAEXL15cGzZs0JIlS7Rjxw5JUmxsrBo3bmxxZQAAeBFTwDDBNgFQkhwOh+6//37df//9VpcCAABgGVsFwKVLl2rp0qU6fvx4ho0fU6dOtagqAAC8iF3AMME2ATApKUlDhw5V9erVFRUVJYfDYXVJAAB4H1PAMME2AXDSpEmaPn26/vWvf1ldCgAAgKVsEwAvX76s++67z+oyAADIUjwLGGbY5jYw3bt314cffmh1GQAAZC2X4Z0Dfs02I4CXLl3S5MmTtWTJElWqVCnDU0FGjx5tUWUAAHgR4Q0m2CYAbt68WVWqVJEk/fTTTx7vsSEEAADYiW0C4PLly60uAQCArMdtYGCCbQIgAAC2wBQwTLDNJhAAAAD8gRFAAAD8iMEIIEwgAAIA4E8IgDCBKWAAAACb8esRwM8++8z0uQ8//HAWVgIAQDbhSSAwwa8DYKtWrTxeOxwOGYbh8fqa9PT07CoLAICswxQwTPDrKWCXy+U+vvnmG1WpUkVfffWVTp8+rdOnT+vLL7/UPffco0WLFlldKgAAQLbx6xHAP+vTp48mTZqkOnXquNuaNm2qvHnz6qmnntL27dstrA4AAC9hBBAm+PUI4J/t2bNHERERGdrDw8O1b9++bK8HAICsYBiGV45bkZ6ersGDBysmJkbBwcEqU6aMhg0bdsv9IPvYZgTw3nvvVUJCgmbOnKkiRYpIko4dO6b+/furRo0aFlcHAICXWDAC+Prrr2vixImaMWOG7r77bq1bt05dunRReHi4evXqle314OZsEwCnTp2q1q1bq0SJEipevLgk6eDBgypXrpzmz59vbXEAAORgq1atUsuWLfXQQw9JkkqVKqX//ve/+vHHHy2uDDdimwBYtmxZbd68WYsXL9aOHTskSbGxsWrcuLHHbmAAAHI0C0YA77vvPk2ePFk///yz7rzzTm3atEnff/+9Ro8ene21wBzbBEDpj9u+NGnSRE2aNLG6FAAAsoS3HgWXlpamtLQ0jzan0ymn05nh3BdeeEFnz57VXXfdpVy5cik9PV2vvPKKOnXq5JVa4H1+HQDHjRunp556SkFBQRo3btzfnssaBQAA/k9ycrKSkpI82oYMGaLExMQM53788ceaNWuWPvzwQ919991KSUlRnz59FB0drfj4+GyqGLfCYfjxFp2YmBitW7dOBQoUUExMzA3Pczgc2rt3721do2upR2+3PACAzUzd92mWX+NMfCOv9BM0+UvTI4DFixfXCy+8oJ49e7rbhg8frg8++MC97Aq+xa9HAFNTU6/7ZwAA/JaXngR3o7B3PRcuXFBAgOed5XLlyiUXj6XzWX4dAAEAQNZr0aKFXnnlFZUoUUJ33323Nm7cqNGjR6tr165Wl4Yb8OsAmJCQYPpcdioBAPyBtzaB3Irx48dr8ODB6tGjh44fP67o6Gj9+9//1ssvv5zttcAcvw6AGzdu9Hi9YcMGXb16VeXLl5ck/fzzz8qVK5eqVatmRXkAAHifBQEwNDRUY8eO1dixY7P92rg9fh0Aly9f7v7z6NGjFRoaqhkzZigyMlKS9Ntvv6lLly6qW7euVSUCAABkO9s8C3jUqFFKTk52hz9JioyM1PDhwzVq1CgLKwMAwItcXjrg1/x6BPDPzp49qxMnTmRoP3HihH7//XcLKgIAwPusWAOInMc2I4CtW7dWly5dNHfuXP3yyy/65ZdfNGfOHHXr1k1t2rSxujwAALyDEUCYYJsRwEmTJqlfv37q2LGjrly5IknKnTu3unXrppEjR1pcHQAAQPaxTQDMmzevJkyYoJEjR2rPnj2SpDJlyigkJMTiygAA8B6mgGGGbQLgNSEhIapUqZLVZQAAkDWYvoUJtlkDCAAAgD/YbgQQAAB/ZjACCBMIgAAA+BMCIExgChgAAMBmGAEEAMCPMAUMMwiAAAD4EwIgTGAKGAAAwGYYAQQAwI8wBQwzCIAAAPgRAiDMIAACAOBHCIAwgzWAAAAANsMIIAAA/sRwWF0BcoAcFwBPnz6tiIgIq8sAAMAnMQUMM3x6Cvj111/XRx995H7dtm1bFShQQMWKFdOmTZssrAwAACDn8ukAOGnSJBUvXlyStHjxYi1evFhfffWVmjVrpv79+1tcHQAAvsdwObxywL/59BTw0aNH3QHw888/V9u2bdWkSROVKlVKNWvWtLg6AAB8D1PAMMOnRwAjIyN18OBBSdKiRYvUuHFjSZJhGEpPT7eyNAAAgBzLp0cA27Rpo44dO6pcuXI6efKkmjVrJknauHGjypYta3F1AAD4HoNdwDDBpwPgmDFjVKpUKR08eFAjRoxQvnz5JElHjhxRjx49LK4OAADfwxQwzPDpAJgnTx7169cvQ/vzzz9vQTUAAAD+wecC4GeffWb63IcffjgLKwEAIOdhBy/M8LkA2KpVK1PnORwONoIAAPAXhmF1BcgJfC4AulwsXgAA4HYxAggzfPo2MH926dIlq0sAAADwCz4dANPT0zVs2DAVK1ZM+fLl0969eyVJgwcP1nvvvWdxdQAA+B6eBAIzfDoAvvLKK5o+fbpGjBihwMBAd3uFChX07rvvWlgZAAC+yTC8c8C/+XQAfP/99zV58mR16tRJuXLlcrdXrlxZO3bssLAyAACAnMvnNoH82aFDh677xA+Xy6UrV65YUBEAAL6N6VuY4dMjgHFxcfruu+8ytH/66aeqWrWqBRUBAODbDMPhlQP+zadHAF9++WXFx8fr0KFDcrlcmjt3rnbu3Kn3339fn3/+udXlAQAA5Eg+PQLYsmVLLVy4UEuWLFFISIhefvllbd++XQsXLtT9999vdXkAAPgcw+WdA/7Np0cAJalu3bpavHix1WUAAJAjuJi+hQk+HwAlad26ddq+fbukP9YFVqtWzeKKAAAAci6fDoC//PKLOnTooP/973+KiIiQJJ0+fVr33XefZs+erTvuuMPaAgEA8DFs4IAZPr0GsHv37rpy5Yq2b9+uU6dO6dSpU9q+fbtcLpe6d+9udXkAAPgcngQCM3x6BPDbb7/VqlWrVL58eXdb+fLlNX78eNWtW9fCygAA8E08xQNm+PQIYPHixa97w+f09HRFR0dbUBEAAEDO59MBcOTIkXruuee0bt06d9u6devUu3dvvfHGGxZWBgCAb2IKGGb43BRwZGSkHI7/+xfv/PnzqlmzpnLn/qPUq1evKnfu3OratatatWplUZUAAPgmbgMDM3wuAI4dO9bqEgAAAPyazwXA+Ph4q0sAACDH4jYwMMPnAuCNXLp0SZcvX/ZoCwsLs6gaAAB8E7uAYYZPbwI5f/68nn32WRUuXFghISGKjIz0OAAAAHDrfDoADhgwQMuWLdPEiRPldDr17rvvKikpSdHR0Xr//fetLg8AAJ/jMhxeOeDffDoALly4UBMmTNAjjzyi3Llzq27dunrppZf06quvatasWVaXBwCAzzEMh1eOW3Xo0CE9/vjjKlCggIKDg1WxYkWP27jBt/h0ADx16pRKly4t6Y/1fqdOnZIk1alTRytXrrSyNAAA8P/99ttvql27tvLkyaOvvvpK27Zt06hRo1iu5cN8ehNI6dKllZqaqhIlSuiuu+7Sxx9/rBo1amjhwoWKiIiwujwAAHyOFZtAXn/9dRUvXlzTpk1zt8XExGR/ITDNp0cAu3Tpok2bNkmSXnjhBb399tsKCgrS888/r/79+1tcHQAAvsdbawDT0tJ09uxZjyMtLe261/zss89UvXp1PfbYYypcuLCqVq2qKVOmZPMnx61wGEbO2TC+f/9+rV+/XmXLllWlSpWsLkeSlDuwmNUlAD7n4uHvrC4B8El5CpbO8musLdbaK/188WRlJSUlebQNGTJEiYmJGc4NCgqSJCUkJOixxx7T2rVr1bt3b02aNIn7+/qoHBUAfREBEMiIAAhcX04KgJX2zs4w4ud0OuV0OjOcGxgYqOrVq2vVqlXutl69emnt2rVavXq1V+qBd/ncGsBx48aZPrdXr15ZWAkAADmPt27hcqOwdz1RUVGKi4vzaIuNjdWcOXO8Ugu8z+cC4JgxY0yd53A4CIAAAPyFFdN6tWvX1s6dOz3afv75Z5UsWdKCamCGzwXA1NRUq0sAAAC34Pnnn9d9992nV199VW3bttWPP/6oyZMna/LkyVaXhhvwuQAIAABunxVP8bj33ns1b948DRo0SEOHDlVMTIzGjh2rTp06ZXstMIcACACAH7mdp3h4Q/PmzdW8eXNLro1b59P3AQQAAID3MQIIAIAfcVldAHIEAiAAAH7EkDVTwMhZfH4K+LvvvtPjjz+uWrVq6dChQ5KkmTNn6vvvv7e4MgAAgJzJpwPgnDlz1LRpUwUHB2vjxo3uO5KfOXNGr776qsXVAQDge1yGdw74N58OgMOHD9ekSZM0ZcoU5cmTx91eu3ZtbdiwwcLKAADwTS45vHLAv/n0GsCdO3eqXr16GdrDw8N1+vTp7C8IAAAfxxpAmOHTI4BFixbV7t27M7R///33Kl066x+oDQAA4I98OgA++eST6t27t9asWSOHw6HDhw9r1qxZ6tevn5555hmrywMAwOe4vHTAv/n0FPALL7wgl8ulRo0a6cKFC6pXr56cTqf69eun5557zuryAADwOUwBwwyHYRg+v9fn8uXL2r17t86dO6e4uDjly5fP6pLccgcWs7oEwOdcPPyd1SUAPilPwaxfvvRNkfZe6afJsdle6Qe+yadHAK8JDAxUXFyc1WUAAODzmL6FGT4dABs2bCiH48ZD2cuWLcvGagAA8H0EQJjh0wGwSpUqHq+vXLmilJQU/fTTT4qPj7emKAAAgBzOpwPgmDFjrtuemJioc+fOZXM1AAD4PjaBwAyfvg3MjTz++OOaOnWq1WUAAOBzXA7vHPBvOTIArl69WkFBQVaXAQAAkCP59BRwmzZtPF4bhqEjR45o3bp1Gjx4sEVVAQDgu3iOL8zw6QAYHh7u8TogIEDly5fX0KFD1aRJE4uqAgDAd/n8zX3hE3w2AKanp6tLly6qWLGiIiMjrS4HAIAcgdvAwAyfXQOYK1cuNWnSRKdPn7a6FAAAAL/iswFQkipUqKC9e/daXQYAADmGy+HwygH/5tMBcPjw4erXr58+//xzHTlyRGfPnvU4AACAJ8NLB/ybT64BHDp0qPr27asHH3xQkvTwww97PBLOMAw5HA6lp6dbVSIAAECO5ZMBMCkpSU8//bSWL19udSkAAOQobAKBGT4ZAA3jj8Hn+vXrW1wJAAA5C0/xgBk+uwbQwQJUAACALOGTI4CSdOedd940BJ46dSqbqgEAIGfgSSAww2cDYFJSUoYngQAAgL/HDl6Y4bMBsH379ipcuLDVZQAAkKOwBhBm+OQaQNb/AQAAZB2fHAG8tgsYAADcGm4DAzN8MgC6XPzrCwDA7WAIBWb45BQwAAAAso5PjgACAIDbwyYQmEEABADAj7CICmYwBQwAAGAzjAACAOBHGAGEGQRAAAD8iMEaQJjAFDAAAIDNMAIIAIAfYQoYZhAAAQDwIwRAmEEABADAj/AkEJjBGkAAAACbYQQQAAA/wpNAYAYBEAAAP8IaQJjBFDAAAIDNMAIIAIAfYQQQZhAAAQDwI+wChhlMAQMAANgMI4AAAPgRdgHDDEYAAQDwIy4vHbfrtddek8PhUJ8+fTLRC7IaARAAAHjF2rVr9c4776hSpUpWl4KbIAACAOBHDC8dt+rcuXPq1KmTpkyZosjIyMx+DGQxAiAAAH7EJcMrR1pams6ePetxpKWl3fC6PXv21EMPPaTGjRtn46fF7SIAAgDgR7y1BjA5OVnh4eEeR3Jy8nWvOXv2bG3YsOGG78P3sAsYAABkMGjQICUkJHi0OZ3ODOcdPHhQvXv31uLFixUUFJRd5SGTCIAAAPgRb90I2ul0Xjfw/dX69et1/Phx3XPPPe629PR0rVy5Um+99ZbS0tKUK1cuL1UFbyEAAgDgR7L7UXCNGjXSli1bPNq6dOmiu+66SwMHDiT8+SgCIAAAuG2hoaGqUKGCR1tISIgKFCiQoR2+gwAIAIAf4UkgMIMACACAH3F5bRXg7VuxYoXVJeAmuA0MAACAzTACCACAH7F+/A85AQEQAAA/kt27gJEzMQUMAABgM7YYAdy8ebPpcytVqpSFlQAAkLV8YRMIfJ8tAmCVKlXkcDhkGIYcjr/fH5+enp5NVQEA4H3EP5hhiyng1NRU7d27V6mpqZozZ45iYmI0YcIEbdy4URs3btSECRNUpkwZzZkzx+pSAQDIFJeXDvg3W4wAlixZ0v3nxx57TOPGjdODDz7obqtUqZKKFy+uwYMHq1WrVhZUCAAAkH1sEQD/bMuWLYqJicnQHhMTo23btllQEQAA3sMaQJhhiyngP4uNjVVycrIuX77sbrt8+bKSk5MVGxtrYWUAAGSe4aUD/s12I4CTJk1SixYtdMcdd7h3/G7evFkOh0MLFy60uDoAAICsZ7sAWKNGDe3du1ezZs3Sjh07JEnt2rVTx44dFRISYnF1AABkDhs4YIbtAqAkhYSE6KmnnrK6DAAAvM5gAhcm2G4NoCTNnDlTderUUXR0tPbv3y9JGjNmjBYsWGBxZQAAAFnPdgFw4sSJSkhIULNmzfTbb7+5b/wcGRmpsWPHWlscAACZxH0AYYbtAuD48eM1ZcoUvfjii8qd+/9mwKtXr64tW7ZYWBkAAJnnkuGVA/7NdgEwNTVVVatWzdDudDp1/vx5CyoCAADIXrYLgDExMUpJScnQvmjRIu4DCADI8bgPIMyw3S7ghIQE9ezZU5cuXZJhGPrxxx/13//+V8nJyXr33XetLg+36Zmn49U34RkVLVpImzdvU+8+g7V2XYrVZQHZYl3KFk378FNt27FbJ06e0pvJg9Wo3n2SpCtXr2r85Bn6bvU6/XL4iPKFhOgf91bV8093UeFCBSyuHFmB6VuYYbsA2L17dwUHB+ull17ShQsX1LFjR0VHR+vNN99U+/btrS4Pt+Gxxx7WGyOHqEfPF/Tj2o3q9Vx3ffnFLMVVqKcTJ05aXR6Q5S5evKTyZUur9UNN1Oc/wz3eu3QpTdt27tG/O3dQ+bKldfb33/Xam+/o2YFJ+njqOIsqRlZiAwfMcBiGYdu/Kly4cEHnzp1T4cKFb7uP3IHFvFgRbseq7xdq7bpN6t3nJUmSw+HQvr1r9faEaRox8m2Lq7Oni4e/s7oE26pQu5nHCOD1bNm+Ux2699HiOTMUVfT2//uHW5enYOksv8aTpR7zSj9T9n3ilX7gm2y3BvDP8ubNm6nwB+vlyZNH99xTSUuX/V/gMAxDS5d9r3/8o5qFlQG+69y5C3I4HAoN5elH/sjw0j/wb7aYAq5ataocDoepczds2JDF1cCbChbMr9y5c+v4sV892o8fP6G7ypexqCrAd6WlXdaYiVP1YOP6ysfjL/0SU8AwwxYBsFWrVu4/X7p0SRMmTFBcXJxq1aolSfrhhx+0detW9ejR42/7SUtLU1pamkebYRimwyUAWOnK1avqO/hVGYahwf2ftbocABayRQAcMmSI+8/du3dXr169NGzYsAznHDx48G/7SU5OVlJSkkebIyCfHLnCvFcsbsmvv57S1atXVbhIQY/2woUL6eixExZVBfiea+Hv8LHjmjruNUb//BjTtzDDdmsAP/nkEz3xxBMZ2h9//HHNmTPnb3920KBBOnPmjMfhCAjNqlJhwpUrV7Rhw2b9s2Edd5vD4dA/G9bRDz+st7AywHdcC38HDh7Wu2NfVUQ4f2n1ZzwKDmbYYgTwz4KDg/W///1P5cqV82j/3//+p6CgoL/9WafTKafT6dHG9K/1xrw5RdPeG6P1GzZr7dqN6vXckwoJCdb0GR9ZXRqQLS5cuKgDvxx2vz50+Jh2/LxH4WGhKlgwvxJefEXbft6tt0ckyeVy6deTpyRJ4WGhypMnj1VlA7CQ7QJgnz599Mwzz2jDhg2qUaOGJGnNmjWaOnWqBg8ebHF1uB2ffPKZChXMr8SX+6lo0ULatGmrHmr+uI4f//XmPwz4gZ927FLX5wa6X48YP1mS1LJZY/Xo9riWf/+DJOnRzj09fm7q+NdV455K2VcosoXLvnd3wy2w5X0AP/74Y7355pvavn27JCk2Nla9e/dW27Ztb7kv7gMIZMR9AIHry477AD5eso1X+vlg/1yv9APfZLsRQElq27btbYU9AAAAf2DLAChJly9f1vHjx+VyeS51LVGihEUVAQCQeTwLGGbYLgDu2rVLXbt21apVqzzar93PLz093aLKAADIPG4DAzNsFwA7d+6s3Llz6/PPP1dUVBS7eAEAfoVbuMAM2wXAlJQUrV+/XnfddZfVpQAAAFjCdgEwLi5Ov/7K7UEAAP6JNYAww3ZPAnn99dc1YMAArVixQidPntTZs2c9DgAAcjLDS//Av9luBLBx48aSpEaNGnm0swkEAADYhe0C4PLly60uAQCALMMmEJhhuwBYv359q0sAACDL2PABX7gNtguA11y4cEEHDhzQ5cuXPdorVeK5mAAAwL/ZLgCeOHFCXbp00VdffXXd91kDCADIydgFDDNstwu4T58+On36tNasWaPg4GAtWrRIM2bMULly5fTZZ59ZXR4AAJni8tIB/2a7EcBly5ZpwYIFql69ugICAlSyZEndf//9CgsLU3Jysh566CGrSwQAAMhSthsBPH/+vAoXLixJioyM1IkTJyRJFStW1IYNG6wsDQCATOM+gDDDdgGwfPny2rlzpySpcuXKeuedd3To0CFNmjRJUVFRFlcHAEDmuGR45YB/s90UcO/evXXkyBFJ0pAhQ/TAAw/ogw8+UGBgoGbMmGFxdQAAZA63gYEZtguAjz/+uPvP1apV0/79+7Vjxw6VKFFCBQsWtLAyAACA7GGLAJiQkGD63NGjR2dhJQAAZC128MIMWwTAjRs3mjrP4XBkcSUAAGQtNnDADFsEQJ7/CwAA8H9stwsYAAB/ZsUu4OTkZN17770KDQ1V4cKF1apVK/cdN+CbCIAAAPgRwzC8ctyKb7/9Vj179tQPP/ygxYsX68qVK2rSpInOnz+fRZ8SmWWLKWAAAJB1Fi1a5PF6+vTpKly4sNavX6969epZVBX+DgEQAAA/4gs3cT5z5owkKX/+/BZXghshAAIA4Ee8tQs4LS1NaWlpHm1Op1NOp/Nvf87lcqlPnz6qXbu2KlSo4JVa4H2sAQQAABkkJycrPDzc40hOTr7pz/Xs2VM//fSTZs+enQ1V4nY5DJ4Zkym5A4tZXQLgcy4e/s7qEgCflKdg6Sy/Rr1ijbzSz+K9X97yCOCzzz6rBQsWaOXKlYqJifFKHcgaTAEDAOBHvDWqY2a6131Nw9Bzzz2nefPmacWKFYS/HIAACACAH7FiE0jPnj314YcfasGCBQoNDdXRo0clSeHh4QoODs72enBzrAEEAACZMnHiRJ05c0YNGjRQVFSU+/joo4+sLg03wAggAAB+xIoRQLYT5DwEQAAA/AhhDGYwBQwAAGAzjAACAOBHfOFJIPB9BEAAAPyIt54EAv/GFDAAAIDNMAIIAIAfYRMIzCAAAgDgR1gDCDOYAgYAALAZRgABAPAjTAHDDAIgAAB+hClgmEEABADAj3AbGJjBGkAAAACbYQQQAAA/4mINIEwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EaaAYQYBEAAAP8IUMMxgChgAAMBmGAEEAMCPMAUMMwiAAAD4EaaAYQZTwAAAADbDCCAAAH6EKWCYQQAEAMCPMAUMMwiAAAD4EcNwWV0CcgDWAAIAANgMI4AAAPgRF1PAMIEACACAHzHYBAITmAIGAACwGUYAAQDwI0wBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAf4UkgMIMACACAH+FJIDCDKWAAAACbYQQQAAA/wiYQmEEABADAj3AbGJhBAAQAwI8wAggzWAMIAABgM4wAAgDgR7gNDMwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EXYBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAfYRcwzCAAAgDgRwzWAMIEpoABAABshhFAAAD8CFPAMIMACACAH2EXMMwgAAIA4EdYAwgzWAMIAABgMwRAAAD8iGEYXjlux9tvv61SpUopKChINWvW1I8//ujlTwdvIQACAOBHrAqAH330kRISEjRkyBBt2LBBlStXVtOmTXX8+PEs+JTILAIgAADItNGjR+vJJ59Uly5dFBcXp0mTJilv3ryaOnWq1aXhOgiAAAD4EcNLR1pams6ePetxpKWlXfealy9f1vr169W4cWN3W0BAgBo3bqzVq1dnzQdFprALOJOuXj5kdQnQH/+hSk5O1qBBg+R0Oq0uB/AZfDfsx1v/X0pMTFRSUpJH25AhQ5SYmJjh3F9//VXp6ekqUqSIR3uRIkW0Y8cOr9QD73IY3DAIfuDs2bMKDw/XmTNnFBYWZnU5gM/gu4HblZaWlmHEz+l0XvcvEocPH1axYsW0atUq1apVy90+YMAAffvtt1qzZk2W14tbwwggAADI4EZh73oKFiyoXLly6dixYx7tx44dU9GiRbOiPGQSawABAECmBAYGqlq1alq6dKm7zeVyaenSpR4jgvAdjAACAIBMS0hIUHx8vKpXr64aNWpo7NixOn/+vLp06WJ1abgOAiD8gtPp1JAhQ1jkDvwF3w1kl3bt2unEiRN6+eWXdfToUVWpUkWLFi3KsDEEvoFNIAAAADbDGkAAAACbIQACAADYDAEQAADAZgiAyJQGDRqoT58+7telSpXS2LFj//ZnHA6H5s+fn6V1mdW5c2e1atUqy68zffp0RUREZPl14N/++n3LComJiapSpUqWXgOA9dgFDK9au3atQkJCrC5DiYmJmj9/vlJSUqwuBQAAn0MAhFcVKlTI6hIAAMBNMAUM086fP68nnnhC+fLlU1RUlEaNGpXhnL9OAe/atUv16tVTUFCQ4uLitHjx4ptep0GDBurVq5cGDBig/Pnzq2jRohkePn7gwAG1bNlS+fLlU1hYmNq2bet+BNH06dOVlJSkTZs2yeFwyOFwaPr06aY+46JFi1SnTh1FRESoQIECat68ufbs2eN+f9++fXI4HJo7d64aNmyovHnzqnLlylq9erVHP9OnT1eJEiWUN29etW7dWidPnjR1fcCsmTNnqnr16goNDVXRokXVsWNHHT9+3P3+ihUr5HA4tHTpUlWvXl158+bVfffdp507d3r089prr6lIkSIKDQ1Vt27ddOnSpez+KAAsQACEaf3799e3336rBQsW6JtvvtGKFSu0YcOGG57vcrnUpk0bBQYGas2aNZo0aZIGDhxo6lozZsxQSEiI1qxZoxEjRmjo0KHu8OhyudSyZUudOnVK3377rRYvXqy9e/eqXbt2kv64GWnfvn11991368iRIzpy5Ij7vZs5f/68EhIStG7dOi1dulQBAQFq3bq1XC6Xx3kvvvii+vXrp5SUFN15553q0KGDrl69Kklas2aNunXrpmeffVYpKSlq2LChhg8fbur6gFlXrlzRsGHDtGnTJs2fP1/79u1T586dM5z34osvatSoUVq3bp1y586trl27ut/7+OOPlZiYqFdffVXr1q1TVFSUJkyYkI2fAoBlDMCE33//3QgMDDQ+/vhjd9vJkyeN4OBgo3fv3u62kiVLGmPGjDEMwzC+/vprI3fu3MahQ4fc73/11VeGJGPevHk3vFb9+vWNOnXqeLTde++9xsCBAw3DMIxvvvnGyJUrl3HgwAH3+1u3bjUkGT/++KNhGIYxZMgQo3Llyjf9XPHx8UbLli1v+P6JEycMScaWLVsMwzCM1NRUQ5Lx7rvvZrj29u3bDcMwjA4dOhgPPvigRz/t2rUzwsPDb1oP8Hfq16/v8X37s7Vr1xqSjN9//90wDMNYvny5IclYsmSJ+5wvvvjCkGRcvHjRMAzDqFWrltGjRw+PfmrWrGnquwMgZ2MEEKbs2bNHly9fVs2aNd1t+fPnV/ny5W/4M9u3b1fx4sUVHR3tbjP7UPBKlSp5vI6KinJPb13rt3jx4u734+LiFBERoe3bt5vq/0Z27dqlDh06qHTp0goLC1OpUqUk/THlfKP6oqKiJMmjvj//niTznxswa/369WrRooVKlCih0NBQ1a9fXxL/rgIwhwAIn5QnTx6P1w6HI8M0bFZo0aKFTp06pSlTpmjNmjVas2aNJOny5cs3rM/hcEhSttQHSH8sVWjatKnCwsI0a9YsrV27VvPmzZPEv6sAzCEAwpQyZcooT5487kAkSb/99pt+/vnnG/5MbGysDh48qCNHjrjbfvjhh0zXcq3fgwcPutu2bdum06dPKy4uTpIUGBio9PT0W+r35MmT2rlzp1566SU1atRIsbGx+u23326rvj//niTvfG7gmh07dujkyZN67bXXVLduXd11110eG0DM4t9VwL64DQxMyZcvn7p166b+/furQIECKly4sF588UUFBNz47xCNGzfWnXfeqfj4eI0cOVJnz57Viy++mOlaGjdurIoVK6pTp04aO3asrl69qh49eqh+/fqqXr26pD92I6empiolJUV33HGHQkND5XQ6/7bfyMhIFShQQJMnT1ZUVJQOHDigF1544Zbr69Wrl2rXrq033nhDLVu21Ndff61Fixbd1mcFrqdEiRIKDAzU+PHj9fTTT+unn37SsGHDbrmf3r17q3Pnzqpevbpq166tWbNmaevWrSpdunQWVA3AlzACCNNGjhypunXrqkWLFmrcuLHq1KmjatWq3fD8gIAAzZs3TxcvXlSNGjXUvXt3vfLKK5muw+FwaMGCBYqMjFS9evXUuHFjlS5dWh999JH7nEceeUQPPPCAGjZsqEKFCum///3vTfsNCAjQ7NmztX79elWoUEHPP/+8Ro4cecv1/eMf/9CUKVP05ptvqnLlyvrmm2/00ksv3XI/wI0UKlRI06dP1yeffKK4uDi99tpreuONN265n3bt2mnw4MEaMGCAqlWrpv379+uZZ57JgooB+BqHYRiG1UUAAAAg+zACCAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAZvo3LmzWrVq5X7doEED9enTJ9vrWLFihRwOh06fPn3DcxwOh+bPn2+6z8TERFWpUiVTde3bt08Oh0MpKSmZ6gcAcgICIGChzp07y+FwyOFwKDAwUGXLltXQoUN19erVLL/23LlzTT8+zExoAwDkHDwLGLDYAw88oGnTpiktLU1ffvmlevbsqTx58mjQoEEZzr18+bICAwO9ct38+fN7pR8AQM7DCCBgMafTqaJFi6pkyZJ65pln1LhxY3322WeS/m/a9pVXXlF0dLTKly8vSTp48KDatm2riIgI5c+fXy1bttS+ffvcfaanpyshIUEREREqUKCABgwYoL8+9fGvU8BpaWkaOHCgihcvLqfTqbJly+q9997Tvn371LBhQ0lSZGSkHA6HOnfuLElyuVxKTk5WTEyMgoODVblyZX366ace1/nyyy915513Kjg4WA0bNvSo06yBAwfqzjvvVN68eVW6dGkNHjxYV65cyXDeO++8o+LFiytv3rxq27atzpw54/H+u+++q9jYWAUFBemuu+7ShAkTbnjN3377TZ06dVKhQoUUHByscuXKadq0abdcOwD4IkYAAR8THByskydPul8vXbpUYWFhWrx4sSTpypUratq0qWrVqqXvvvtOuXPn1vDhw/XAAw9o8+bNCgwM1KhRozR9+nRNnTpVsbGxGjVqlObNm6d//vOfN7zuE088odWrV2vcuHGqXLmyUlNT9euvv6p48eKaM2eOHnnkEe3cuVNhYWEKDg6WJCUnJ+uDDz7QpEmTVK5cOa1cuVKPP/64ChUqpPr16+vgwYNq06aNevbsqaeeekrr1q1T3759b/l3EhoaqunTpys6OlpbtmzRk08+qdDQUA0YMMB9zu7du/Xxxx9r4cKFOnv2rLp166YePXpo1qxZkqRZs2bp5Zdf1ltvvaWqVatq48aNevLJJxUSEqL4+PgM1xw8eLC2bdumr776SgULFtTu3bt18eLFW64dAHySAcAy8fHxRsuWLQ3DMAyXy2UsXrzYcDqdRr9+/dzvFylSxEhLS3P/zMyZM43y5csbLpfL3ZaWlmYEBwcbX3/9tWEYhhEVFWWMGDHC/f6VK1eMO+64w30twzCM+vXrG7179zYMwzB27txpSDIWL1583TqXL19uSDJ+++03d9ulS5eMvHnzGqtWrfI4t1u3bkaHDh0MwzCMQYMGGXFxcR7vDxw4MENffyXJmDdv3g3fHzlypFGtWjX36yFDhhi5cuUyfvnlF3fbV199ZQQEBBhHjhwxDMMwypQpY3z44Yce/QwbNsyoVauWYRiGkZqaakgyNm7caBiGYbRo0cLo0qXLDWsAgJyMEUDAYp9//rny5cunK1euyOVyqWPHjkpMTHS/X7FiRY91f5s2bdLu3bsVGhrq0c+lS5e0Z88enTlzRkeOHFHNmjXd7+XOnVvVq1fPMA18TUpKinLlyqX69eubrnv37t26cOGC7r//fo/2y5cvq2rVqpKk7du3e9QhSbVq1TJ9jWs++ugjjRs3Tnv27NG5c+d09epVhYWFeZxTokQJFStWzOM6LpdLO3fuVGhoqPbs2aNu3brpySefdJ9z9epVhYeHX/eazzzzjB555BFt2LBBTZo0UatWrXTffffdcu0A4IsIgIDFGjZsqIkTJyowMFDR0dHKndvzaxkSEuLx+ty5c6pWrZp7avPPChUqdFs1XJvSvRXnzp2TJH3xxRcewUv6Y12jt6xevVqdOnVSUlKSmjZtqvDwcM2ePVujRo265VqnTJmSIZDmypXruj/TrFkz7d+/X19++aUWL16sRo0aqWfPnnrjjTdu/8MAgI8gAAIWCwkJUdmyZU2ff8899+ijjz5S4cKFM4yCXRMVFaU1a9aoXr16kv4Y6Vq/fr3uueee655fsWJFuVwuffvtt2rcuHGG96+NQKanp7vb4uLi5HQ6deDAgRuOHMbGxro3tFzzww8/3PxD/smqVatUsmRJvfjii+62/fv3ZzjvwIEDOnz4sKKjo93XCQgIUPny5VWkSBFFR0dr79696tSpk+lrFypUSPHx8YqPj1fdunXVv39/AiAAv8AuYCCH6dSpkwoWLKiWLVvqu+++U2pqqlasWKFevXrpl19+kST17t1br732mubPn68dO3aoR48ef3sPv1KlSik+Pl5du3bV/Pnz3X1+/PHHkqSSJUvK4XDo888/14kTJ3Tu3DmFhoaqX79+ev755zVjxgzt2bNHGzZs0Pjx4zVjxgxJ0tNPP61du3apf//+2rlzpz788ENNnz79lj5vuXLldODAAc2ePVt79uzRuHHjNG/evAznBQUFKT4+Xps2bdJ3332nXr16qW3btipatKgkKSkpScnJyRo3bpx+/vlnbdmyRdOmTdPo0aOve92XX35ZCxYs0O7du7V161Z9/vnnio2NvaXaAcBXEQCBHCZv3rxauXKlSpQooTZt2ig2NlbdunXTpUuX3COCffv21b/+9S/Fx8erVq1aCg0NVevWrf+234kTJ+rRRx9Vjx49dNddd+nJJ5/U+fPnJUnFihVTUlKSXnjhBRUpUkTPPvusJGnYsGEaPHiwkpOTFRsbqwceeEBffPGFYmJiJP2xLm/OnDmaP3++KleurEmTJunVV1+9pc/78MMP6/nnn9ezzz6rKlWqaNWqVRo8eHCG88qWLas2bdrowQcfVJMmTVSpUiWP27x0795d7777rqZNm6aKFSuqfv36mj59urvWvwoMDNSgQYNUqVIl1atXT7ly5dLs2bNvqXYA8FUO40arwgEAAOCXGAEEAACwGQIgAACAzRAAAQAAbIYACAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAQAAbIYACAAAYDP/D32GkVATVcrxAAAAAElFTkSuQmCC"}, "metadata": {}}], "id": "2f45fbab-8fcb-4973-9aef-d1980e5283c8"}, {"cell_type": "markdown", "source": "## TASK  8\n", "metadata": {}, "id": "76e0b51a-3ccd-49d4-a214-6ef189aedc2f"}, {"cell_type": "markdown", "source": "Create a decision tree classifier object then  create a  <code>GridSearchCV</code> object  <code>tree_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n", "metadata": {}, "id": "1a136130-54e9-40d3-b775-758f69b30bf1"}, {"cell_type": "code", "source": "parameters = {'criterion': ['gini', 'entropy'],\n     'splitter': ['best', 'random'],\n     'max_depth': [2*n for n in range(1,10)],\n     'max_features': ['auto', 'sqrt'],\n     'min_samples_leaf': [1, 2, 4],\n     'min_samples_split': [2, 5, 10]}\n\ntree = DecisionTreeClassifier()", "metadata": {}, "execution_count": 30, "outputs": [], "id": "d85a7713-82bc-4857-9a18-56f2f425abcc"}, {"cell_type": "code", "source": "tree_cv=GridSearchCV(tree,parameters,cv=10)\ntree_cv.fit(X_train,Y_train)", "metadata": {}, "execution_count": 31, "outputs": [{"execution_count": 31, "output_type": "execute_result", "data": {"text/plain": "GridSearchCV(cv=10, estimator=DecisionTreeClassifier(),\n             param_grid={'criterion': ['gini', 'entropy'],\n                         'max_depth': [2, 4, 6, 8, 10, 12, 14, 16, 18],\n                         'max_features': ['auto', 'sqrt'],\n                         'min_samples_leaf': [1, 2, 4],\n                         'min_samples_split': [2, 5, 10],\n                         'splitter': ['best', 'random']})"}, "metadata": {}}], "id": "966e2a3f-d15a-4940-99cf-e9b3bc1b7df4"}, {"cell_type": "code", "source": "print(\"tuned hpyerparameters :(best parameters) \",tree_cv.best_params_)\nprint(\"accuracy :\",tree_cv.best_score_)", "metadata": {}, "execution_count": 32, "outputs": [{"name": "stdout", "text": "tuned hpyerparameters :(best parameters)  {'criterion': 'entropy', 'max_depth': 10, 'max_features': 'auto', 'min_samples_leaf': 2, 'min_samples_split': 10, 'splitter': 'random'}\naccuracy : 0.8875\n", "output_type": "stream"}], "id": "4c26b867-0f93-4713-bd7c-9bdef8dea18f"}, {"cell_type": "markdown", "source": "## TASK  9\n", "metadata": {}, "id": "1a845437-17f0-4bd4-8e9a-06f30ef827bf"}, {"cell_type": "markdown", "source": "Calculate the accuracy of tree_cv on the test data using the method <code>score</code>:\n", "metadata": {}, "id": "60d92686-3013-45bf-9983-9bd33aa530f2"}, {"cell_type": "code", "source": "print('Accuracy on test data is:{:.3f}'.format(tree_cv.score(X_test, Y_test)))", "metadata": {}, "execution_count": 33, "outputs": [{"name": "stdout", "text": "Accuracy on test data is:0.944\n", "output_type": "stream"}], "id": "55003514-94f0-459a-a6eb-093f1c5f9f05"}, {"cell_type": "markdown", "source": "We can plot the confusion matrix\n", "metadata": {}, "id": "78fb6d64-6239-4783-8974-23606d5754c0"}, {"cell_type": "code", "source": "yhat = svm_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)", "metadata": {}, "execution_count": 34, "outputs": [{"output_type": "display_data", "data": {"text/plain": "<pyolite.display.Image at 0x65fb3c0>", "image/png": "iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/YYfK9AAAACXBIWXMAAA9hAAAPYQGoP6dpAABHB0lEQVR4nO3dd3gU5f7+8XsDZBNCGj1BSihiIlUQDtIPCKIgRaV6DE2PggKGJkeRBNAoSBEUEJQi4sFCEwtKFT0g0gJIkxKKdEFAWoDs/P7wx35dAzKQTWaz8355zXWxz06e+WwuV2+eMuMwDMMQAAAAbCPA6gIAAACQvQiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABPzArl271KRJE4WHh8vhcGj+/Ple7X/fvn1yOByaPn26V/vNyRo0aKAGDRpYXQYA3BYCIOAle/bs0b///W+VLl1aQUFBCgsLU+3atfXmm2/q4sWLWXrt+Ph4bdmyRa+88opmzpyp6tWrZ+n1slPnzp3lcDgUFhZ23d/jrl275HA45HA49MYbb9xy/4cPH1ZiYqJSUlK8UC0A5Ay5rS4A8AdffPGFHnvsMTmdTj3xxBOqUKGCLl++rO+//179+/fX1q1bNXny5Cy59sWLF7V69Wq9+OKLevbZZ7PkGiVLltTFixeVJ0+eLOn/ZnLnzq0LFy5o4cKFatu2rcd7s2bNUlBQkC5dunRbfR8+fFhJSUkqVaqUqlSpYvrnvvnmm9u6HgD4AgIgkEmpqalq3769SpYsqWXLlikqKsr9Xs+ePbV792598cUXWXb9EydOSJIiIiKy7BoOh0NBQUFZ1v/NOJ1O1a5dW//9738zBMAPP/xQDz30kObMmZMttVy4cEF58+ZVYGBgtlwPALICU8BAJo0YMULnzp3Te++95xH+rilbtqx69+7tfn316lUNGzZMZcqUkdPpVKlSpfSf//xHaWlpHj9XqlQpNW/eXN9//71q1KihoKAglS5dWu+//777nMTERJUsWVKS1L9/fzkcDpUqVUrSH1On1/78Z4mJiXI4HB5tixcvVp06dRQREaF8+fKpfPny+s9//uN+/0ZrAJctW6a6desqJCREERERatmypbZv337d6+3evVudO3dWRESEwsPD1aVLF124cOHGv9i/6Nixo7766iudPn3a3bZ27Vrt2rVLHTt2zHD+qVOn1K9fP1WsWFH58uVTWFiYmjVrpk2bNrnPWbFihe69915JUpcuXdxTydc+Z4MGDVShQgWtX79e9erVU968ed2/l7+uAYyPj1dQUFCGz9+0aVNFRkbq8OHDpj8rAGQ1AiCQSQsXLlTp0qV13333mTq/e/fuevnll3XPPfdozJgxql+/vpKTk9W+ffsM5+7evVuPPvqo7r//fo0aNUqRkZHq3Lmztm7dKklq06aNxowZI0nq0KGDZs6cqbFjx95S/Vu3blXz5s2VlpamoUOHatSoUXr44Yf1v//9729/bsmSJWratKmOHz+uxMREJSQkaNWqVapdu7b27duX4fy2bdvq999/V3Jystq2bavp06crKSnJdJ1t2rSRw+HQ3Llz3W0ffvih7rrrLt1zzz0Zzt+7d6/mz5+v5s2ba/To0erfv7+2bNmi+vXru8NYbGyshg4dKkl66qmnNHPmTM2cOVP16tVz93Py5Ek1a9ZMVapU0dixY9WwYcPr1vfmm2+qUKFCio+PV3p6uiTpnXfe0TfffKPx48crOjra9GcFgCxnALhtZ86cMSQZLVu2NHV+SkqKIcno3r27R3u/fv0MScayZcvcbSVLljQkGStXrnS3HT9+3HA6nUbfvn3dbampqYYkY+TIkR59xsfHGyVLlsxQw5AhQ4w/f/XHjBljSDJOnDhxw7qvXWPatGnutipVqhiFCxc2Tp486W7btGmTERAQYDzxxBMZrte1a1ePPlu3bm0UKFDghtf88+cICQkxDMMwHn30UaNRo0aGYRhGenq6UbRoUSMpKem6v4NLly4Z6enpGT6H0+k0hg4d6m5bu3Zths92Tf369Q1JxqRJk677Xv369T3avv76a0OSMXz4cGPv3r1Gvnz5jFatWt30MwJAdmMEEMiEs2fPSpJCQ0NNnf/ll19KkhISEjza+/btK0kZ1grGxcWpbt267teFChVS+fLltXfv3tuu+a+urR1csGCBXC6XqZ85cuSIUlJS1LlzZ+XPn9/dXqlSJd1///3uz/lnTz/9tMfrunXr6uTJk+7foRkdO3bUihUrdPToUS1btkxHjx697vSv9Me6wYCAP/4Tl56erpMnT7qntzds2GD6mk6nU126dDF1bpMmTfTvf/9bQ4cOVZs2bRQUFKR33nnH9LUAILsQAIFMCAsLkyT9/vvvps7fv3+/AgICVLZsWY/2okWLKiIiQvv37/doL1GiRIY+IiMj9dtvv91mxRm1a9dOtWvXVvfu3VWkSBG1b99eH3/88d+GwWt1li9fPsN7sbGx+vXXX3X+/HmP9r9+lsjISEm6pc/y4IMPKjQ0VB999JFmzZqle++9N8Pv8hqXy6UxY8aoXLlycjqdKliwoAoVKqTNmzfrzJkzpq9ZrFixW9rw8cYbbyh//vxKSUnRuHHjVLhwYdM/CwDZhQAIZEJYWJiio6P1008/3dLP/XUTxo3kypXruu2GYdz2Na6tT7smODhYK1eu1JIlS/Svf/1LmzdvVrt27XT//fdnODczMvNZrnE6nWrTpo1mzJihefPm3XD0T5JeffVVJSQkqF69evrggw/09ddfa/Hixbr77rtNj3RKf/x+bsXGjRt1/PhxSdKWLVtu6WcBILsQAIFMat68ufbs2aPVq1ff9NySJUvK5XJp165dHu3Hjh3T6dOn3Tt6vSEyMtJjx+w1fx1llKSAgAA1atRIo0eP1rZt2/TKK69o2bJlWr58+XX7vlbnzp07M7y3Y8cOFSxYUCEhIZn7ADfQsWNHbdy4Ub///vt1N85c8+mnn6phw4Z677331L59ezVp0kSNGzfO8DsxG8bNOH/+vLp06aK4uDg99dRTGjFihNauXeu1/gHAWwiAQCYNGDBAISEh6t69u44dO5bh/T179ujNN9+U9McUpqQMO3VHjx4tSXrooYe8VleZMmV05swZbd682d125MgRzZs3z+O8U6dOZfjZazdE/uutaa6JiopSlSpVNGPGDI9A9dNPP+mbb75xf86s0LBhQw0bNkxvvfWWihYtesPzcuXKlWF08ZNPPtGhQ4c82q4F1euF5Vs1cOBAHThwQDNmzNDo0aNVqlQpxcfH3/D3CABW4UbQQCaVKVNGH374odq1a6fY2FiPJ4GsWrVKn3zyiTp37ixJqly5suLj4zV58mSdPn1a9evX148//qgZM2aoVatWN7zFyO1o3769Bg4cqNatW6tXr166cOGCJk6cqDvvvNNjE8TQoUO1cuVKPfTQQypZsqSOHz+uCRMm6I477lCdOnVu2P/IkSPVrFkz1apVS926ddPFixc1fvx4hYeHKzEx0Wuf468CAgL00ksv3fS85s2ba+jQoerSpYvuu+8+bdmyRbNmzVLp0qU9zitTpowiIiI0adIkhYaGKiQkRDVr1lRMTMwt1bVs2TJNmDBBQ4YMcd+WZtq0aWrQoIEGDx6sESNG3FJ/AJClLN6FDPiNn3/+2XjyySeNUqVKGYGBgUZoaKhRu3ZtY/z48calS5fc5125csVISkoyYmJijDx58hjFixc3Bg0a5HGOYfxxG5iHHnoow3X+evuRG90GxjAM45tvvjEqVKhgBAYGGuXLlzc++OCDDLeBWbp0qdGyZUsjOjraCAwMNKKjo40OHToYP//8c4Zr/PVWKUuWLDFq165tBAcHG2FhYUaLFi2Mbdu2eZxz7Xp/vc3MtGnTDElGamrqDX+nhuF5G5gbudFtYPr27WtERUUZwcHBRu3atY3Vq1df9/YtCxYsMOLi4ozcuXN7fM769esbd99993Wv+ed+zp49a5QsWdK45557jCtXrnic9/zzzxsBAQHG6tWr//YzAEB2chjGLazABgAAQI7HGkAAAACbIQACAADYDAEQAADAZgiAAAAgU1auXKkWLVooOjpaDodD8+fPd7935coVDRw4UBUrVlRISIiio6P1xBNP6PDhw9YVDAIgAADInPPnz6ty5cp6++23M7x34cIFbdiwQYMHD9aGDRs0d+5c7dy5Uw8//LAFleIadgEDAACvcTgcmjdvnlq1anXDc9auXasaNWpo//79133mObIeI4AAACBbnTlzRg6HQxEREVaXYls8CQQAAGSQlpaW4TGGTqdTTqczU/1eunRJAwcOVIcOHRQWFpapvnD7CICZ1LXUo1aXAADIIabu+zTLr3Hl171e6Sf5rfeVlJTk0TZkyJBMPerxypUratu2rQzD0MSJEzNZITKDAAgAgD9xpXulm0GDBikhIcGjLTOjf9fC3/79+7Vs2TJG/yxGAAQAwJ8YLq90443p3muuhb9du3Zp+fLlKlCggFf6xe0jAAIAgEw5d+6cdu/e7X6dmpqqlJQU5c+fX1FRUXr00Ue1YcMGff7550pPT9fRo0clSfnz51dgYKBVZdsat4HJJNYAAgDMypY1gEe2e6WfPFGxps9dsWKFGjZsmKE9Pj5eiYmJiomJue7PLV++XA0aNLjdEpEJjAACAOBHDC9NAd+KBg0a6O/Gkxhr8j3cBxAAAMBmGAEEAMCfuLJ/BBA5DwEQAAB/YsEUMHIepoABAABshhFAAAD8iZduBA3/RgAEAMCfMAUME5gCBgAAsBlGAAEA8CfsAoYJBEAAAPyIFTeCRs5DAAQAwJ8wAggTWAMIAABgM4wAAgDgT5gChgkEQAAA/An3AYQJTAEDAADYDCOAAAD4E6aAYQIBEAAAf8IuYJjAFDAAAIDNMAIIAIA/YQoYJhAAAQDwJ0wBwwSmgAEAAGyGEUAAAPyIYXAfQNwcARAAAH/CGkCYQAAEAMCfsAYQJrAGEAAAwGYYAQQAwJ8wBQwTCIAAAPgTF5tAcHNMAQMAANgMI4AAAPgTpoBhAgEQAAB/wi5gmMAUMAAAgM0wAggAgD9hChgmEAABAPAnTAHDBKaAAQAAbIYRQAAA/AkjgDCBAAgAgB8xDG4EjZsjAAIA4E8YAYQJrAEEAACwGUYAAQDwJ9wGBiYQAAEA8CdMAcMEpoABAABshhFAAAD8CVPAMIEACACAP2EKGCYwBQwAAGAzjAACAOBPmAKGCQRAAAD8CVPAMIEpYAAAAJthBBAAAH/CCCBM8OsAGBkZKYfDYercU6dOZXE1AABkA9YAwgS/DoBjx451//nkyZMaPny4mjZtqlq1akmSVq9era+//lqDBw+2qEIAALyMEUCY4DAMw7C6iOzwyCOPqGHDhnr22Wc92t966y0tWbJE8+fPv61+u5Z61AvVAQDsYOq+T7P8Ghc/e8Mr/QQ/3M8r/cA32WYTyNdff60HHnggQ/sDDzygJUuWWFARAABZwHB554Bfs00ALFCggBYsWJChfcGCBSpQoIAFFQEAkAVcLu8ct2DlypVq0aKFoqOj5XA4MsyqGYahl19+WVFRUQoODlbjxo21a9cuL35o3Cq/XgP4Z0lJSerevbtWrFihmjVrSpLWrFmjRYsWacqUKRZXBwBAznX+/HlVrlxZXbt2VZs2bTK8P2LECI0bN04zZsxQTEyMBg8erKZNm2rbtm0KCgqyoGLYJgB27txZsbGxGjdunObOnStJio2N1ffff+8OhAAA5HgWTN82a9ZMzZo1u+57hmFo7Nixeumll9SyZUtJ0vvvv68iRYpo/vz5at++fXaWiv/PNgFQkmrWrKlZs2ZZXQYAAFnHS7uA09LSlJaW5tHmdDrldDpvqZ/U1FQdPXpUjRs3dreFh4erZs2aWr16NQHQIrYKgC6XS7t379bx48fl+ssXpF69ehZVBQCA70lOTlZSUpJH25AhQ5SYmHhL/Rw9elSSVKRIEY/2IkWKuN9D9rNNAPzhhx/UsWNH7d+/X3+9843D4VB6erpFlQEA4EVeGgEcNGiQEhISPNpudfQPvss2AfDpp59W9erV9cUXXygqKsr0E0IAAMhRvHR739uZ7r2eokWLSpKOHTumqKgod/uxY8dUpUqVTPeP22ObALhr1y59+umnKlu2rNWlAABgGzExMSpatKiWLl3qDnxnz57VmjVr9Mwzz1hbnI3ZJgDWrFlTu3fvJgACAPybBY+CO3funHbv3u1+nZqaqpSUFOXPn18lSpRQnz59NHz4cJUrV859G5jo6Gi1atUq22vFH2wTAJ977jn17dtXR48eVcWKFZUnTx6P9ytVqmRRZQAAeJEFAXDdunVq2LCh+/W1tYPx8fGaPn26BgwYoPPnz+upp57S6dOnVadOHS1atIh7AFrINs8CDgjI+NATh8MhwzAytQmEZwEDAMzKlmcBf/CiV/oJfvwVr/QD32SbEcDU1FSrSwAAAPAJtgmAJUuWtLoEAACyngVTwMh5bBMAr9m2bZsOHDigy5cve7Q//PDDFlUEAIAX2WNlFzLJNgFw7969at26tbZs2eJe+yfJfT9AbgQNAADsIuPOCD/Vu3dvxcTE6Pjx48qbN6+2bt2qlStXqnr16lqxYoXV5QEA4B0ul3cO+DXbjACuXr1ay5YtU8GCBRUQEKCAgADVqVNHycnJ6tWrlzZu3Gh1iQAAZB7hDSbYZgQwPT1doaGhkqSCBQvq8OHDkv7YHLJz504rSwMAAMhWthkBrFChgjZt2qSYmBjVrFlTI0aMUGBgoCZPnqzSpUtbXR4AAN5hMAKIm7NNAHzppZd0/vx5SdLQoUPVvHlz1a1bVwUKFNBHH31kcXUAAHiH4WIXMG7ONgGwadOm7j+XLVtWO3bs0KlTpxQZGeneCQwAAGAHtgmA15M/f36rSwAAwLvYBAIT/DoAtmnTxvS5c+fOzcJKAADIJqwBhAl+HQDDw8OtLgEAgOzFGkCY4NcBcNq0aVaXAAAA4HP8OgACAGA7rAGECQRAAAD8CQEQJtjmSSAAAAD4AyOAAAD4E4NNILg52wTA999/X+3atZPT6fRov3z5smbPnq0nnnjCosqQGQ0eb6KGnZqq4B2FJEmHdh3UwnGfasuKjRZXBliH74XNMQUMExyGYY+/KuTKlUtHjhxR4cKFPdpPnjypwoULKz09/bb67VrqUW+Uh9tUuVE1udJdOrbviBwOh2o/0kAPPPWwEh/qr8O7frG6PMASfC9819R9n2b5NS6MftIr/eRNmOKVfuCbbDMCaBjGdR/59ssvv3C/wBxs09L1Hq/nvvFfNXi8icpUvZP/0cG2+F7YHPcBhAl+HwCrVq0qh8Mhh8OhRo0aKXfu//vI6enpSk1N1QMPPGBhhfAWR0CA7n2olpzBQdqz4WerywF8At8LG+JJIDDB7wNgq1atJEkpKSlq2rSp8uXL534vMDBQpUqV0iOPPGJRdfCGYuVL6MW5ryiPM1BpFy7prX+P0OHdjHLA3vheAPg7tlkDOGPGDLVr105BQUG33UdaWprS0tI82p6rGK9cjlyZLQ+ZkCtPbhWILqjg0Lyq/uA/VK9dI73ebgj/s4Ot8b3wTdmyBvD1Ll7pJ+9Anqblz/x+BPCa+Ph4SdL69eu1fft2SdLdd9+tqlWrmu4jOTlZSUlJHm1VwmNVNSLOe4XilqVfuarj+49Kkvb/tFcxlcqqcdcH9f5/JltcGWAdvhf2ZbALGCbYJgAeP35c7du314oVKxQRESFJOn36tBo2bKjZs2erUKFCN+1j0KBBSkhI8Gh7rmJ8VpSLTHAEOJQ7MI/VZQA+he+FjbAJBCbY5kkgzz33nH7//Xdt3bpVp06d0qlTp/TTTz/p7Nmz6tWrl6k+nE6nwsLCPA6mf631yICOurNGrArcUUjFypfQIwM6qvw/7tYP87+zujTAMnwvANyMbUYAFy1apCVLlig2NtbdFhcXp7fffltNmjSxsDJkRliBcHUf/ZzCC0Xq4u8X9MuO/Rr9xHBt+36z1aUBluF7YXPsAoYJtgmALpdLefJknP7IkyePXKyXyLGmDZxodQmAz+F7YXNMAcME20wB//Of/1Tv3r11+PBhd9uhQ4f0/PPPq1GjRhZWBgAAkL1sEwDfeustnT17VqVKlVKZMmVUpkwZxcTE6OzZsxo/frzV5QEA4B0ul3cO+DXbTAEXL15cGzZs0JIlS7Rjxw5JUmxsrBo3bmxxZQAAeBFTwDDBNgFQkhwOh+6//37df//9VpcCAABgGVsFwKVLl2rp0qU6fvx4ho0fU6dOtagqAAC8iF3AMME2ATApKUlDhw5V9erVFRUVJYfDYXVJAAB4H1PAMME2AXDSpEmaPn26/vWvf1ldCgAAgKVsEwAvX76s++67z+oyAADIUjwLGGbY5jYw3bt314cffmh1GQAAZC2X4Z0Dfs02I4CXLl3S5MmTtWTJElWqVCnDU0FGjx5tUWUAAHgR4Q0m2CYAbt68WVWqVJEk/fTTTx7vsSEEAADYiW0C4PLly60uAQCArMdtYGCCbQIgAAC2wBQwTLDNJhAAAAD8gRFAAAD8iMEIIEwgAAIA4E8IgDCBKWAAAACb8esRwM8++8z0uQ8//HAWVgIAQDbhSSAwwa8DYKtWrTxeOxwOGYbh8fqa9PT07CoLAICswxQwTPDrKWCXy+U+vvnmG1WpUkVfffWVTp8+rdOnT+vLL7/UPffco0WLFlldKgAAQLbx6xHAP+vTp48mTZqkOnXquNuaNm2qvHnz6qmnntL27dstrA4AAC9hBBAm+PUI4J/t2bNHERERGdrDw8O1b9++bK8HAICsYBiGV45bkZ6ersGDBysmJkbBwcEqU6aMhg0bdsv9IPvYZgTw3nvvVUJCgmbOnKkiRYpIko4dO6b+/furRo0aFlcHAICXWDAC+Prrr2vixImaMWOG7r77bq1bt05dunRReHi4evXqle314OZsEwCnTp2q1q1bq0SJEipevLgk6eDBgypXrpzmz59vbXEAAORgq1atUsuWLfXQQw9JkkqVKqX//ve/+vHHHy2uDDdimwBYtmxZbd68WYsXL9aOHTskSbGxsWrcuLHHbmAAAHI0C0YA77vvPk2ePFk///yz7rzzTm3atEnff/+9Ro8ene21wBzbBEDpj9u+NGnSRE2aNLG6FAAAsoS3HgWXlpamtLQ0jzan0ymn05nh3BdeeEFnz57VXXfdpVy5cik9PV2vvPKKOnXq5JVa4H1+HQDHjRunp556SkFBQRo3btzfnssaBQAA/k9ycrKSkpI82oYMGaLExMQM53788ceaNWuWPvzwQ919991KSUlRnz59FB0drfj4+GyqGLfCYfjxFp2YmBitW7dOBQoUUExMzA3Pczgc2rt3721do2upR2+3PACAzUzd92mWX+NMfCOv9BM0+UvTI4DFixfXCy+8oJ49e7rbhg8frg8++MC97Aq+xa9HAFNTU6/7ZwAA/JaXngR3o7B3PRcuXFBAgOed5XLlyiUXj6XzWX4dAAEAQNZr0aKFXnnlFZUoUUJ33323Nm7cqNGjR6tr165Wl4Yb8OsAmJCQYPpcdioBAPyBtzaB3Irx48dr8ODB6tGjh44fP67o6Gj9+9//1ssvv5zttcAcvw6AGzdu9Hi9YcMGXb16VeXLl5ck/fzzz8qVK5eqVatmRXkAAHifBQEwNDRUY8eO1dixY7P92rg9fh0Aly9f7v7z6NGjFRoaqhkzZigyMlKS9Ntvv6lLly6qW7euVSUCAABkO9s8C3jUqFFKTk52hz9JioyM1PDhwzVq1CgLKwMAwItcXjrg1/x6BPDPzp49qxMnTmRoP3HihH7//XcLKgIAwPusWAOInMc2I4CtW7dWly5dNHfuXP3yyy/65ZdfNGfOHHXr1k1t2rSxujwAALyDEUCYYJsRwEmTJqlfv37q2LGjrly5IknKnTu3unXrppEjR1pcHQAAQPaxTQDMmzevJkyYoJEjR2rPnj2SpDJlyigkJMTiygAA8B6mgGGGbQLgNSEhIapUqZLVZQAAkDWYvoUJtlkDCAAAgD/YbgQQAAB/ZjACCBMIgAAA+BMCIExgChgAAMBmGAEEAMCPMAUMMwiAAAD4EwIgTGAKGAAAwGYYAQQAwI8wBQwzCIAAAPgRAiDMIAACAOBHCIAwgzWAAAAANsMIIAAA/sRwWF0BcoAcFwBPnz6tiIgIq8sAAMAnMQUMM3x6Cvj111/XRx995H7dtm1bFShQQMWKFdOmTZssrAwAACDn8ukAOGnSJBUvXlyStHjxYi1evFhfffWVmjVrpv79+1tcHQAAvsdwObxywL/59BTw0aNH3QHw888/V9u2bdWkSROVKlVKNWvWtLg6AAB8D1PAMMOnRwAjIyN18OBBSdKiRYvUuHFjSZJhGEpPT7eyNAAAgBzLp0cA27Rpo44dO6pcuXI6efKkmjVrJknauHGjypYta3F1AAD4HoNdwDDBpwPgmDFjVKpUKR08eFAjRoxQvnz5JElHjhxRjx49LK4OAADfwxQwzPDpAJgnTx7169cvQ/vzzz9vQTUAAAD+wecC4GeffWb63IcffjgLKwEAIOdhBy/M8LkA2KpVK1PnORwONoIAAPAXhmF1BcgJfC4AulwsXgAA4HYxAggzfPo2MH926dIlq0sAAADwCz4dANPT0zVs2DAVK1ZM+fLl0969eyVJgwcP1nvvvWdxdQAA+B6eBAIzfDoAvvLKK5o+fbpGjBihwMBAd3uFChX07rvvWlgZAAC+yTC8c8C/+XQAfP/99zV58mR16tRJuXLlcrdXrlxZO3bssLAyAACAnMvnNoH82aFDh677xA+Xy6UrV65YUBEAAL6N6VuY4dMjgHFxcfruu+8ytH/66aeqWrWqBRUBAODbDMPhlQP+zadHAF9++WXFx8fr0KFDcrlcmjt3rnbu3Kn3339fn3/+udXlAQAA5Eg+PQLYsmVLLVy4UEuWLFFISIhefvllbd++XQsXLtT9999vdXkAAPgcw+WdA/7Np0cAJalu3bpavHix1WUAAJAjuJi+hQk+HwAlad26ddq+fbukP9YFVqtWzeKKAAAAci6fDoC//PKLOnTooP/973+KiIiQJJ0+fVr33XefZs+erTvuuMPaAgEA8DFs4IAZPr0GsHv37rpy5Yq2b9+uU6dO6dSpU9q+fbtcLpe6d+9udXkAAPgcngQCM3x6BPDbb7/VqlWrVL58eXdb+fLlNX78eNWtW9fCygAA8E08xQNm+PQIYPHixa97w+f09HRFR0dbUBEAAEDO59MBcOTIkXruuee0bt06d9u6devUu3dvvfHGGxZWBgCAb2IKGGb43BRwZGSkHI7/+xfv/PnzqlmzpnLn/qPUq1evKnfu3OratatatWplUZUAAPgmbgMDM3wuAI4dO9bqEgAAAPyazwXA+Ph4q0sAACDH4jYwMMPnAuCNXLp0SZcvX/ZoCwsLs6gaAAB8E7uAYYZPbwI5f/68nn32WRUuXFghISGKjIz0OAAAAHDrfDoADhgwQMuWLdPEiRPldDr17rvvKikpSdHR0Xr//fetLg8AAJ/jMhxeOeDffDoALly4UBMmTNAjjzyi3Llzq27dunrppZf06quvatasWVaXBwCAzzEMh1eOW3Xo0CE9/vjjKlCggIKDg1WxYkWP27jBt/h0ADx16pRKly4t6Y/1fqdOnZIk1alTRytXrrSyNAAA8P/99ttvql27tvLkyaOvvvpK27Zt06hRo1iu5cN8ehNI6dKllZqaqhIlSuiuu+7Sxx9/rBo1amjhwoWKiIiwujwAAHyOFZtAXn/9dRUvXlzTpk1zt8XExGR/ITDNp0cAu3Tpok2bNkmSXnjhBb399tsKCgrS888/r/79+1tcHQAAvsdbawDT0tJ09uxZjyMtLe261/zss89UvXp1PfbYYypcuLCqVq2qKVOmZPMnx61wGEbO2TC+f/9+rV+/XmXLllWlSpWsLkeSlDuwmNUlAD7n4uHvrC4B8El5CpbO8musLdbaK/188WRlJSUlebQNGTJEiYmJGc4NCgqSJCUkJOixxx7T2rVr1bt3b02aNIn7+/qoHBUAfREBEMiIAAhcX04KgJX2zs4w4ud0OuV0OjOcGxgYqOrVq2vVqlXutl69emnt2rVavXq1V+qBd/ncGsBx48aZPrdXr15ZWAkAADmPt27hcqOwdz1RUVGKi4vzaIuNjdWcOXO8Ugu8z+cC4JgxY0yd53A4CIAAAPyFFdN6tWvX1s6dOz3afv75Z5UsWdKCamCGzwXA1NRUq0sAAAC34Pnnn9d9992nV199VW3bttWPP/6oyZMna/LkyVaXhhvwuQAIAABunxVP8bj33ns1b948DRo0SEOHDlVMTIzGjh2rTp06ZXstMIcACACAH7mdp3h4Q/PmzdW8eXNLro1b59P3AQQAAID3MQIIAIAfcVldAHIEAiAAAH7EkDVTwMhZfH4K+LvvvtPjjz+uWrVq6dChQ5KkmTNn6vvvv7e4MgAAgJzJpwPgnDlz1LRpUwUHB2vjxo3uO5KfOXNGr776qsXVAQDge1yGdw74N58OgMOHD9ekSZM0ZcoU5cmTx91eu3ZtbdiwwcLKAADwTS45vHLAv/n0GsCdO3eqXr16GdrDw8N1+vTp7C8IAAAfxxpAmOHTI4BFixbV7t27M7R///33Kl066x+oDQAA4I98OgA++eST6t27t9asWSOHw6HDhw9r1qxZ6tevn5555hmrywMAwOe4vHTAv/n0FPALL7wgl8ulRo0a6cKFC6pXr56cTqf69eun5557zuryAADwOUwBwwyHYRg+v9fn8uXL2r17t86dO6e4uDjly5fP6pLccgcWs7oEwOdcPPyd1SUAPilPwaxfvvRNkfZe6afJsdle6Qe+yadHAK8JDAxUXFyc1WUAAODzmL6FGT4dABs2bCiH48ZD2cuWLcvGagAA8H0EQJjh0wGwSpUqHq+vXLmilJQU/fTTT4qPj7emKAAAgBzOpwPgmDFjrtuemJioc+fOZXM1AAD4PjaBwAyfvg3MjTz++OOaOnWq1WUAAOBzXA7vHPBvOTIArl69WkFBQVaXAQAAkCP59BRwmzZtPF4bhqEjR45o3bp1Gjx4sEVVAQDgu3iOL8zw6QAYHh7u8TogIEDly5fX0KFD1aRJE4uqAgDAd/n8zX3hE3w2AKanp6tLly6qWLGiIiMjrS4HAIAcgdvAwAyfXQOYK1cuNWnSRKdPn7a6FAAAAL/iswFQkipUqKC9e/daXQYAADmGy+HwygH/5tMBcPjw4erXr58+//xzHTlyRGfPnvU4AACAJ8NLB/ybT64BHDp0qPr27asHH3xQkvTwww97PBLOMAw5HA6lp6dbVSIAAECO5ZMBMCkpSU8//bSWL19udSkAAOQobAKBGT4ZAA3jj8Hn+vXrW1wJAAA5C0/xgBk+uwbQwQJUAACALOGTI4CSdOedd940BJ46dSqbqgEAIGfgSSAww2cDYFJSUoYngQAAgL/HDl6Y4bMBsH379ipcuLDVZQAAkKOwBhBm+OQaQNb/AQAAZB2fHAG8tgsYAADcGm4DAzN8MgC6XPzrCwDA7WAIBWb45BQwAAAAso5PjgACAIDbwyYQmEEABADAj7CICmYwBQwAAGAzjAACAOBHGAGEGQRAAAD8iMEaQJjAFDAAAIDNMAIIAIAfYQoYZhAAAQDwIwRAmEEABADAj/AkEJjBGkAAAACbYQQQAAA/wpNAYAYBEAAAP8IaQJjBFDAAAIDNMAIIAIAfYQQQZhAAAQDwI+wChhlMAQMAANgMI4AAAPgRdgHDDEYAAQDwIy4vHbfrtddek8PhUJ8+fTLRC7IaARAAAHjF2rVr9c4776hSpUpWl4KbIAACAOBHDC8dt+rcuXPq1KmTpkyZosjIyMx+DGQxAiAAAH7EJcMrR1pams6ePetxpKWl3fC6PXv21EMPPaTGjRtn46fF7SIAAgDgR7y1BjA5OVnh4eEeR3Jy8nWvOXv2bG3YsOGG78P3sAsYAABkMGjQICUkJHi0OZ3ODOcdPHhQvXv31uLFixUUFJRd5SGTCIAAAPgRb90I2ul0Xjfw/dX69et1/Phx3XPPPe629PR0rVy5Um+99ZbS0tKUK1cuL1UFbyEAAgDgR7L7UXCNGjXSli1bPNq6dOmiu+66SwMHDiT8+SgCIAAAuG2hoaGqUKGCR1tISIgKFCiQoR2+gwAIAIAf4UkgMIMACACAH3F5bRXg7VuxYoXVJeAmuA0MAACAzTACCACAH7F+/A85AQEQAAA/kt27gJEzMQUMAABgM7YYAdy8ebPpcytVqpSFlQAAkLV8YRMIfJ8tAmCVKlXkcDhkGIYcjr/fH5+enp5NVQEA4H3EP5hhiyng1NRU7d27V6mpqZozZ45iYmI0YcIEbdy4URs3btSECRNUpkwZzZkzx+pSAQDIFJeXDvg3W4wAlixZ0v3nxx57TOPGjdODDz7obqtUqZKKFy+uwYMHq1WrVhZUCAAAkH1sEQD/bMuWLYqJicnQHhMTo23btllQEQAA3sMaQJhhiyngP4uNjVVycrIuX77sbrt8+bKSk5MVGxtrYWUAAGSe4aUD/s12I4CTJk1SixYtdMcdd7h3/G7evFkOh0MLFy60uDoAAICsZ7sAWKNGDe3du1ezZs3Sjh07JEnt2rVTx44dFRISYnF1AABkDhs4YIbtAqAkhYSE6KmnnrK6DAAAvM5gAhcm2G4NoCTNnDlTderUUXR0tPbv3y9JGjNmjBYsWGBxZQAAAFnPdgFw4sSJSkhIULNmzfTbb7+5b/wcGRmpsWPHWlscAACZxH0AYYbtAuD48eM1ZcoUvfjii8qd+/9mwKtXr64tW7ZYWBkAAJnnkuGVA/7NdgEwNTVVVatWzdDudDp1/vx5CyoCAADIXrYLgDExMUpJScnQvmjRIu4DCADI8bgPIMyw3S7ghIQE9ezZU5cuXZJhGPrxxx/13//+V8nJyXr33XetLg+36Zmn49U34RkVLVpImzdvU+8+g7V2XYrVZQHZYl3KFk378FNt27FbJ06e0pvJg9Wo3n2SpCtXr2r85Bn6bvU6/XL4iPKFhOgf91bV8093UeFCBSyuHFmB6VuYYbsA2L17dwUHB+ull17ShQsX1LFjR0VHR+vNN99U+/btrS4Pt+Gxxx7WGyOHqEfPF/Tj2o3q9Vx3ffnFLMVVqKcTJ05aXR6Q5S5evKTyZUur9UNN1Oc/wz3eu3QpTdt27tG/O3dQ+bKldfb33/Xam+/o2YFJ+njqOIsqRlZiAwfMcBiGYdu/Kly4cEHnzp1T4cKFb7uP3IHFvFgRbseq7xdq7bpN6t3nJUmSw+HQvr1r9faEaRox8m2Lq7Oni4e/s7oE26pQu5nHCOD1bNm+Ux2699HiOTMUVfT2//uHW5enYOksv8aTpR7zSj9T9n3ilX7gm2y3BvDP8ubNm6nwB+vlyZNH99xTSUuX/V/gMAxDS5d9r3/8o5qFlQG+69y5C3I4HAoN5elH/sjw0j/wb7aYAq5ataocDoepczds2JDF1cCbChbMr9y5c+v4sV892o8fP6G7ypexqCrAd6WlXdaYiVP1YOP6ysfjL/0SU8AwwxYBsFWrVu4/X7p0SRMmTFBcXJxq1aolSfrhhx+0detW9ejR42/7SUtLU1pamkebYRimwyUAWOnK1avqO/hVGYahwf2ftbocABayRQAcMmSI+8/du3dXr169NGzYsAznHDx48G/7SU5OVlJSkkebIyCfHLnCvFcsbsmvv57S1atXVbhIQY/2woUL6eixExZVBfiea+Hv8LHjmjruNUb//BjTtzDDdmsAP/nkEz3xxBMZ2h9//HHNmTPnb3920KBBOnPmjMfhCAjNqlJhwpUrV7Rhw2b9s2Edd5vD4dA/G9bRDz+st7AywHdcC38HDh7Wu2NfVUQ4f2n1ZzwKDmbYYgTwz4KDg/W///1P5cqV82j/3//+p6CgoL/9WafTKafT6dHG9K/1xrw5RdPeG6P1GzZr7dqN6vXckwoJCdb0GR9ZXRqQLS5cuKgDvxx2vz50+Jh2/LxH4WGhKlgwvxJefEXbft6tt0ckyeVy6deTpyRJ4WGhypMnj1VlA7CQ7QJgnz599Mwzz2jDhg2qUaOGJGnNmjWaOnWqBg8ebHF1uB2ffPKZChXMr8SX+6lo0ULatGmrHmr+uI4f//XmPwz4gZ927FLX5wa6X48YP1mS1LJZY/Xo9riWf/+DJOnRzj09fm7q+NdV455K2VcosoXLvnd3wy2w5X0AP/74Y7355pvavn27JCk2Nla9e/dW27Ztb7kv7gMIZMR9AIHry477AD5eso1X+vlg/1yv9APfZLsRQElq27btbYU9AAAAf2DLAChJly9f1vHjx+VyeS51LVGihEUVAQCQeTwLGGbYLgDu2rVLXbt21apVqzzar93PLz093aLKAADIPG4DAzNsFwA7d+6s3Llz6/PPP1dUVBS7eAEAfoVbuMAM2wXAlJQUrV+/XnfddZfVpQAAAFjCdgEwLi5Ov/7K7UEAAP6JNYAww3ZPAnn99dc1YMAArVixQidPntTZs2c9DgAAcjLDS//Av9luBLBx48aSpEaNGnm0swkEAADYhe0C4PLly60uAQCALMMmEJhhuwBYv359q0sAACDL2PABX7gNtguA11y4cEEHDhzQ5cuXPdorVeK5mAAAwL/ZLgCeOHFCXbp00VdffXXd91kDCADIydgFDDNstwu4T58+On36tNasWaPg4GAtWrRIM2bMULly5fTZZ59ZXR4AAJni8tIB/2a7EcBly5ZpwYIFql69ugICAlSyZEndf//9CgsLU3Jysh566CGrSwQAAMhSthsBPH/+vAoXLixJioyM1IkTJyRJFStW1IYNG6wsDQCATOM+gDDDdgGwfPny2rlzpySpcuXKeuedd3To0CFNmjRJUVFRFlcHAEDmuGR45YB/s90UcO/evXXkyBFJ0pAhQ/TAAw/ogw8+UGBgoGbMmGFxdQAAZA63gYEZtguAjz/+uPvP1apV0/79+7Vjxw6VKFFCBQsWtLAyAACA7GGLAJiQkGD63NGjR2dhJQAAZC128MIMWwTAjRs3mjrP4XBkcSUAAGQtNnDADFsEQJ7/CwAA8H9stwsYAAB/ZsUu4OTkZN17770KDQ1V4cKF1apVK/cdN+CbCIAAAPgRwzC8ctyKb7/9Vj179tQPP/ygxYsX68qVK2rSpInOnz+fRZ8SmWWLKWAAAJB1Fi1a5PF6+vTpKly4sNavX6969epZVBX+DgEQAAA/4gs3cT5z5owkKX/+/BZXghshAAIA4Ee8tQs4LS1NaWlpHm1Op1NOp/Nvf87lcqlPnz6qXbu2KlSo4JVa4H2sAQQAABkkJycrPDzc40hOTr7pz/Xs2VM//fSTZs+enQ1V4nY5DJ4Zkym5A4tZXQLgcy4e/s7qEgCflKdg6Sy/Rr1ijbzSz+K9X97yCOCzzz6rBQsWaOXKlYqJifFKHcgaTAEDAOBHvDWqY2a6131Nw9Bzzz2nefPmacWKFYS/HIAACACAH7FiE0jPnj314YcfasGCBQoNDdXRo0clSeHh4QoODs72enBzrAEEAACZMnHiRJ05c0YNGjRQVFSU+/joo4+sLg03wAggAAB+xIoRQLYT5DwEQAAA/AhhDGYwBQwAAGAzjAACAOBHfOFJIPB9BEAAAPyIt54EAv/GFDAAAIDNMAIIAIAfYRMIzCAAAgDgR1gDCDOYAgYAALAZRgABAPAjTAHDDAIgAAB+hClgmEEABADAj3AbGJjBGkAAAACbYQQQAAA/4mINIEwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EaaAYQYBEAAAP8IUMMxgChgAAMBmGAEEAMCPMAUMMwiAAAD4EaaAYQZTwAAAADbDCCAAAH6EKWCYQQAEAMCPMAUMMwiAAAD4EcNwWV0CcgDWAAIAANgMI4AAAPgRF1PAMIEACACAHzHYBAITmAIGAACwGUYAAQDwI0wBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAf4UkgMIMACACAH+FJIDCDKWAAAACbYQQQAAA/wiYQmEEABADAj3AbGJhBAAQAwI8wAggzWAMIAABgM4wAAgDgR7gNDMwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EXYBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAfYRcwzCAAAgDgRwzWAMIEpoABAABshhFAAAD8CFPAMIMACACAH2EXMMwgAAIA4EdYAwgzWAMIAABgMwRAAAD8iGEYXjlux9tvv61SpUopKChINWvW1I8//ujlTwdvIQACAOBHrAqAH330kRISEjRkyBBt2LBBlStXVtOmTXX8+PEs+JTILAIgAADItNGjR+vJJ59Uly5dFBcXp0mTJilv3ryaOnWq1aXhOgiAAAD4EcNLR1pams6ePetxpKWlXfealy9f1vr169W4cWN3W0BAgBo3bqzVq1dnzQdFprALOJOuXj5kdQnQH/+hSk5O1qBBg+R0Oq0uB/AZfDfsx1v/X0pMTFRSUpJH25AhQ5SYmJjh3F9//VXp6ekqUqSIR3uRIkW0Y8cOr9QD73IY3DAIfuDs2bMKDw/XmTNnFBYWZnU5gM/gu4HblZaWlmHEz+l0XvcvEocPH1axYsW0atUq1apVy90+YMAAffvtt1qzZk2W14tbwwggAADI4EZh73oKFiyoXLly6dixYx7tx44dU9GiRbOiPGQSawABAECmBAYGqlq1alq6dKm7zeVyaenSpR4jgvAdjAACAIBMS0hIUHx8vKpXr64aNWpo7NixOn/+vLp06WJ1abgOAiD8gtPp1JAhQ1jkDvwF3w1kl3bt2unEiRN6+eWXdfToUVWpUkWLFi3KsDEEvoFNIAAAADbDGkAAAACbIQACAADYDAEQAADAZgiAyJQGDRqoT58+7telSpXS2LFj//ZnHA6H5s+fn6V1mdW5c2e1atUqy68zffp0RUREZPl14N/++n3LComJiapSpUqWXgOA9dgFDK9au3atQkJCrC5DiYmJmj9/vlJSUqwuBQAAn0MAhFcVKlTI6hIAAMBNMAUM086fP68nnnhC+fLlU1RUlEaNGpXhnL9OAe/atUv16tVTUFCQ4uLitHjx4ptep0GDBurVq5cGDBig/Pnzq2jRohkePn7gwAG1bNlS+fLlU1hYmNq2bet+BNH06dOVlJSkTZs2yeFwyOFwaPr06aY+46JFi1SnTh1FRESoQIECat68ufbs2eN+f9++fXI4HJo7d64aNmyovHnzqnLlylq9erVHP9OnT1eJEiWUN29etW7dWidPnjR1fcCsmTNnqnr16goNDVXRokXVsWNHHT9+3P3+ihUr5HA4tHTpUlWvXl158+bVfffdp507d3r089prr6lIkSIKDQ1Vt27ddOnSpez+KAAsQACEaf3799e3336rBQsW6JtvvtGKFSu0YcOGG57vcrnUpk0bBQYGas2aNZo0aZIGDhxo6lozZsxQSEiI1qxZoxEjRmjo0KHu8OhyudSyZUudOnVK3377rRYvXqy9e/eqXbt2kv64GWnfvn11991368iRIzpy5Ij7vZs5f/68EhIStG7dOi1dulQBAQFq3bq1XC6Xx3kvvvii+vXrp5SUFN15553q0KGDrl69Kklas2aNunXrpmeffVYpKSlq2LChhg8fbur6gFlXrlzRsGHDtGnTJs2fP1/79u1T586dM5z34osvatSoUVq3bp1y586trl27ut/7+OOPlZiYqFdffVXr1q1TVFSUJkyYkI2fAoBlDMCE33//3QgMDDQ+/vhjd9vJkyeN4OBgo3fv3u62kiVLGmPGjDEMwzC+/vprI3fu3MahQ4fc73/11VeGJGPevHk3vFb9+vWNOnXqeLTde++9xsCBAw3DMIxvvvnGyJUrl3HgwAH3+1u3bjUkGT/++KNhGIYxZMgQo3Llyjf9XPHx8UbLli1v+P6JEycMScaWLVsMwzCM1NRUQ5Lx7rvvZrj29u3bDcMwjA4dOhgPPvigRz/t2rUzwsPDb1oP8Hfq16/v8X37s7Vr1xqSjN9//90wDMNYvny5IclYsmSJ+5wvvvjCkGRcvHjRMAzDqFWrltGjRw+PfmrWrGnquwMgZ2MEEKbs2bNHly9fVs2aNd1t+fPnV/ny5W/4M9u3b1fx4sUVHR3tbjP7UPBKlSp5vI6KinJPb13rt3jx4u734+LiFBERoe3bt5vq/0Z27dqlDh06qHTp0goLC1OpUqUk/THlfKP6oqKiJMmjvj//niTznxswa/369WrRooVKlCih0NBQ1a9fXxL/rgIwhwAIn5QnTx6P1w6HI8M0bFZo0aKFTp06pSlTpmjNmjVas2aNJOny5cs3rM/hcEhSttQHSH8sVWjatKnCwsI0a9YsrV27VvPmzZPEv6sAzCEAwpQyZcooT5487kAkSb/99pt+/vnnG/5MbGysDh48qCNHjrjbfvjhh0zXcq3fgwcPutu2bdum06dPKy4uTpIUGBio9PT0W+r35MmT2rlzp1566SU1atRIsbGx+u23326rvj//niTvfG7gmh07dujkyZN67bXXVLduXd11110eG0DM4t9VwL64DQxMyZcvn7p166b+/furQIECKly4sF588UUFBNz47xCNGzfWnXfeqfj4eI0cOVJnz57Viy++mOlaGjdurIoVK6pTp04aO3asrl69qh49eqh+/fqqXr26pD92I6empiolJUV33HGHQkND5XQ6/7bfyMhIFShQQJMnT1ZUVJQOHDigF1544Zbr69Wrl2rXrq033nhDLVu21Ndff61Fixbd1mcFrqdEiRIKDAzU+PHj9fTTT+unn37SsGHDbrmf3r17q3Pnzqpevbpq166tWbNmaevWrSpdunQWVA3AlzACCNNGjhypunXrqkWLFmrcuLHq1KmjatWq3fD8gIAAzZs3TxcvXlSNGjXUvXt3vfLKK5muw+FwaMGCBYqMjFS9evXUuHFjlS5dWh999JH7nEceeUQPPPCAGjZsqEKFCum///3vTfsNCAjQ7NmztX79elWoUEHPP/+8Ro4cecv1/eMf/9CUKVP05ptvqnLlyvrmm2/00ksv3XI/wI0UKlRI06dP1yeffKK4uDi99tpreuONN265n3bt2mnw4MEaMGCAqlWrpv379+uZZ57JgooB+BqHYRiG1UUAAAAg+zACCAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAZvo3LmzWrVq5X7doEED9enTJ9vrWLFihRwOh06fPn3DcxwOh+bPn2+6z8TERFWpUiVTde3bt08Oh0MpKSmZ6gcAcgICIGChzp07y+FwyOFwKDAwUGXLltXQoUN19erVLL/23LlzTT8+zExoAwDkHDwLGLDYAw88oGnTpiktLU1ffvmlevbsqTx58mjQoEEZzr18+bICAwO9ct38+fN7pR8AQM7DCCBgMafTqaJFi6pkyZJ65pln1LhxY3322WeS/m/a9pVXXlF0dLTKly8vSTp48KDatm2riIgI5c+fXy1bttS+ffvcfaanpyshIUEREREqUKCABgwYoL8+9fGvU8BpaWkaOHCgihcvLqfTqbJly+q9997Tvn371LBhQ0lSZGSkHA6HOnfuLElyuVxKTk5WTEyMgoODVblyZX366ace1/nyyy915513Kjg4WA0bNvSo06yBAwfqzjvvVN68eVW6dGkNHjxYV65cyXDeO++8o+LFiytv3rxq27atzpw54/H+u+++q9jYWAUFBemuu+7ShAkTbnjN3377TZ06dVKhQoUUHByscuXKadq0abdcOwD4IkYAAR8THByskydPul8vXbpUYWFhWrx4sSTpypUratq0qWrVqqXvvvtOuXPn1vDhw/XAAw9o8+bNCgwM1KhRozR9+nRNnTpVsbGxGjVqlObNm6d//vOfN7zuE088odWrV2vcuHGqXLmyUlNT9euvv6p48eKaM2eOHnnkEe3cuVNhYWEKDg6WJCUnJ+uDDz7QpEmTVK5cOa1cuVKPP/64ChUqpPr16+vgwYNq06aNevbsqaeeekrr1q1T3759b/l3EhoaqunTpys6OlpbtmzRk08+qdDQUA0YMMB9zu7du/Xxxx9r4cKFOnv2rLp166YePXpo1qxZkqRZs2bp5Zdf1ltvvaWqVatq48aNevLJJxUSEqL4+PgM1xw8eLC2bdumr776SgULFtTu3bt18eLFW64dAHySAcAy8fHxRsuWLQ3DMAyXy2UsXrzYcDqdRr9+/dzvFylSxEhLS3P/zMyZM43y5csbLpfL3ZaWlmYEBwcbX3/9tWEYhhEVFWWMGDHC/f6VK1eMO+64w30twzCM+vXrG7179zYMwzB27txpSDIWL1583TqXL19uSDJ+++03d9ulS5eMvHnzGqtWrfI4t1u3bkaHDh0MwzCMQYMGGXFxcR7vDxw4MENffyXJmDdv3g3fHzlypFGtWjX36yFDhhi5cuUyfvnlF3fbV199ZQQEBBhHjhwxDMMwypQpY3z44Yce/QwbNsyoVauWYRiGkZqaakgyNm7caBiGYbRo0cLo0qXLDWsAgJyMEUDAYp9//rny5cunK1euyOVyqWPHjkpMTHS/X7FiRY91f5s2bdLu3bsVGhrq0c+lS5e0Z88enTlzRkeOHFHNmjXd7+XOnVvVq1fPMA18TUpKinLlyqX69eubrnv37t26cOGC7r//fo/2y5cvq2rVqpKk7du3e9QhSbVq1TJ9jWs++ugjjRs3Tnv27NG5c+d09epVhYWFeZxTokQJFStWzOM6LpdLO3fuVGhoqPbs2aNu3brpySefdJ9z9epVhYeHX/eazzzzjB555BFt2LBBTZo0UatWrXTffffdcu0A4IsIgIDFGjZsqIkTJyowMFDR0dHKndvzaxkSEuLx+ty5c6pWrZp7avPPChUqdFs1XJvSvRXnzp2TJH3xxRcewUv6Y12jt6xevVqdOnVSUlKSmjZtqvDwcM2ePVujRo265VqnTJmSIZDmypXruj/TrFkz7d+/X19++aUWL16sRo0aqWfPnnrjjTdu/8MAgI8gAAIWCwkJUdmyZU2ff8899+ijjz5S4cKFM4yCXRMVFaU1a9aoXr16kv4Y6Vq/fr3uueee655fsWJFuVwuffvtt2rcuHGG96+NQKanp7vb4uLi5HQ6deDAgRuOHMbGxro3tFzzww8/3PxD/smqVatUsmRJvfjii+62/fv3ZzjvwIEDOnz4sKKjo93XCQgIUPny5VWkSBFFR0dr79696tSpk+lrFypUSPHx8YqPj1fdunXVv39/AiAAv8AuYCCH6dSpkwoWLKiWLVvqu+++U2pqqlasWKFevXrpl19+kST17t1br732mubPn68dO3aoR48ef3sPv1KlSik+Pl5du3bV/Pnz3X1+/PHHkqSSJUvK4XDo888/14kTJ3Tu3DmFhoaqX79+ev755zVjxgzt2bNHGzZs0Pjx4zVjxgxJ0tNPP61du3apf//+2rlzpz788ENNnz79lj5vuXLldODAAc2ePVt79uzRuHHjNG/evAznBQUFKT4+Xps2bdJ3332nXr16qW3btipatKgkKSkpScnJyRo3bpx+/vlnbdmyRdOmTdPo0aOve92XX35ZCxYs0O7du7V161Z9/vnnio2NvaXaAcBXEQCBHCZv3rxauXKlSpQooTZt2ig2NlbdunXTpUuX3COCffv21b/+9S/Fx8erVq1aCg0NVevWrf+234kTJ+rRRx9Vjx49dNddd+nJJ5/U+fPnJUnFihVTUlKSXnjhBRUpUkTPPvusJGnYsGEaPHiwkpOTFRsbqwceeEBffPGFYmJiJP2xLm/OnDmaP3++KleurEmTJunVV1+9pc/78MMP6/nnn9ezzz6rKlWqaNWqVRo8eHCG88qWLas2bdrowQcfVJMmTVSpUiWP27x0795d7777rqZNm6aKFSuqfv36mj59urvWvwoMDNSgQYNUqVIl1atXT7ly5dLs2bNvqXYA8FUO40arwgEAAOCXGAEEAACwGQIgAACAzRAAAQAAbIYACAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAQAAbIYACAAAYDP/D32GkVATVcrxAAAAAElFTkSuQmCC"}, "metadata": {}}], "id": "c15ce013-6b4c-4723-9b04-7e60f23f6448"}, {"cell_type": "markdown", "source": "## TASK  10\n", "metadata": {}, "id": "612dbb58-fb2f-47ee-a7bb-d77a00e6dbd3"}, {"cell_type": "markdown", "source": "Create a k nearest neighbors object then  create a  <code>GridSearchCV</code> object  <code>knn_cv</code> with cv = 10.  Fit the object to find the best parameters from the dictionary <code>parameters</code>.\n", "metadata": {}, "id": "a748cd07-5a39-4cda-809d-3cea906bd148"}, {"cell_type": "code", "source": "parameters = {'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n              'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n              'p': [1,2]}\n\nKNN = KNeighborsClassifier()", "metadata": {}, "execution_count": 35, "outputs": [], "id": "0cee22b2-bcf7-471e-96cf-e63302a47b52"}, {"cell_type": "code", "source": "knn_cv=GridSearchCV(KNN,parameters,cv=10)\nknn_cv.fit(X_train,Y_train)", "metadata": {}, "execution_count": 36, "outputs": [{"execution_count": 36, "output_type": "execute_result", "data": {"text/plain": "GridSearchCV(cv=10, estimator=KNeighborsClassifier(),\n             param_grid={'algorithm': ['auto', 'ball_tree', 'kd_tree', 'brute'],\n                         'n_neighbors': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10],\n                         'p': [1, 2]})"}, "metadata": {}}], "id": "ffbaf94b-0b03-4094-84b6-f5233194434c"}, {"cell_type": "code", "source": "print(\"tuned hpyerparameters :(best parameters) \",knn_cv.best_params_)\nprint(\"accuracy :\",knn_cv.best_score_)", "metadata": {}, "execution_count": 37, "outputs": [{"name": "stdout", "text": "tuned hpyerparameters :(best parameters)  {'algorithm': 'auto', 'n_neighbors': 10, 'p': 1}\naccuracy : 0.8482142857142858\n", "output_type": "stream"}], "id": "6309852d-7fb4-400f-b44a-1a3a04f03fba"}, {"cell_type": "markdown", "source": "## TASK  11\n", "metadata": {}, "id": "98e9e899-25da-4c9b-99eb-b680c559ebda"}, {"cell_type": "markdown", "source": "Calculate the accuracy of knn_cv on the test data using the method <code>score</code>:\n", "metadata": {}, "id": "9a20e83b-5c1b-440d-bba3-57c44a8605a6"}, {"cell_type": "code", "source": "print('Accuracy on test data is:{:.3f}'.format(knn_cv.score(X_test, Y_test)))", "metadata": {}, "execution_count": 38, "outputs": [{"name": "stdout", "text": "Accuracy on test data is:0.833\n", "output_type": "stream"}], "id": "89196934-71d7-408d-9ff2-e99a934fb7de"}, {"cell_type": "markdown", "source": "We can plot the confusion matrix\n", "metadata": {}, "id": "a6cafe12-0a65-4cdc-8e44-67892989248e"}, {"cell_type": "code", "source": "yhat = knn_cv.predict(X_test)\nplot_confusion_matrix(Y_test,yhat)", "metadata": {}, "execution_count": 39, "outputs": [{"output_type": "display_data", "data": {"text/plain": "<pyolite.display.Image at 0x5f41f98>", "image/png": "iVBORw0KGgoAAAANSUhEUgAAAoAAAAHgCAYAAAA10dzkAAAAOXRFWHRTb2Z0d2FyZQBNYXRwbG90bGliIHZlcnNpb24zLjUuMSwgaHR0cHM6Ly9tYXRwbG90bGliLm9yZy/YYfK9AAAACXBIWXMAAA9hAAAPYQGoP6dpAABHB0lEQVR4nO3dd3gU5f7+8XsDZBNCGj1BSihiIlUQDtIPCKIgRaV6DE2PggKGJkeRBNAoSBEUEJQi4sFCEwtKFT0g0gJIkxKKdEFAWoDs/P7wx35dAzKQTWaz8355zXWxz06e+WwuV2+eMuMwDMMQAAAAbCPA6gIAAACQvQiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABAAAsBkCIAAAgM0QAAEAAGyGAAgAAGAzBEAAAACbIQACAADYDAEQAADAZgiAAAAANkMABPzArl271KRJE4WHh8vhcGj+/Ple7X/fvn1yOByaPn26V/vNyRo0aKAGDRpYXQYA3BYCIOAle/bs0b///W+VLl1aQUFBCgsLU+3atfXmm2/q4sWLWXrt+Ph4bdmyRa+88opmzpyp6tWrZ+n1slPnzp3lcDgUFhZ23d/jrl275HA45HA49MYbb9xy/4cPH1ZiYqJSUlK8UC0A5Ay5rS4A8AdffPGFHnvsMTmdTj3xxBOqUKGCLl++rO+//179+/fX1q1bNXny5Cy59sWLF7V69Wq9+OKLevbZZ7PkGiVLltTFixeVJ0+eLOn/ZnLnzq0LFy5o4cKFatu2rcd7s2bNUlBQkC5dunRbfR8+fFhJSUkqVaqUqlSpYvrnvvnmm9u6HgD4AgIgkEmpqalq3769SpYsqWXLlikqKsr9Xs+ePbV792598cUXWXb9EydOSJIiIiKy7BoOh0NBQUFZ1v/NOJ1O1a5dW//9738zBMAPP/xQDz30kObMmZMttVy4cEF58+ZVYGBgtlwPALICU8BAJo0YMULnzp3Te++95xH+rilbtqx69+7tfn316lUNGzZMZcqUkdPpVKlSpfSf//xHaWlpHj9XqlQpNW/eXN9//71q1KihoKAglS5dWu+//777nMTERJUsWVKS1L9/fzkcDpUqVUrSH1On1/78Z4mJiXI4HB5tixcvVp06dRQREaF8+fKpfPny+s9//uN+/0ZrAJctW6a6desqJCREERERatmypbZv337d6+3evVudO3dWRESEwsPD1aVLF124cOHGv9i/6Nixo7766iudPn3a3bZ27Vrt2rVLHTt2zHD+qVOn1K9fP1WsWFH58uVTWFiYmjVrpk2bNrnPWbFihe69915JUpcuXdxTydc+Z4MGDVShQgWtX79e9erVU968ed2/l7+uAYyPj1dQUFCGz9+0aVNFRkbq8OHDpj8rAGQ1AiCQSQsXLlTp0qV13333mTq/e/fuevnll3XPPfdozJgxql+/vpKTk9W+ffsM5+7evVuPPvqo7r//fo0aNUqRkZHq3Lmztm7dKklq06aNxowZI0nq0KGDZs6cqbFjx95S/Vu3blXz5s2VlpamoUOHatSoUXr44Yf1v//9729/bsmSJWratKmOHz+uxMREJSQkaNWqVapdu7b27duX4fy2bdvq999/V3Jystq2bavp06crKSnJdJ1t2rSRw+HQ3Llz3W0ffvih7rrrLt1zzz0Zzt+7d6/mz5+v5s2ba/To0erfv7+2bNmi+vXru8NYbGyshg4dKkl66qmnNHPmTM2cOVP16tVz93Py5Ek1a9ZMVapU0dixY9WwYcPr1vfmm2+qUKFCio+PV3p6uiTpnXfe0TfffKPx48crOjra9GcFgCxnALhtZ86cMSQZLVu2NHV+SkqKIcno3r27R3u/fv0MScayZcvcbSVLljQkGStXrnS3HT9+3HA6nUbfvn3dbampqYYkY+TIkR59xsfHGyVLlsxQw5AhQ4w/f/XHjBljSDJOnDhxw7qvXWPatGnutipVqhiFCxc2Tp486W7btGmTERAQYDzxxBMZrte1a1ePPlu3bm0UKFDghtf88+cICQkxDMMwHn30UaNRo0aGYRhGenq6UbRoUSMpKem6v4NLly4Z6enpGT6H0+k0hg4d6m5bu3Zths92Tf369Q1JxqRJk677Xv369T3avv76a0OSMXz4cGPv3r1Gvnz5jFatWt30MwJAdmMEEMiEs2fPSpJCQ0NNnf/ll19KkhISEjza+/btK0kZ1grGxcWpbt267teFChVS+fLltXfv3tuu+a+urR1csGCBXC6XqZ85cuSIUlJS1LlzZ+XPn9/dXqlSJd1///3uz/lnTz/9tMfrunXr6uTJk+7foRkdO3bUihUrdPToUS1btkxHjx697vSv9Me6wYCAP/4Tl56erpMnT7qntzds2GD6mk6nU126dDF1bpMmTfTvf/9bQ4cOVZs2bRQUFKR33nnH9LUAILsQAIFMCAsLkyT9/vvvps7fv3+/AgICVLZsWY/2okWLKiIiQvv37/doL1GiRIY+IiMj9dtvv91mxRm1a9dOtWvXVvfu3VWkSBG1b99eH3/88d+GwWt1li9fPsN7sbGx+vXXX3X+/HmP9r9+lsjISEm6pc/y4IMPKjQ0VB999JFmzZqle++9N8Pv8hqXy6UxY8aoXLlycjqdKliwoAoVKqTNmzfrzJkzpq9ZrFixW9rw8cYbbyh//vxKSUnRuHHjVLhwYdM/CwDZhQAIZEJYWJiio6P1008/3dLP/XUTxo3kypXruu2GYdz2Na6tT7smODhYK1eu1JIlS/Svf/1LmzdvVrt27XT//fdnODczMvNZrnE6nWrTpo1mzJihefPm3XD0T5JeffVVJSQkqF69evrggw/09ddfa/Hixbr77rtNj3RKf/x+bsXGjRt1/PhxSdKWLVtu6WcBILsQAIFMat68ufbs2aPVq1ff9NySJUvK5XJp165dHu3Hjh3T6dOn3Tt6vSEyMtJjx+w1fx1llKSAgAA1atRIo0eP1rZt2/TKK69o2bJlWr58+XX7vlbnzp07M7y3Y8cOFSxYUCEhIZn7ADfQsWNHbdy4Ub///vt1N85c8+mnn6phw4Z677331L59ezVp0kSNGzfO8DsxG8bNOH/+vLp06aK4uDg99dRTGjFihNauXeu1/gHAWwiAQCYNGDBAISEh6t69u44dO5bh/T179ujNN9+U9McUpqQMO3VHjx4tSXrooYe8VleZMmV05swZbd682d125MgRzZs3z+O8U6dOZfjZazdE/uutaa6JiopSlSpVNGPGDI9A9dNPP+mbb75xf86s0LBhQw0bNkxvvfWWihYtesPzcuXKlWF08ZNPPtGhQ4c82q4F1euF5Vs1cOBAHThwQDNmzNDo0aNVqlQpxcfH3/D3CABW4UbQQCaVKVNGH374odq1a6fY2FiPJ4GsWrVKn3zyiTp37ixJqly5suLj4zV58mSdPn1a9evX148//qgZM2aoVatWN7zFyO1o3769Bg4cqNatW6tXr166cOGCJk6cqDvvvNNjE8TQoUO1cuVKPfTQQypZsqSOHz+uCRMm6I477lCdOnVu2P/IkSPVrFkz1apVS926ddPFixc1fvx4hYeHKzEx0Wuf468CAgL00ksv3fS85s2ba+jQoerSpYvuu+8+bdmyRbNmzVLp0qU9zitTpowiIiI0adIkhYaGKiQkRDVr1lRMTMwt1bVs2TJNmDBBQ4YMcd+WZtq0aWrQoIEGDx6sESNG3FJ/AJClLN6FDPiNn3/+2XjyySeNUqVKGYGBgUZoaKhRu3ZtY/z48calS5fc5125csVISkoyYmJijDx58hjFixc3Bg0a5HGOYfxxG5iHHnoow3X+evuRG90GxjAM45tvvjEqVKhgBAYGGuXLlzc++OCDDLeBWbp0qdGyZUsjOjraCAwMNKKjo40OHToYP//8c4Zr/PVWKUuWLDFq165tBAcHG2FhYUaLFi2Mbdu2eZxz7Xp/vc3MtGnTDElGamrqDX+nhuF5G5gbudFtYPr27WtERUUZwcHBRu3atY3Vq1df9/YtCxYsMOLi4ozcuXN7fM769esbd99993Wv+ed+zp49a5QsWdK45557jCtXrnic9/zzzxsBAQHG6tWr//YzAEB2chjGLazABgAAQI7HGkAAAACbIQACAADYDAEQAADAZgiAAAAgU1auXKkWLVooOjpaDodD8+fPd7935coVDRw4UBUrVlRISIiio6P1xBNP6PDhw9YVDAIgAADInPPnz6ty5cp6++23M7x34cIFbdiwQYMHD9aGDRs0d+5c7dy5Uw8//LAFleIadgEDAACvcTgcmjdvnlq1anXDc9auXasaNWpo//79133mObIeI4AAACBbnTlzRg6HQxEREVaXYls8CQQAAGSQlpaW4TGGTqdTTqczU/1eunRJAwcOVIcOHRQWFpapvnD7CICZ1LXUo1aXAADIIabu+zTLr3Hl171e6Sf5rfeVlJTk0TZkyJBMPerxypUratu2rQzD0MSJEzNZITKDAAgAgD9xpXulm0GDBikhIcGjLTOjf9fC3/79+7Vs2TJG/yxGAAQAwJ8YLq90443p3muuhb9du3Zp+fLlKlCggFf6xe0jAAIAgEw5d+6cdu/e7X6dmpqqlJQU5c+fX1FRUXr00Ue1YcMGff7550pPT9fRo0clSfnz51dgYKBVZdsat4HJJNYAAgDMypY1gEe2e6WfPFGxps9dsWKFGjZsmKE9Pj5eiYmJiomJue7PLV++XA0aNLjdEpEJjAACAOBHDC9NAd+KBg0a6O/Gkxhr8j3cBxAAAMBmGAEEAMCfuLJ/BBA5DwEQAAB/YsEUMHIepoABAABshhFAAAD8iZduBA3/RgAEAMCfMAUME5gCBgAAsBlGAAEA8CfsAoYJBEAAAPyIFTeCRs5DAAQAwJ8wAggTWAMIAABgM4wAAgDgT5gChgkEQAAA/An3AYQJTAEDAADYDCOAAAD4E6aAYQIBEAAAf8IuYJjAFDAAAIDNMAIIAIA/YQoYJhAAAQDwJ0wBwwSmgAEAAGyGEUAAAPyIYXAfQNwcARAAAH/CGkCYQAAEAMCfsAYQJrAGEAAAwGYYAQQAwJ8wBQwTCIAAAPgTF5tAcHNMAQMAANgMI4AAAPgTpoBhAgEQAAB/wi5gmMAUMAAAgM0wAggAgD9hChgmEAABAPAnTAHDBKaAAQAAbIYRQAAA/AkjgDCBAAgAgB8xDG4EjZsjAAIA4E8YAYQJrAEEAACwGUYAAQDwJ9wGBiYQAAEA8CdMAcMEpoABAABshhFAAAD8CVPAMIEACACAP2EKGCYwBQwAAGAzjAACAOBPmAKGCQRAAAD8CVPAMIEpYAAAAJthBBAAAH/CCCBM8OsAGBkZKYfDYercU6dOZXE1AABkA9YAwgS/DoBjx451//nkyZMaPny4mjZtqlq1akmSVq9era+//lqDBw+2qEIAALyMEUCY4DAMw7C6iOzwyCOPqGHDhnr22Wc92t966y0tWbJE8+fPv61+u5Z61AvVAQDsYOq+T7P8Ghc/e8Mr/QQ/3M8r/cA32WYTyNdff60HHnggQ/sDDzygJUuWWFARAABZwHB554Bfs00ALFCggBYsWJChfcGCBSpQoIAFFQEAkAVcLu8ct2DlypVq0aKFoqOj5XA4MsyqGYahl19+WVFRUQoODlbjxo21a9cuL35o3Cq/XgP4Z0lJSerevbtWrFihmjVrSpLWrFmjRYsWacqUKRZXBwBAznX+/HlVrlxZXbt2VZs2bTK8P2LECI0bN04zZsxQTEyMBg8erKZNm2rbtm0KCgqyoGLYJgB27txZsbGxGjdunObOnStJio2N1ffff+8OhAAA5HgWTN82a9ZMzZo1u+57hmFo7Nixeumll9SyZUtJ0vvvv68iRYpo/vz5at++fXaWiv/PNgFQkmrWrKlZs2ZZXQYAAFnHS7uA09LSlJaW5tHmdDrldDpvqZ/U1FQdPXpUjRs3dreFh4erZs2aWr16NQHQIrYKgC6XS7t379bx48fl+ssXpF69ehZVBQCA70lOTlZSUpJH25AhQ5SYmHhL/Rw9elSSVKRIEY/2IkWKuN9D9rNNAPzhhx/UsWNH7d+/X3+9843D4VB6erpFlQEA4EVeGgEcNGiQEhISPNpudfQPvss2AfDpp59W9erV9cUXXygqKsr0E0IAAMhRvHR739uZ7r2eokWLSpKOHTumqKgod/uxY8dUpUqVTPeP22ObALhr1y59+umnKlu2rNWlAABgGzExMSpatKiWLl3qDnxnz57VmjVr9Mwzz1hbnI3ZJgDWrFlTu3fvJgACAPybBY+CO3funHbv3u1+nZqaqpSUFOXPn18lSpRQnz59NHz4cJUrV859G5jo6Gi1atUq22vFH2wTAJ977jn17dtXR48eVcWKFZUnTx6P9ytVqmRRZQAAeJEFAXDdunVq2LCh+/W1tYPx8fGaPn26BgwYoPPnz+upp57S6dOnVadOHS1atIh7AFrINs8CDgjI+NATh8MhwzAytQmEZwEDAMzKlmcBf/CiV/oJfvwVr/QD32SbEcDU1FSrSwAAAPAJtgmAJUuWtLoEAACyngVTwMh5bBMAr9m2bZsOHDigy5cve7Q//PDDFlUEAIAX2WNlFzLJNgFw7969at26tbZs2eJe+yfJfT9AbgQNAADsIuPOCD/Vu3dvxcTE6Pjx48qbN6+2bt2qlStXqnr16lqxYoXV5QEA4B0ul3cO+DXbjACuXr1ay5YtU8GCBRUQEKCAgADVqVNHycnJ6tWrlzZu3Gh1iQAAZB7hDSbYZgQwPT1doaGhkqSCBQvq8OHDkv7YHLJz504rSwMAAMhWthkBrFChgjZt2qSYmBjVrFlTI0aMUGBgoCZPnqzSpUtbXR4AAN5hMAKIm7NNAHzppZd0/vx5SdLQoUPVvHlz1a1bVwUKFNBHH31kcXUAAHiH4WIXMG7ONgGwadOm7j+XLVtWO3bs0KlTpxQZGeneCQwAAGAHtgmA15M/f36rSwAAwLvYBAIT/DoAtmnTxvS5c+fOzcJKAADIJqwBhAl+HQDDw8OtLgEAgOzFGkCY4NcBcNq0aVaXAAAA4HP8OgACAGA7rAGECQRAAAD8CQEQJtjmSSAAAAD4AyOAAAD4E4NNILg52wTA999/X+3atZPT6fRov3z5smbPnq0nnnjCosqQGQ0eb6KGnZqq4B2FJEmHdh3UwnGfasuKjRZXBliH74XNMQUMExyGYY+/KuTKlUtHjhxR4cKFPdpPnjypwoULKz09/bb67VrqUW+Uh9tUuVE1udJdOrbviBwOh2o/0kAPPPWwEh/qr8O7frG6PMASfC9819R9n2b5NS6MftIr/eRNmOKVfuCbbDMCaBjGdR/59ssvv3C/wBxs09L1Hq/nvvFfNXi8icpUvZP/0cG2+F7YHPcBhAl+HwCrVq0qh8Mhh8OhRo0aKXfu//vI6enpSk1N1QMPPGBhhfAWR0CA7n2olpzBQdqz4WerywF8At8LG+JJIDDB7wNgq1atJEkpKSlq2rSp8uXL534vMDBQpUqV0iOPPGJRdfCGYuVL6MW5ryiPM1BpFy7prX+P0OHdjHLA3vheAPg7tlkDOGPGDLVr105BQUG33UdaWprS0tI82p6rGK9cjlyZLQ+ZkCtPbhWILqjg0Lyq/uA/VK9dI73ebgj/s4Ot8b3wTdmyBvD1Ll7pJ+9Anqblz/x+BPCa+Ph4SdL69eu1fft2SdLdd9+tqlWrmu4jOTlZSUlJHm1VwmNVNSLOe4XilqVfuarj+49Kkvb/tFcxlcqqcdcH9f5/JltcGWAdvhf2ZbALGCbYJgAeP35c7du314oVKxQRESFJOn36tBo2bKjZs2erUKFCN+1j0KBBSkhI8Gh7rmJ8VpSLTHAEOJQ7MI/VZQA+he+FjbAJBCbY5kkgzz33nH7//Xdt3bpVp06d0qlTp/TTTz/p7Nmz6tWrl6k+nE6nwsLCPA6mf631yICOurNGrArcUUjFypfQIwM6qvw/7tYP87+zujTAMnwvANyMbUYAFy1apCVLlig2NtbdFhcXp7fffltNmjSxsDJkRliBcHUf/ZzCC0Xq4u8X9MuO/Rr9xHBt+36z1aUBluF7YXPsAoYJtgmALpdLefJknP7IkyePXKyXyLGmDZxodQmAz+F7YXNMAcME20wB//Of/1Tv3r11+PBhd9uhQ4f0/PPPq1GjRhZWBgAAkL1sEwDfeustnT17VqVKlVKZMmVUpkwZxcTE6OzZsxo/frzV5QEA4B0ul3cO+DXbTAEXL15cGzZs0JIlS7Rjxw5JUmxsrBo3bmxxZQAAeBFTwDDBNgFQkhwOh+6//37df//9VpcCAABgGVsFwKVLl2rp0qU6fvx4ho0fU6dOtagqAAC8iF3AMME2ATApKUlDhw5V9erVFRUVJYfDYXVJAAB4H1PAMME2AXDSpEmaPn26/vWvf1ldCgAAgKVsEwAvX76s++67z+oyAADIUjwLGGbY5jYw3bt314cffmh1GQAAZC2X4Z0Dfs02I4CXLl3S5MmTtWTJElWqVCnDU0FGjx5tUWUAAHgR4Q0m2CYAbt68WVWqVJEk/fTTTx7vsSEEAADYiW0C4PLly60uAQCArMdtYGCCbQIgAAC2wBQwTLDNJhAAAAD8gRFAAAD8iMEIIEwgAAIA4E8IgDCBKWAAAACb8esRwM8++8z0uQ8//HAWVgIAQDbhSSAwwa8DYKtWrTxeOxwOGYbh8fqa9PT07CoLAICswxQwTPDrKWCXy+U+vvnmG1WpUkVfffWVTp8+rdOnT+vLL7/UPffco0WLFlldKgAAQLbx6xHAP+vTp48mTZqkOnXquNuaNm2qvHnz6qmnntL27dstrA4AAC9hBBAm+PUI4J/t2bNHERERGdrDw8O1b9++bK8HAICsYBiGV45bkZ6ersGDBysmJkbBwcEqU6aMhg0bdsv9IPvYZgTw3nvvVUJCgmbOnKkiRYpIko4dO6b+/furRo0aFlcHAICXWDAC+Prrr2vixImaMWOG7r77bq1bt05dunRReHi4evXqle314OZsEwCnTp2q1q1bq0SJEipevLgk6eDBgypXrpzmz59vbXEAAORgq1atUsuWLfXQQw9JkkqVKqX//ve/+vHHHy2uDDdimwBYtmxZbd68WYsXL9aOHTskSbGxsWrcuLHHbmAAAHI0C0YA77vvPk2ePFk///yz7rzzTm3atEnff/+9Ro8ene21wBzbBEDpj9u+NGnSRE2aNLG6FAAAsoS3HgWXlpamtLQ0jzan0ymn05nh3BdeeEFnz57VXXfdpVy5cik9PV2vvPKKOnXq5JVa4H1+HQDHjRunp556SkFBQRo3btzfnssaBQAA/k9ycrKSkpI82oYMGaLExMQM53788ceaNWuWPvzwQ919991KSUlRnz59FB0drfj4+GyqGLfCYfjxFp2YmBitW7dOBQoUUExMzA3Pczgc2rt3721do2upR2+3PACAzUzd92mWX+NMfCOv9BM0+UvTI4DFixfXCy+8oJ49e7rbhg8frg8++MC97Aq+xa9HAFNTU6/7ZwAA/JaXngR3o7B3PRcuXFBAgOed5XLlyiUXj6XzWX4dAAEAQNZr0aKFXnnlFZUoUUJ33323Nm7cqNGjR6tr165Wl4Yb8OsAmJCQYPpcdioBAPyBtzaB3Irx48dr8ODB6tGjh44fP67o6Gj9+9//1ssvv5zttcAcvw6AGzdu9Hi9YcMGXb16VeXLl5ck/fzzz8qVK5eqVatmRXkAAHifBQEwNDRUY8eO1dixY7P92rg9fh0Aly9f7v7z6NGjFRoaqhkzZigyMlKS9Ntvv6lLly6qW7euVSUCAABkO9s8C3jUqFFKTk52hz9JioyM1PDhwzVq1CgLKwMAwItcXjrg1/x6BPDPzp49qxMnTmRoP3HihH7//XcLKgIAwPusWAOInMc2I4CtW7dWly5dNHfuXP3yyy/65ZdfNGfOHHXr1k1t2rSxujwAALyDEUCYYJsRwEmTJqlfv37q2LGjrly5IknKnTu3unXrppEjR1pcHQAAQPaxTQDMmzevJkyYoJEjR2rPnj2SpDJlyigkJMTiygAA8B6mgGGGbQLgNSEhIapUqZLVZQAAkDWYvoUJtlkDCAAAgD/YbgQQAAB/ZjACCBMIgAAA+BMCIExgChgAAMBmGAEEAMCPMAUMMwiAAAD4EwIgTGAKGAAAwGYYAQQAwI8wBQwzCIAAAPgRAiDMIAACAOBHCIAwgzWAAAAANsMIIAAA/sRwWF0BcoAcFwBPnz6tiIgIq8sAAMAnMQUMM3x6Cvj111/XRx995H7dtm1bFShQQMWKFdOmTZssrAwAACDn8ukAOGnSJBUvXlyStHjxYi1evFhfffWVmjVrpv79+1tcHQAAvsdwObxywL/59BTw0aNH3QHw888/V9u2bdWkSROVKlVKNWvWtLg6AAB8D1PAMMOnRwAjIyN18OBBSdKiRYvUuHFjSZJhGEpPT7eyNAAAgBzLp0cA27Rpo44dO6pcuXI6efKkmjVrJknauHGjypYta3F1AAD4HoNdwDDBpwPgmDFjVKpUKR08eFAjRoxQvnz5JElHjhxRjx49LK4OAADfwxQwzPDpAJgnTx7169cvQ/vzzz9vQTUAAAD+wecC4GeffWb63IcffjgLKwEAIOdhBy/M8LkA2KpVK1PnORwONoIAAPAXhmF1BcgJfC4AulwsXgAA4HYxAggzfPo2MH926dIlq0sAAADwCz4dANPT0zVs2DAVK1ZM+fLl0969eyVJgwcP1nvvvWdxdQAA+B6eBAIzfDoAvvLKK5o+fbpGjBihwMBAd3uFChX07rvvWlgZAAC+yTC8c8C/+XQAfP/99zV58mR16tRJuXLlcrdXrlxZO3bssLAyAACAnMvnNoH82aFDh677xA+Xy6UrV65YUBEAAL6N6VuY4dMjgHFxcfruu+8ytH/66aeqWrWqBRUBAODbDMPhlQP+zadHAF9++WXFx8fr0KFDcrlcmjt3rnbu3Kn3339fn3/+udXlAQAA5Eg+PQLYsmVLLVy4UEuWLFFISIhefvllbd++XQsXLtT9999vdXkAAPgcw+WdA/7Np0cAJalu3bpavHix1WUAAJAjuJi+hQk+HwAlad26ddq+fbukP9YFVqtWzeKKAAAAci6fDoC//PKLOnTooP/973+KiIiQJJ0+fVr33XefZs+erTvuuMPaAgEA8DFs4IAZPr0GsHv37rpy5Yq2b9+uU6dO6dSpU9q+fbtcLpe6d+9udXkAAPgcngQCM3x6BPDbb7/VqlWrVL58eXdb+fLlNX78eNWtW9fCygAA8E08xQNm+PQIYPHixa97w+f09HRFR0dbUBEAAEDO59MBcOTIkXruuee0bt06d9u6devUu3dvvfHGGxZWBgCAb2IKGGb43BRwZGSkHI7/+xfv/PnzqlmzpnLn/qPUq1evKnfu3OratatatWplUZUAAPgmbgMDM3wuAI4dO9bqEgAAAPyazwXA+Ph4q0sAACDH4jYwMMPnAuCNXLp0SZcvX/ZoCwsLs6gaAAB8E7uAYYZPbwI5f/68nn32WRUuXFghISGKjIz0OAAAAHDrfDoADhgwQMuWLdPEiRPldDr17rvvKikpSdHR0Xr//fetLg8AAJ/jMhxeOeDffDoALly4UBMmTNAjjzyi3Llzq27dunrppZf06quvatasWVaXBwCAzzEMh1eOW3Xo0CE9/vjjKlCggIKDg1WxYkWP27jBt/h0ADx16pRKly4t6Y/1fqdOnZIk1alTRytXrrSyNAAA8P/99ttvql27tvLkyaOvvvpK27Zt06hRo1iu5cN8ehNI6dKllZqaqhIlSuiuu+7Sxx9/rBo1amjhwoWKiIiwujwAAHyOFZtAXn/9dRUvXlzTpk1zt8XExGR/ITDNp0cAu3Tpok2bNkmSXnjhBb399tsKCgrS888/r/79+1tcHQAAvsdbawDT0tJ09uxZjyMtLe261/zss89UvXp1PfbYYypcuLCqVq2qKVOmZPMnx61wGEbO2TC+f/9+rV+/XmXLllWlSpWsLkeSlDuwmNUlAD7n4uHvrC4B8El5CpbO8musLdbaK/188WRlJSUlebQNGTJEiYmJGc4NCgqSJCUkJOixxx7T2rVr1bt3b02aNIn7+/qoHBUAfREBEMiIAAhcX04KgJX2zs4w4ud0OuV0OjOcGxgYqOrVq2vVqlXutl69emnt2rVavXq1V+qBd/ncGsBx48aZPrdXr15ZWAkAADmPt27hcqOwdz1RUVGKi4vzaIuNjdWcOXO8Ugu8z+cC4JgxY0yd53A4CIAAAPyFFdN6tWvX1s6dOz3afv75Z5UsWdKCamCGzwXA1NRUq0sAAAC34Pnnn9d9992nV199VW3bttWPP/6oyZMna/LkyVaXhhvwuQAIAABunxVP8bj33ns1b948DRo0SEOHDlVMTIzGjh2rTp06ZXstMIcACACAH7mdp3h4Q/PmzdW8eXNLro1b59P3AQQAAID3MQIIAIAfcVldAHIEAiAAAH7EkDVTwMhZfH4K+LvvvtPjjz+uWrVq6dChQ5KkmTNn6vvvv7e4MgAAgJzJpwPgnDlz1LRpUwUHB2vjxo3uO5KfOXNGr776qsXVAQDge1yGdw74N58OgMOHD9ekSZM0ZcoU5cmTx91eu3ZtbdiwwcLKAADwTS45vHLAv/n0GsCdO3eqXr16GdrDw8N1+vTp7C8IAAAfxxpAmOHTI4BFixbV7t27M7R///33Kl066x+oDQAA4I98OgA++eST6t27t9asWSOHw6HDhw9r1qxZ6tevn5555hmrywMAwOe4vHTAv/n0FPALL7wgl8ulRo0a6cKFC6pXr56cTqf69eun5557zuryAADwOUwBwwyHYRg+v9fn8uXL2r17t86dO6e4uDjly5fP6pLccgcWs7oEwOdcPPyd1SUAPilPwaxfvvRNkfZe6afJsdle6Qe+yadHAK8JDAxUXFyc1WUAAODzmL6FGT4dABs2bCiH48ZD2cuWLcvGagAA8H0EQJjh0wGwSpUqHq+vXLmilJQU/fTTT4qPj7emKAAAgBzOpwPgmDFjrtuemJioc+fOZXM1AAD4PjaBwAyfvg3MjTz++OOaOnWq1WUAAOBzXA7vHPBvOTIArl69WkFBQVaXAQAAkCP59BRwmzZtPF4bhqEjR45o3bp1Gjx4sEVVAQDgu3iOL8zw6QAYHh7u8TogIEDly5fX0KFD1aRJE4uqAgDAd/n8zX3hE3w2AKanp6tLly6qWLGiIiMjrS4HAIAcgdvAwAyfXQOYK1cuNWnSRKdPn7a6FAAAAL/iswFQkipUqKC9e/daXQYAADmGy+HwygH/5tMBcPjw4erXr58+//xzHTlyRGfPnvU4AACAJ8NLB/ybT64BHDp0qPr27asHH3xQkvTwww97PBLOMAw5HA6lp6dbVSIAAECO5ZMBMCkpSU8//bSWL19udSkAAOQobAKBGT4ZAA3jj8Hn+vXrW1wJAAA5C0/xgBk+uwbQwQJUAACALOGTI4CSdOedd940BJ46dSqbqgEAIGfgSSAww2cDYFJSUoYngQAAgL/HDl6Y4bMBsH379ipcuLDVZQAAkKOwBhBm+OQaQNb/AQAAZB2fHAG8tgsYAADcGm4DAzN8MgC6XPzrCwDA7WAIBWb45BQwAAAAso5PjgACAIDbwyYQmEEABADAj7CICmYwBQwAAGAzjAACAOBHGAGEGQRAAAD8iMEaQJjAFDAAAIDNMAIIAIAfYQoYZhAAAQDwIwRAmEEABADAj/AkEJjBGkAAAACbYQQQAAA/wpNAYAYBEAAAP8IaQJjBFDAAAIDNMAIIAIAfYQQQZhAAAQDwI+wChhlMAQMAANgMI4AAAPgRdgHDDEYAAQDwIy4vHbfrtddek8PhUJ8+fTLRC7IaARAAAHjF2rVr9c4776hSpUpWl4KbIAACAOBHDC8dt+rcuXPq1KmTpkyZosjIyMx+DGQxAiAAAH7EJcMrR1pams6ePetxpKWl3fC6PXv21EMPPaTGjRtn46fF7SIAAgDgR7y1BjA5OVnh4eEeR3Jy8nWvOXv2bG3YsOGG78P3sAsYAABkMGjQICUkJHi0OZ3ODOcdPHhQvXv31uLFixUUFJRd5SGTCIAAAPgRb90I2ul0Xjfw/dX69et1/Phx3XPPPe629PR0rVy5Um+99ZbS0tKUK1cuL1UFbyEAAgDgR7L7UXCNGjXSli1bPNq6dOmiu+66SwMHDiT8+SgCIAAAuG2hoaGqUKGCR1tISIgKFCiQoR2+gwAIAIAf4UkgMIMACACAH3F5bRXg7VuxYoXVJeAmuA0MAACAzTACCACAH7F+/A85AQEQAAA/kt27gJEzMQUMAABgM7YYAdy8ebPpcytVqpSFlQAAkLV8YRMIfJ8tAmCVKlXkcDhkGIYcjr/fH5+enp5NVQEA4H3EP5hhiyng1NRU7d27V6mpqZozZ45iYmI0YcIEbdy4URs3btSECRNUpkwZzZkzx+pSAQDIFJeXDvg3W4wAlixZ0v3nxx57TOPGjdODDz7obqtUqZKKFy+uwYMHq1WrVhZUCAAAkH1sEQD/bMuWLYqJicnQHhMTo23btllQEQAA3sMaQJhhiyngP4uNjVVycrIuX77sbrt8+bKSk5MVGxtrYWUAAGSe4aUD/s12I4CTJk1SixYtdMcdd7h3/G7evFkOh0MLFy60uDoAAICsZ7sAWKNGDe3du1ezZs3Sjh07JEnt2rVTx44dFRISYnF1AABkDhs4YIbtAqAkhYSE6KmnnrK6DAAAvM5gAhcm2G4NoCTNnDlTderUUXR0tPbv3y9JGjNmjBYsWGBxZQAAAFnPdgFw4sSJSkhIULNmzfTbb7+5b/wcGRmpsWPHWlscAACZxH0AYYbtAuD48eM1ZcoUvfjii8qd+/9mwKtXr64tW7ZYWBkAAJnnkuGVA/7NdgEwNTVVVatWzdDudDp1/vx5CyoCAADIXrYLgDExMUpJScnQvmjRIu4DCADI8bgPIMyw3S7ghIQE9ezZU5cuXZJhGPrxxx/13//+V8nJyXr33XetLg+36Zmn49U34RkVLVpImzdvU+8+g7V2XYrVZQHZYl3KFk378FNt27FbJ06e0pvJg9Wo3n2SpCtXr2r85Bn6bvU6/XL4iPKFhOgf91bV8093UeFCBSyuHFmB6VuYYbsA2L17dwUHB+ull17ShQsX1LFjR0VHR+vNN99U+/btrS4Pt+Gxxx7WGyOHqEfPF/Tj2o3q9Vx3ffnFLMVVqKcTJ05aXR6Q5S5evKTyZUur9UNN1Oc/wz3eu3QpTdt27tG/O3dQ+bKldfb33/Xam+/o2YFJ+njqOIsqRlZiAwfMcBiGYdu/Kly4cEHnzp1T4cKFb7uP3IHFvFgRbseq7xdq7bpN6t3nJUmSw+HQvr1r9faEaRox8m2Lq7Oni4e/s7oE26pQu5nHCOD1bNm+Ux2699HiOTMUVfT2//uHW5enYOksv8aTpR7zSj9T9n3ilX7gm2y3BvDP8ubNm6nwB+vlyZNH99xTSUuX/V/gMAxDS5d9r3/8o5qFlQG+69y5C3I4HAoN5elH/sjw0j/wb7aYAq5ataocDoepczds2JDF1cCbChbMr9y5c+v4sV892o8fP6G7ypexqCrAd6WlXdaYiVP1YOP6ysfjL/0SU8AwwxYBsFWrVu4/X7p0SRMmTFBcXJxq1aolSfrhhx+0detW9ejR42/7SUtLU1pamkebYRimwyUAWOnK1avqO/hVGYahwf2ftbocABayRQAcMmSI+8/du3dXr169NGzYsAznHDx48G/7SU5OVlJSkkebIyCfHLnCvFcsbsmvv57S1atXVbhIQY/2woUL6eixExZVBfiea+Hv8LHjmjruNUb//BjTtzDDdmsAP/nkEz3xxBMZ2h9//HHNmTPnb3920KBBOnPmjMfhCAjNqlJhwpUrV7Rhw2b9s2Edd5vD4dA/G9bRDz+st7AywHdcC38HDh7Wu2NfVUQ4f2n1ZzwKDmbYYgTwz4KDg/W///1P5cqV82j/3//+p6CgoL/9WafTKafT6dHG9K/1xrw5RdPeG6P1GzZr7dqN6vXckwoJCdb0GR9ZXRqQLS5cuKgDvxx2vz50+Jh2/LxH4WGhKlgwvxJefEXbft6tt0ckyeVy6deTpyRJ4WGhypMnj1VlA7CQ7QJgnz599Mwzz2jDhg2qUaOGJGnNmjWaOnWqBg8ebHF1uB2ffPKZChXMr8SX+6lo0ULatGmrHmr+uI4f//XmPwz4gZ927FLX5wa6X48YP1mS1LJZY/Xo9riWf/+DJOnRzj09fm7q+NdV455K2VcosoXLvnd3wy2w5X0AP/74Y7355pvavn27JCk2Nla9e/dW27Ztb7kv7gMIZMR9AIHry477AD5eso1X+vlg/1yv9APfZLsRQElq27btbYU9AAAAf2DLAChJly9f1vHjx+VyeS51LVGihEUVAQCQeTwLGGbYLgDu2rVLXbt21apVqzzar93PLz093aLKAADIPG4DAzNsFwA7d+6s3Llz6/PPP1dUVBS7eAEAfoVbuMAM2wXAlJQUrV+/XnfddZfVpQAAAFjCdgEwLi5Ov/7K7UEAAP6JNYAww3ZPAnn99dc1YMAArVixQidPntTZs2c9DgAAcjLDS//Av9luBLBx48aSpEaNGnm0swkEAADYhe0C4PLly60uAQCALMMmEJhhuwBYv359q0sAACDL2PABX7gNtguA11y4cEEHDhzQ5cuXPdorVeK5mAAAwL/ZLgCeOHFCXbp00VdffXXd91kDCADIydgFDDNstwu4T58+On36tNasWaPg4GAtWrRIM2bMULly5fTZZ59ZXR4AAJni8tIB/2a7EcBly5ZpwYIFql69ugICAlSyZEndf//9CgsLU3Jysh566CGrSwQAAMhSthsBPH/+vAoXLixJioyM1IkTJyRJFStW1IYNG6wsDQCATOM+gDDDdgGwfPny2rlzpySpcuXKeuedd3To0CFNmjRJUVFRFlcHAEDmuGR45YB/s90UcO/evXXkyBFJ0pAhQ/TAAw/ogw8+UGBgoGbMmGFxdQAAZA63gYEZtguAjz/+uPvP1apV0/79+7Vjxw6VKFFCBQsWtLAyAACA7GGLAJiQkGD63NGjR2dhJQAAZC128MIMWwTAjRs3mjrP4XBkcSUAAGQtNnDADFsEQJ7/CwAA8H9stwsYAAB/ZsUu4OTkZN17770KDQ1V4cKF1apVK/cdN+CbCIAAAPgRwzC8ctyKb7/9Vj179tQPP/ygxYsX68qVK2rSpInOnz+fRZ8SmWWLKWAAAJB1Fi1a5PF6+vTpKly4sNavX6969epZVBX+DgEQAAA/4gs3cT5z5owkKX/+/BZXghshAAIA4Ee8tQs4LS1NaWlpHm1Op1NOp/Nvf87lcqlPnz6qXbu2KlSo4JVa4H2sAQQAABkkJycrPDzc40hOTr7pz/Xs2VM//fSTZs+enQ1V4nY5DJ4Zkym5A4tZXQLgcy4e/s7qEgCflKdg6Sy/Rr1ijbzSz+K9X97yCOCzzz6rBQsWaOXKlYqJifFKHcgaTAEDAOBHvDWqY2a6131Nw9Bzzz2nefPmacWKFYS/HIAACACAH7FiE0jPnj314YcfasGCBQoNDdXRo0clSeHh4QoODs72enBzrAEEAACZMnHiRJ05c0YNGjRQVFSU+/joo4+sLg03wAggAAB+xIoRQLYT5DwEQAAA/AhhDGYwBQwAAGAzjAACAOBHfOFJIPB9BEAAAPyIt54EAv/GFDAAAIDNMAIIAIAfYRMIzCAAAgDgR1gDCDOYAgYAALAZRgABAPAjTAHDDAIgAAB+hClgmEEABADAj3AbGJjBGkAAAACbYQQQAAA/4mINIEwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EaaAYQYBEAAAP8IUMMxgChgAAMBmGAEEAMCPMAUMMwiAAAD4EaaAYQZTwAAAADbDCCAAAH6EKWCYQQAEAMCPMAUMMwiAAAD4EcNwWV0CcgDWAAIAANgMI4AAAPgRF1PAMIEACACAHzHYBAITmAIGAACwGUYAAQDwI0wBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAf4UkgMIMACACAH+FJIDCDKWAAAACbYQQQAAA/wiYQmEEABADAj3AbGJhBAAQAwI8wAggzWAMIAABgM4wAAgDgR7gNDMwgAAIA4EeYAoYZTAEDAADYDCOAAAD4EXYBwwwCIAAAfoQpYJjBFDAAAIDNMAIIAIAfYRcwzCAAAgDgRwzWAMIEpoABAABshhFAAAD8CFPAMIMACACAH2EXMMwgAAIA4EdYAwgzWAMIAABgMwRAAAD8iGEYXjlux9tvv61SpUopKChINWvW1I8//ujlTwdvIQACAOBHrAqAH330kRISEjRkyBBt2LBBlStXVtOmTXX8+PEs+JTILAIgAADItNGjR+vJJ59Uly5dFBcXp0mTJilv3ryaOnWq1aXhOgiAAAD4EcNLR1pams6ePetxpKWlXfealy9f1vr169W4cWN3W0BAgBo3bqzVq1dnzQdFprALOJOuXj5kdQnQH/+hSk5O1qBBg+R0Oq0uB/AZfDfsx1v/X0pMTFRSUpJH25AhQ5SYmJjh3F9//VXp6ekqUqSIR3uRIkW0Y8cOr9QD73IY3DAIfuDs2bMKDw/XmTNnFBYWZnU5gM/gu4HblZaWlmHEz+l0XvcvEocPH1axYsW0atUq1apVy90+YMAAffvtt1qzZk2W14tbwwggAADI4EZh73oKFiyoXLly6dixYx7tx44dU9GiRbOiPGQSawABAECmBAYGqlq1alq6dKm7zeVyaenSpR4jgvAdjAACAIBMS0hIUHx8vKpXr64aNWpo7NixOn/+vLp06WJ1abgOAiD8gtPp1JAhQ1jkDvwF3w1kl3bt2unEiRN6+eWXdfToUVWpUkWLFi3KsDEEvoFNIAAAADbDGkAAAACbIQACAADYDAEQAADAZgiAyJQGDRqoT58+7telSpXS2LFj//ZnHA6H5s+fn6V1mdW5c2e1atUqy68zffp0RUREZPl14N/++n3LComJiapSpUqWXgOA9dgFDK9au3atQkJCrC5DiYmJmj9/vlJSUqwuBQAAn0MAhFcVKlTI6hIAAMBNMAUM086fP68nnnhC+fLlU1RUlEaNGpXhnL9OAe/atUv16tVTUFCQ4uLitHjx4ptep0GDBurVq5cGDBig/Pnzq2jRohkePn7gwAG1bNlS+fLlU1hYmNq2bet+BNH06dOVlJSkTZs2yeFwyOFwaPr06aY+46JFi1SnTh1FRESoQIECat68ufbs2eN+f9++fXI4HJo7d64aNmyovHnzqnLlylq9erVHP9OnT1eJEiWUN29etW7dWidPnjR1fcCsmTNnqnr16goNDVXRokXVsWNHHT9+3P3+ihUr5HA4tHTpUlWvXl158+bVfffdp507d3r089prr6lIkSIKDQ1Vt27ddOnSpez+KAAsQACEaf3799e3336rBQsW6JtvvtGKFSu0YcOGG57vcrnUpk0bBQYGas2aNZo0aZIGDhxo6lozZsxQSEiI1qxZoxEjRmjo0KHu8OhyudSyZUudOnVK3377rRYvXqy9e/eqXbt2kv64GWnfvn11991368iRIzpy5Ij7vZs5f/68EhIStG7dOi1dulQBAQFq3bq1XC6Xx3kvvvii+vXrp5SUFN15553q0KGDrl69Kklas2aNunXrpmeffVYpKSlq2LChhg8fbur6gFlXrlzRsGHDtGnTJs2fP1/79u1T586dM5z34osvatSoUVq3bp1y586trl27ut/7+OOPlZiYqFdffVXr1q1TVFSUJkyYkI2fAoBlDMCE33//3QgMDDQ+/vhjd9vJkyeN4OBgo3fv3u62kiVLGmPGjDEMwzC+/vprI3fu3MahQ4fc73/11VeGJGPevHk3vFb9+vWNOnXqeLTde++9xsCBAw3DMIxvvvnGyJUrl3HgwAH3+1u3bjUkGT/++KNhGIYxZMgQo3Llyjf9XPHx8UbLli1v+P6JEycMScaWLVsMwzCM1NRUQ5Lx7rvvZrj29u3bDcMwjA4dOhgPPvigRz/t2rUzwsPDb1oP8Hfq16/v8X37s7Vr1xqSjN9//90wDMNYvny5IclYsmSJ+5wvvvjCkGRcvHjRMAzDqFWrltGjRw+PfmrWrGnquwMgZ2MEEKbs2bNHly9fVs2aNd1t+fPnV/ny5W/4M9u3b1fx4sUVHR3tbjP7UPBKlSp5vI6KinJPb13rt3jx4u734+LiFBERoe3bt5vq/0Z27dqlDh06qHTp0goLC1OpUqUk/THlfKP6oqKiJMmjvj//niTznxswa/369WrRooVKlCih0NBQ1a9fXxL/rgIwhwAIn5QnTx6P1w6HI8M0bFZo0aKFTp06pSlTpmjNmjVas2aNJOny5cs3rM/hcEhSttQHSH8sVWjatKnCwsI0a9YsrV27VvPmzZPEv6sAzCEAwpQyZcooT5487kAkSb/99pt+/vnnG/5MbGysDh48qCNHjrjbfvjhh0zXcq3fgwcPutu2bdum06dPKy4uTpIUGBio9PT0W+r35MmT2rlzp1566SU1atRIsbGx+u23326rvj//niTvfG7gmh07dujkyZN67bXXVLduXd11110eG0DM4t9VwL64DQxMyZcvn7p166b+/furQIECKly4sF588UUFBNz47xCNGzfWnXfeqfj4eI0cOVJnz57Viy++mOlaGjdurIoVK6pTp04aO3asrl69qh49eqh+/fqqXr26pD92I6empiolJUV33HGHQkND5XQ6/7bfyMhIFShQQJMnT1ZUVJQOHDigF1544Zbr69Wrl2rXrq033nhDLVu21Ndff61Fixbd1mcFrqdEiRIKDAzU+PHj9fTTT+unn37SsGHDbrmf3r17q3Pnzqpevbpq166tWbNmaevWrSpdunQWVA3AlzACCNNGjhypunXrqkWLFmrcuLHq1KmjatWq3fD8gIAAzZs3TxcvXlSNGjXUvXt3vfLKK5muw+FwaMGCBYqMjFS9evXUuHFjlS5dWh999JH7nEceeUQPPPCAGjZsqEKFCum///3vTfsNCAjQ7NmztX79elWoUEHPP/+8Ro4cecv1/eMf/9CUKVP05ptvqnLlyvrmm2/00ksv3XI/wI0UKlRI06dP1yeffKK4uDi99tpreuONN265n3bt2mnw4MEaMGCAqlWrpv379+uZZ57JgooB+BqHYRiG1UUAAAAg+zACCAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAZvo3LmzWrVq5X7doEED9enTJ9vrWLFihRwOh06fPn3DcxwOh+bPn2+6z8TERFWpUiVTde3bt08Oh0MpKSmZ6gcAcgICIGChzp07y+FwyOFwKDAwUGXLltXQoUN19erVLL/23LlzTT8+zExoAwDkHDwLGLDYAw88oGnTpiktLU1ffvmlevbsqTx58mjQoEEZzr18+bICAwO9ct38+fN7pR8AQM7DCCBgMafTqaJFi6pkyZJ65pln1LhxY3322WeS/m/a9pVXXlF0dLTKly8vSTp48KDatm2riIgI5c+fXy1bttS+ffvcfaanpyshIUEREREqUKCABgwYoL8+9fGvU8BpaWkaOHCgihcvLqfTqbJly+q9997Tvn371LBhQ0lSZGSkHA6HOnfuLElyuVxKTk5WTEyMgoODVblyZX366ace1/nyyy915513Kjg4WA0bNvSo06yBAwfqzjvvVN68eVW6dGkNHjxYV65cyXDeO++8o+LFiytv3rxq27atzpw54/H+u+++q9jYWAUFBemuu+7ShAkTbnjN3377TZ06dVKhQoUUHByscuXKadq0abdcOwD4IkYAAR8THByskydPul8vXbpUYWFhWrx4sSTpypUratq0qWrVqqXvvvtOuXPn1vDhw/XAAw9o8+bNCgwM1KhRozR9+nRNnTpVsbGxGjVqlObNm6d//vOfN7zuE088odWrV2vcuHGqXLmyUlNT9euvv6p48eKaM2eOHnnkEe3cuVNhYWEKDg6WJCUnJ+uDDz7QpEmTVK5cOa1cuVKPP/64ChUqpPr16+vgwYNq06aNevbsqaeeekrr1q1T3759b/l3EhoaqunTpys6OlpbtmzRk08+qdDQUA0YMMB9zu7du/Xxxx9r4cKFOnv2rLp166YePXpo1qxZkqRZs2bp5Zdf1ltvvaWqVatq48aNevLJJxUSEqL4+PgM1xw8eLC2bdumr776SgULFtTu3bt18eLFW64dAHySAcAy8fHxRsuWLQ3DMAyXy2UsXrzYcDqdRr9+/dzvFylSxEhLS3P/zMyZM43y5csbLpfL3ZaWlmYEBwcbX3/9tWEYhhEVFWWMGDHC/f6VK1eMO+64w30twzCM+vXrG7179zYMwzB27txpSDIWL1583TqXL19uSDJ+++03d9ulS5eMvHnzGqtWrfI4t1u3bkaHDh0MwzCMQYMGGXFxcR7vDxw4MENffyXJmDdv3g3fHzlypFGtWjX36yFDhhi5cuUyfvnlF3fbV199ZQQEBBhHjhwxDMMwypQpY3z44Yce/QwbNsyoVauWYRiGkZqaakgyNm7caBiGYbRo0cLo0qXLDWsAgJyMEUDAYp9//rny5cunK1euyOVyqWPHjkpMTHS/X7FiRY91f5s2bdLu3bsVGhrq0c+lS5e0Z88enTlzRkeOHFHNmjXd7+XOnVvVq1fPMA18TUpKinLlyqX69eubrnv37t26cOGC7r//fo/2y5cvq2rVqpKk7du3e9QhSbVq1TJ9jWs++ugjjRs3Tnv27NG5c+d09epVhYWFeZxTokQJFStWzOM6LpdLO3fuVGhoqPbs2aNu3brpySefdJ9z9epVhYeHX/eazzzzjB555BFt2LBBTZo0UatWrXTffffdcu0A4IsIgIDFGjZsqIkTJyowMFDR0dHKndvzaxkSEuLx+ty5c6pWrZp7avPPChUqdFs1XJvSvRXnzp2TJH3xxRcewUv6Y12jt6xevVqdOnVSUlKSmjZtqvDwcM2ePVujRo265VqnTJmSIZDmypXruj/TrFkz7d+/X19++aUWL16sRo0aqWfPnnrjjTdu/8MAgI8gAAIWCwkJUdmyZU2ff8899+ijjz5S4cKFM4yCXRMVFaU1a9aoXr16kv4Y6Vq/fr3uueee655fsWJFuVwuffvtt2rcuHGG96+NQKanp7vb4uLi5HQ6deDAgRuOHMbGxro3tFzzww8/3PxD/smqVatUsmRJvfjii+62/fv3ZzjvwIEDOnz4sKKjo93XCQgIUPny5VWkSBFFR0dr79696tSpk+lrFypUSPHx8YqPj1fdunXVv39/AiAAv8AuYCCH6dSpkwoWLKiWLVvqu+++U2pqqlasWKFevXrpl19+kST17t1br732mubPn68dO3aoR48ef3sPv1KlSik+Pl5du3bV/Pnz3X1+/PHHkqSSJUvK4XDo888/14kTJ3Tu3DmFhoaqX79+ev755zVjxgzt2bNHGzZs0Pjx4zVjxgxJ0tNPP61du3apf//+2rlzpz788ENNnz79lj5vuXLldODAAc2ePVt79uzRuHHjNG/evAznBQUFKT4+Xps2bdJ3332nXr16qW3btipatKgkKSkpScnJyRo3bpx+/vlnbdmyRdOmTdPo0aOve92XX35ZCxYs0O7du7V161Z9/vnnio2NvaXaAcBXEQCBHCZv3rxauXKlSpQooTZt2ig2NlbdunXTpUuX3COCffv21b/+9S/Fx8erVq1aCg0NVevWrf+234kTJ+rRRx9Vjx49dNddd+nJJ5/U+fPnJUnFihVTUlKSXnjhBRUpUkTPPvusJGnYsGEaPHiwkpOTFRsbqwceeEBffPGFYmJiJP2xLm/OnDmaP3++KleurEmTJunVV1+9pc/78MMP6/nnn9ezzz6rKlWqaNWqVRo8eHCG88qWLas2bdrowQcfVJMmTVSpUiWP27x0795d7777rqZNm6aKFSuqfv36mj59urvWvwoMDNSgQYNUqVIl1atXT7ly5dLs2bNvqXYA8FUO40arwgEAAOCXGAEEAACwGQIgAACAzRAAAQAAbIYACAAAYDMEQAAAAJshAAIAANgMARAAAMBmCIAAAAA2QwAEAACwGQIgAACAzRAAAQAAbIYACAAAYDP/D32GkVATVcrxAAAAAElFTkSuQmCC"}, "metadata": {}}], "id": "7b021ac7-870a-445b-9459-021c9e78f745"}, {"cell_type": "markdown", "source": "## TASK  12\n", "metadata": {}, "id": "3a98ab95-6763-4bcc-ae98-d76fc1c0812b"}, {"cell_type": "markdown", "source": "Find the method performs best:\n", "metadata": {}, "id": "965a2d1d-7ac3-458c-ba11-10f97d22e927"}, {"cell_type": "code", "source": "algorithms = {'KNN':knn_cv.best_score_,'Tree':tree_cv.best_score_,'LogisticRegression':logreg_cv.best_score_,'SVM':svm_cv.best_score_}\nbestalgorithm = max(algorithms, key=algorithms.get)\nprint('Best Algorithm is',bestalgorithm,'with a score of',algorithms[bestalgorithm])", "metadata": {}, "execution_count": 40, "outputs": [{"name": "stdout", "text": "Best Algorithm is Tree with a score of 0.8875\n", "output_type": "stream"}], "id": "7e2da33c-70ca-46ae-98a7-9ed8cdb4dabe"}, {"cell_type": "markdown", "source": "## Authors\n", "metadata": {}, "id": "2388a641-817f-4e15-815a-f66278c656b0"}, {"cell_type": "markdown", "source": "[Pratiksha Verma](https://www.linkedin.com/in/pratiksha-verma-6487561b1/?utm_medium=Exinfluencer&utm_source=Exinfluencer&utm_content=000026UJ&utm_term=10006555&utm_id=NA-SkillsNetwork-Channel-SkillsNetworkCoursesIBMDS0321ENSkillsNetwork865-2022-01-01)\n", "metadata": {}, "id": "8845aea5-d412-4eac-9b51-3457f0be2c0f"}, {"cell_type": "markdown", "source": "## Change Log\n", "metadata": {}, "id": "02bdba00-e939-4425-b819-417baeb84f8c"}, {"cell_type": "markdown", "source": "| Date (YYYY-MM-DD) | Version | Changed By      | Change Description      |\n| ----------------- | ------- | -------------   | ----------------------- |\n| 2022-11-09        | 1.0     | Pratiksha Verma | Converted initial version to Jupyterlite|\n", "metadata": {}, "id": "91fce393-48e3-493a-a228-9d58989c4766"}, {"cell_type": "markdown", "source": "### <h3 align=\"center\"> IBM Corporation 2022. All rights reserved. <h3/>\n", "metadata": {}, "id": "73d1479f-e16f-449f-a5fe-ef1d4e367a1a"}]}