{ "cells": [ { "cell_type": "markdown", "id": "a1777924-9b4c-47be-9293-438ec91ad1bf", "metadata": {}, "source": [ "# 18 Keras Syntax Basis" ] }, { "cell_type": "code", "execution_count": 2, "id": "aa0761f5-e303-4412-8584-6519c4e5a46a", "metadata": {}, "outputs": [], "source": [ "import numpy as np" ] }, { "cell_type": "code", "execution_count": 3, "id": "db1014a3-214c-41c0-8771-d35e31f0cf20", "metadata": {}, "outputs": [], "source": [ "from sklearn.datasets import load_iris" ] }, { "cell_type": "code", "execution_count": 4, "id": "fcfcfe73-90ef-4897-86d3-35a109795239", "metadata": {}, "outputs": [], "source": [ "iris = load_iris()" ] }, { "cell_type": "code", "execution_count": 5, "id": "58992413-00bb-4847-ae2a-88b68b6a5842", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "sklearn.utils._bunch.Bunch" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "type(iris)" ] }, { "cell_type": "code", "execution_count": 6, "id": "28b5a2d4-b454-4d03-a6f9-cc256c044995", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'.. _iris_dataset:\\n\\nIris plants dataset\\n--------------------\\n\\n**Data Set Characteristics:**\\n\\n :Number of Instances: 150 (50 in each of three classes)\\n :Number of Attributes: 4 numeric, predictive attributes and the class\\n :Attribute Information:\\n - sepal length in cm\\n - sepal width in cm\\n - petal length in cm\\n - petal width in cm\\n - class:\\n - Iris-Setosa\\n - Iris-Versicolour\\n - Iris-Virginica\\n \\n :Summary Statistics:\\n\\n ============== ==== ==== ======= ===== ====================\\n Min Max Mean SD Class Correlation\\n ============== ==== ==== ======= ===== ====================\\n sepal length: 4.3 7.9 5.84 0.83 0.7826\\n sepal width: 2.0 4.4 3.05 0.43 -0.4194\\n petal length: 1.0 6.9 3.76 1.76 0.9490 (high!)\\n petal width: 0.1 2.5 1.20 0.76 0.9565 (high!)\\n ============== ==== ==== ======= ===== ====================\\n\\n :Missing Attribute Values: None\\n :Class Distribution: 33.3% for each of 3 classes.\\n :Creator: R.A. Fisher\\n :Donor: Michael Marshall (MARSHALL%PLU@io.arc.nasa.gov)\\n :Date: July, 1988\\n\\nThe famous Iris database, first used by Sir R.A. Fisher. The dataset is taken\\nfrom Fisher\\'s paper. Note that it\\'s the same as in R, but not as in the UCI\\nMachine Learning Repository, which has two wrong data points.\\n\\nThis is perhaps the best known database to be found in the\\npattern recognition literature. Fisher\\'s paper is a classic in the field and\\nis referenced frequently to this day. (See Duda & Hart, for example.) The\\ndata set contains 3 classes of 50 instances each, where each class refers to a\\ntype of iris plant. One class is linearly separable from the other 2; the\\nlatter are NOT linearly separable from each other.\\n\\n.. topic:: References\\n\\n - Fisher, R.A. \"The use of multiple measurements in taxonomic problems\"\\n Annual Eugenics, 7, Part II, 179-188 (1936); also in \"Contributions to\\n Mathematical Statistics\" (John Wiley, NY, 1950).\\n - Duda, R.O., & Hart, P.E. (1973) Pattern Classification and Scene Analysis.\\n (Q327.D83) John Wiley & Sons. ISBN 0-471-22361-1. See page 218.\\n - Dasarathy, B.V. (1980) \"Nosing Around the Neighborhood: A New System\\n Structure and Classification Rule for Recognition in Partially Exposed\\n Environments\". IEEE Transactions on Pattern Analysis and Machine\\n Intelligence, Vol. PAMI-2, No. 1, 67-71.\\n - Gates, G.W. (1972) \"The Reduced Nearest Neighbor Rule\". IEEE Transactions\\n on Information Theory, May 1972, 431-433.\\n - See also: 1988 MLC Proceedings, 54-64. Cheeseman et al\"s AUTOCLASS II\\n conceptual clustering system finds 3 classes in the data.\\n - Many, many more ...'" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "iris.DESCR" ] }, { "cell_type": "code", "execution_count": 7, "id": "a7354ad7-b0be-4492-a231-c0373c3dc0d9", "metadata": {}, "outputs": [], "source": [ "X = iris.data" ] }, { "cell_type": "code", "execution_count": 8, "id": "e83acf3c-9c91-4a99-8cb3-e67a3b43a077", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([[5.1, 3.5, 1.4, 0.2],\n", " [4.9, 3. , 1.4, 0.2],\n", " [4.7, 3.2, 1.3, 0.2],\n", " [4.6, 3.1, 1.5, 0.2],\n", " [5. , 3.6, 1.4, 0.2],\n", " [5.4, 3.9, 1.7, 0.4],\n", " [4.6, 3.4, 1.4, 0.3],\n", " [5. , 3.4, 1.5, 0.2],\n", " [4.4, 2.9, 1.4, 0.2],\n", " [4.9, 3.1, 1.5, 0.1],\n", " [5.4, 3.7, 1.5, 0.2],\n", " [4.8, 3.4, 1.6, 0.2],\n", " [4.8, 3. , 1.4, 0.1],\n", " [4.3, 3. , 1.1, 0.1],\n", " [5.8, 4. , 1.2, 0.2],\n", " [5.7, 4.4, 1.5, 0.4],\n", " [5.4, 3.9, 1.3, 0.4],\n", " [5.1, 3.5, 1.4, 0.3],\n", " [5.7, 3.8, 1.7, 0.3],\n", " [5.1, 3.8, 1.5, 0.3],\n", " [5.4, 3.4, 1.7, 0.2],\n", " [5.1, 3.7, 1.5, 0.4],\n", " [4.6, 3.6, 1. , 0.2],\n", " [5.1, 3.3, 1.7, 0.5],\n", " [4.8, 3.4, 1.9, 0.2],\n", " [5. , 3. , 1.6, 0.2],\n", " [5. , 3.4, 1.6, 0.4],\n", " [5.2, 3.5, 1.5, 0.2],\n", " [5.2, 3.4, 1.4, 0.2],\n", " [4.7, 3.2, 1.6, 0.2],\n", " [4.8, 3.1, 1.6, 0.2],\n", " [5.4, 3.4, 1.5, 0.4],\n", " [5.2, 4.1, 1.5, 0.1],\n", " [5.5, 4.2, 1.4, 0.2],\n", " [4.9, 3.1, 1.5, 0.2],\n", " [5. , 3.2, 1.2, 0.2],\n", " [5.5, 3.5, 1.3, 0.2],\n", " [4.9, 3.6, 1.4, 0.1],\n", " [4.4, 3. , 1.3, 0.2],\n", " [5.1, 3.4, 1.5, 0.2],\n", " [5. , 3.5, 1.3, 0.3],\n", " [4.5, 2.3, 1.3, 0.3],\n", " [4.4, 3.2, 1.3, 0.2],\n", " [5. , 3.5, 1.6, 0.6],\n", " [5.1, 3.8, 1.9, 0.4],\n", " [4.8, 3. , 1.4, 0.3],\n", " [5.1, 3.8, 1.6, 0.2],\n", " [4.6, 3.2, 1.4, 0.2],\n", " [5.3, 3.7, 1.5, 0.2],\n", " [5. , 3.3, 1.4, 0.2],\n", " [7. , 3.2, 4.7, 1.4],\n", " [6.4, 3.2, 4.5, 1.5],\n", " [6.9, 3.1, 4.9, 1.5],\n", " [5.5, 2.3, 4. , 1.3],\n", " [6.5, 2.8, 4.6, 1.5],\n", " [5.7, 2.8, 4.5, 1.3],\n", " [6.3, 3.3, 4.7, 1.6],\n", " [4.9, 2.4, 3.3, 1. ],\n", " [6.6, 2.9, 4.6, 1.3],\n", " [5.2, 2.7, 3.9, 1.4],\n", " [5. , 2. , 3.5, 1. ],\n", " [5.9, 3. , 4.2, 1.5],\n", " [6. , 2.2, 4. , 1. ],\n", " [6.1, 2.9, 4.7, 1.4],\n", " [5.6, 2.9, 3.6, 1.3],\n", " [6.7, 3.1, 4.4, 1.4],\n", " [5.6, 3. , 4.5, 1.5],\n", " [5.8, 2.7, 4.1, 1. ],\n", " [6.2, 2.2, 4.5, 1.5],\n", " [5.6, 2.5, 3.9, 1.1],\n", " [5.9, 3.2, 4.8, 1.8],\n", " [6.1, 2.8, 4. , 1.3],\n", " [6.3, 2.5, 4.9, 1.5],\n", " [6.1, 2.8, 4.7, 1.2],\n", " [6.4, 2.9, 4.3, 1.3],\n", " [6.6, 3. , 4.4, 1.4],\n", " [6.8, 2.8, 4.8, 1.4],\n", " [6.7, 3. , 5. , 1.7],\n", " [6. , 2.9, 4.5, 1.5],\n", " [5.7, 2.6, 3.5, 1. ],\n", " [5.5, 2.4, 3.8, 1.1],\n", " [5.5, 2.4, 3.7, 1. ],\n", " [5.8, 2.7, 3.9, 1.2],\n", " [6. , 2.7, 5.1, 1.6],\n", " [5.4, 3. , 4.5, 1.5],\n", " [6. , 3.4, 4.5, 1.6],\n", " [6.7, 3.1, 4.7, 1.5],\n", " [6.3, 2.3, 4.4, 1.3],\n", " [5.6, 3. , 4.1, 1.3],\n", " [5.5, 2.5, 4. , 1.3],\n", " [5.5, 2.6, 4.4, 1.2],\n", " [6.1, 3. , 4.6, 1.4],\n", " [5.8, 2.6, 4. , 1.2],\n", " [5. , 2.3, 3.3, 1. ],\n", " [5.6, 2.7, 4.2, 1.3],\n", " [5.7, 3. , 4.2, 1.2],\n", " [5.7, 2.9, 4.2, 1.3],\n", " [6.2, 2.9, 4.3, 1.3],\n", " [5.1, 2.5, 3. , 1.1],\n", " [5.7, 2.8, 4.1, 1.3],\n", " [6.3, 3.3, 6. , 2.5],\n", " [5.8, 2.7, 5.1, 1.9],\n", " [7.1, 3. , 5.9, 2.1],\n", " [6.3, 2.9, 5.6, 1.8],\n", " [6.5, 3. , 5.8, 2.2],\n", " [7.6, 3. , 6.6, 2.1],\n", " [4.9, 2.5, 4.5, 1.7],\n", " [7.3, 2.9, 6.3, 1.8],\n", " [6.7, 2.5, 5.8, 1.8],\n", " [7.2, 3.6, 6.1, 2.5],\n", " [6.5, 3.2, 5.1, 2. ],\n", " [6.4, 2.7, 5.3, 1.9],\n", " [6.8, 3. , 5.5, 2.1],\n", " [5.7, 2.5, 5. , 2. ],\n", " [5.8, 2.8, 5.1, 2.4],\n", " [6.4, 3.2, 5.3, 2.3],\n", " [6.5, 3. , 5.5, 1.8],\n", " [7.7, 3.8, 6.7, 2.2],\n", " [7.7, 2.6, 6.9, 2.3],\n", " [6. , 2.2, 5. , 1.5],\n", " [6.9, 3.2, 5.7, 2.3],\n", " [5.6, 2.8, 4.9, 2. ],\n", " [7.7, 2.8, 6.7, 2. ],\n", " [6.3, 2.7, 4.9, 1.8],\n", " [6.7, 3.3, 5.7, 2.1],\n", " [7.2, 3.2, 6. , 1.8],\n", " [6.2, 2.8, 4.8, 1.8],\n", " [6.1, 3. , 4.9, 1.8],\n", " [6.4, 2.8, 5.6, 2.1],\n", " [7.2, 3. , 5.8, 1.6],\n", " [7.4, 2.8, 6.1, 1.9],\n", " [7.9, 3.8, 6.4, 2. ],\n", " [6.4, 2.8, 5.6, 2.2],\n", " [6.3, 2.8, 5.1, 1.5],\n", " [6.1, 2.6, 5.6, 1.4],\n", " [7.7, 3. , 6.1, 2.3],\n", " [6.3, 3.4, 5.6, 2.4],\n", " [6.4, 3.1, 5.5, 1.8],\n", " [6. , 3. , 4.8, 1.8],\n", " [6.9, 3.1, 5.4, 2.1],\n", " [6.7, 3.1, 5.6, 2.4],\n", " [6.9, 3.1, 5.1, 2.3],\n", " [5.8, 2.7, 5.1, 1.9],\n", " [6.8, 3.2, 5.9, 2.3],\n", " [6.7, 3.3, 5.7, 2.5],\n", " [6.7, 3. , 5.2, 2.3],\n", " [6.3, 2.5, 5. , 1.9],\n", " [6.5, 3. , 5.2, 2. ],\n", " [6.2, 3.4, 5.4, 2.3],\n", " [5.9, 3. , 5.1, 1.8]])" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "X" ] }, { "cell_type": "code", "execution_count": 9, "id": "0c4441cb-d324-410b-88ef-654c421d6d1f", "metadata": {}, "outputs": [], "source": [ "y = iris.target" ] }, { "cell_type": "code", "execution_count": 11, "id": "3e03167a-98fc-40d0-b9b2-52e59e8e79c3", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n", " 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0,\n", " 0, 0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n", " 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1,\n", " 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,\n", " 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,\n", " 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2])" ] }, "execution_count": 11, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# one hot encoded target label\n", "# class 0 => [1,0,0]\n", "# class 1 => [0,1,0]\n", "# class 2 => [0,0,1]\n", "y" ] }, { "cell_type": "code", "execution_count": 14, "id": "25d35a39-36e4-4917-856b-a1127a4a5402", "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "2023-09-12 15:36:16.513075: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.\n", "2023-09-12 15:36:16.565774: I tensorflow/tsl/cuda/cudart_stub.cc:28] Could not find cuda drivers on your machine, GPU will not be used.\n", "2023-09-12 15:36:17.826301: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT\n" ] } ], "source": [ "from keras.utils import to_categorical" ] }, { "cell_type": "code", "execution_count": 15, "id": "0cbe5c9d-4cae-4057-8352-53471a2d77ce", "metadata": {}, "outputs": [], "source": [ "y = to_categorical(y)" ] }, { "cell_type": "code", "execution_count": 16, "id": "fbe6ca4d-dd4b-44d0-8340-d0ee2466b070", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "(150, 3)" ] }, "execution_count": 16, "metadata": {}, "output_type": "execute_result" } ], "source": [ "y.shape" ] }, { "cell_type": "code", "execution_count": 17, "id": "460833a0-0c17-41ff-a98a-aaf247d7c436", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([[1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [1., 0., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 1., 0.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.],\n", " [0., 0., 1.]], dtype=float32)" ] }, "execution_count": 17, "metadata": {}, "output_type": "execute_result" } ], "source": [ "y" ] }, { "cell_type": "code", "execution_count": 20, "id": "33b2b36f-9f46-41dc-96e0-5da631cd0fc9", "metadata": {}, "outputs": [], "source": [ "from sklearn.model_selection import train_test_split\n", "X_train, X_test, y_train, y_test = train_test_split(X,y,test_size=0.33,random_state=42)" ] }, { "cell_type": "markdown", "id": "5717b9a5-433e-4d97-a44f-2a5e22c9958d", "metadata": {}, "source": [ "When dealing with neural networks is important to scale the data:" ] }, { "cell_type": "code", "execution_count": 22, "id": "91c8cfe0-a6f3-468d-9613-5550b487dea5", "metadata": {}, "outputs": [], "source": [ "from sklearn.preprocessing import MinMaxScaler" ] }, { "cell_type": "code", "execution_count": 26, "id": "a639c801-86dd-4b73-8970-78a6722eaed0", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([0.25, 0.5 , 0.75, 1. ])" ] }, "execution_count": 26, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# MinMaxScaler divides the array for the highest value\n", "# in order to scale values between 0 and 1\n", "np.array([5,10,15,20])/20" ] }, { "cell_type": "code", "execution_count": 27, "id": "04fdd69a-a9fe-4506-b893-a4c92f18852b", "metadata": {}, "outputs": [], "source": [ "scaler = MinMaxScaler()" ] }, { "cell_type": "code", "execution_count": 28, "id": "d80b4e24-c742-4fae-b0a3-4de4d0f5c39d", "metadata": {}, "outputs": [ { "data": { "text/html": [ "

MinMaxScaler()

In a Jupyter environment, please rerun this cell to show the HTML representation or trust the notebook.
On GitHub, the HTML representation is unable to render, please try loading this page with nbviewer.org.

" ], "text/plain": [ "MinMaxScaler()" ] }, "execution_count": 28, "metadata": {}, "output_type": "execute_result" } ], "source": [ "scaler.fit(X_train)" ] }, { "cell_type": "code", "execution_count": 31, "id": "546ce0d4-b98b-4f48-902b-51d1cfb0f0c9", "metadata": {}, "outputs": [], "source": [ "scaled_X_train = scaler.transform(X_train)" ] }, { "cell_type": "code", "execution_count": 30, "id": "558e0a6c-ba9b-493f-aa17-13ea0501f496", "metadata": {}, "outputs": [], "source": [ "scaled_X_test = scaler.transform(X_test)" ] }, { "cell_type": "code", "execution_count": 32, "id": "9e3a822c-1b4c-445c-9201-d9c808705589", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([[0.41176471, 0.40909091, 0.55357143, 0.5 ],\n", " [0.97058824, 0.45454545, 0.98214286, 0.83333333],\n", " [0.38235294, 0.45454545, 0.60714286, 0.58333333],\n", " [0.23529412, 0.68181818, 0.05357143, 0.04166667],\n", " [1. , 0.36363636, 1. , 0.79166667],\n", " [0.44117647, 0.31818182, 0.53571429, 0.375 ],\n", " [0.26470588, 0.63636364, 0.05357143, 0.04166667],\n", " [0.20588235, 0.68181818, 0.03571429, 0.08333333],\n", " [0.23529412, 0.81818182, 0.14285714, 0.125 ],\n", " [0.20588235, 0. , 0.42857143, 0.375 ],\n", " [0.58823529, 0.31818182, 0.67857143, 0.70833333],\n", " [0.14705882, 0.63636364, 0.14285714, 0.04166667],\n", " [0.20588235, 0.45454545, 0.08928571, 0.04166667],\n", " [0.23529412, 0.59090909, 0.10714286, 0.16666667],\n", " [0.38235294, 0.31818182, 0.55357143, 0.5 ],\n", " [0.23529412, 0.63636364, 0.07142857, 0.04166667],\n", " [0.41176471, 0.45454545, 0.55357143, 0.45833333],\n", " [1. , 0.81818182, 1. , 0.875 ],\n", " [0.08823529, 0.54545455, 0.05357143, 0.04166667],\n", " [0.55882353, 0.40909091, 0.57142857, 0.5 ],\n", " [0.41176471, 0.22727273, 0.69642857, 0.79166667],\n", " [0.35294118, 1. , 0.05357143, 0.04166667],\n", " [0.5 , 0.45454545, 0.66071429, 0.70833333],\n", " [0.44117647, 0.31818182, 0.71428571, 0.75 ],\n", " [0.5 , 0.09090909, 0.51785714, 0.375 ],\n", " [0.32352941, 0.45454545, 0.60714286, 0.58333333],\n", " [0.55882353, 0.63636364, 0.76785714, 0.91666667],\n", " [0.35294118, 0.13636364, 0.51785714, 0.5 ],\n", " [0.32352941, 0.86363636, 0.10714286, 0.125 ],\n", " [0.20588235, 0.13636364, 0.39285714, 0.375 ],\n", " [0.61764706, 0.31818182, 0.75 , 0.75 ],\n", " [0.20588235, 0.59090909, 0.05357143, 0.04166667],\n", " [0.20588235, 0.54545455, 0.01785714, 0.04166667],\n", " [0.35294118, 0.18181818, 0.48214286, 0.41666667],\n", " [0.70588235, 0.45454545, 0.69642857, 0.66666667],\n", " [0.17647059, 0.5 , 0.07142857, 0.04166667],\n", " [0.44117647, 0.36363636, 0.71428571, 0.95833333],\n", " [0.20588235, 0.63636364, 0.07142857, 0.04166667],\n", " [0.20588235, 0.68181818, 0.08928571, 0.20833333],\n", " [0.47058824, 0.54545455, 0.66071429, 0.70833333],\n", " [0.23529412, 0.22727273, 0.33928571, 0.41666667],\n", " [0.76470588, 0.54545455, 0.82142857, 0.91666667],\n", " [0.5 , 0.31818182, 0.71428571, 0.625 ],\n", " [0.52941176, 0.27272727, 0.80357143, 0.54166667],\n", " [1. , 0.45454545, 0.89285714, 0.91666667],\n", " [0.35294118, 0.22727273, 0.51785714, 0.5 ],\n", " [0.02941176, 0.40909091, 0.05357143, 0.04166667],\n", " [0. , 0.45454545, 0. , 0. ],\n", " [0.5 , 0.09090909, 0.69642857, 0.58333333],\n", " [0.85294118, 0.54545455, 0.875 , 0.70833333],\n", " [0.08823529, 0.5 , 0.07142857, 0.04166667],\n", " [0.23529412, 0.68181818, 0.05357143, 0.08333333],\n", " [0.02941176, 0.45454545, 0.03571429, 0.04166667],\n", " [0.58823529, 0.22727273, 0.67857143, 0.58333333],\n", " [0.58823529, 0.63636364, 0.80357143, 0.95833333],\n", " [0.08823529, 0.63636364, 0.05357143, 0.08333333],\n", " [0.73529412, 0.45454545, 0.78571429, 0.83333333],\n", " [0.58823529, 0.59090909, 0.875 , 1. ],\n", " [0.11764706, 0.54545455, 0.03571429, 0.04166667],\n", " [0.52941176, 0.40909091, 0.64285714, 0.54166667],\n", " [0.64705882, 0.36363636, 0.625 , 0.58333333],\n", " [0.55882353, 0.36363636, 0.66071429, 0.70833333],\n", " [0.79411765, 0.54545455, 0.64285714, 0.54166667],\n", " [0.61764706, 0.54545455, 0.75 , 0.91666667],\n", " [0.23529412, 0.81818182, 0.08928571, 0.04166667],\n", " [0.76470588, 0.5 , 0.76785714, 0.83333333],\n", " [0.47058824, 0.45454545, 0.55357143, 0.58333333],\n", " [0.64705882, 0.45454545, 0.73214286, 0.79166667],\n", " [0.41176471, 0.27272727, 0.42857143, 0.375 ],\n", " [0.26470588, 0.31818182, 0.5 , 0.54166667],\n", " [0.52941176, 0.45454545, 0.625 , 0.54166667],\n", " [0.05882353, 0.13636364, 0.03571429, 0.08333333],\n", " [0.67647059, 0.40909091, 0.625 , 0.5 ],\n", " [0.35294118, 0.27272727, 0.58928571, 0.45833333],\n", " [0.29411765, 0.77272727, 0.07142857, 0.04166667],\n", " [0.38235294, 0.45454545, 0.53571429, 0.5 ],\n", " [0.88235294, 0.40909091, 0.92857143, 0.70833333],\n", " [0.70588235, 0.59090909, 0.82142857, 0.83333333],\n", " [0.23529412, 0.77272727, 0.07142857, 0.125 ],\n", " [0.17647059, 0.18181818, 0.39285714, 0.375 ],\n", " [0.70588235, 0.59090909, 0.82142857, 1. ],\n", " [0.85294118, 0.45454545, 0.83928571, 0.625 ],\n", " [0.17647059, 0.72727273, 0.05357143, 0. ],\n", " [0.70588235, 0.5 , 0.80357143, 0.95833333],\n", " [0.17647059, 0.45454545, 0.05357143, 0.04166667],\n", " [0.76470588, 0.5 , 0.67857143, 0.58333333],\n", " [0.91176471, 0.36363636, 0.89285714, 0.75 ],\n", " [0.58823529, 0.40909091, 0.80357143, 0.70833333],\n", " [0.41176471, 0.36363636, 0.53571429, 0.5 ],\n", " [0.64705882, 0.45454545, 0.78571429, 0.70833333],\n", " [0.58823529, 0.13636364, 0.58928571, 0.5 ],\n", " [0.61764706, 0.40909091, 0.57142857, 0.5 ],\n", " [0.38235294, 0.36363636, 0.67857143, 0.79166667],\n", " [0.47058824, 0.45454545, 0.71428571, 0.70833333],\n", " [0.32352941, 0.63636364, 0.10714286, 0.04166667],\n", " [0.52941176, 0.36363636, 0.51785714, 0.5 ],\n", " [0.17647059, 0.22727273, 0.60714286, 0.66666667],\n", " [0.44117647, 0.90909091, 0.01785714, 0.04166667],\n", " [0.44117647, 0.27272727, 0.51785714, 0.45833333],\n", " [0.82352941, 0.45454545, 0.85714286, 0.83333333]])" ] }, "execution_count": 32, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# all values are between 0 and 1\n", "scaled_X_train" ] }, { "cell_type": "code", "execution_count": 33, "id": "bc439b37-aab0-4a9b-a254-903817b8ea3a", "metadata": {}, "outputs": [], "source": [ "from keras.models import Sequential\n", "from keras.layers import Dense" ] }, { "cell_type": "code", "execution_count": 35, "id": "b2d98f15-b869-4df7-a0d7-daec97d8ec64", "metadata": {}, "outputs": [], "source": [ "model = Sequential()\n", "model.add(Dense(\n", " # 8 neurons\n", " 8,\n", " # 4 input dimensions\n", " input_dim=4,\n", " # Rectified Linear Unit returns 0 if input is negative or the input if positive\n", " activation='relu'\n", "))\n", "model.add(Dense(\n", " 8,\n", " input_dim=4,\n", " activation='relu'\n", "))\n", "model.add(Dense(\n", " 3,\n", " # in the output layer, each input will have\n", " # a probability of belonging to a particular label. (e.g. [0.2,0.3,0.5])\n", " # Softmax function will return the higher probability one.\n", " activation='softmax'\n", "))\n", "model.compile(\n", " loss='categorical_crossentropy',\n", " optimizer='adam',\n", " metrics=['accuracy']\n", ")" ] }, { "cell_type": "code", "execution_count": 36, "id": "51c1e52d-1c6d-438b-a841-8317a8a48432", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Model: \"sequential_1\"\n", "_________________________________________________________________\n", " Layer (type) Output Shape Param # \n", "=================================================================\n", " dense_3 (Dense) (None, 8) 40 \n", " \n", " dense_4 (Dense) (None, 8) 72 \n", " \n", " dense_5 (Dense) (None, 3) 27 \n", " \n", "=================================================================\n", "Total params: 139 (556.00 Byte)\n", "Trainable params: 139 (556.00 Byte)\n", "Non-trainable params: 0 (0.00 Byte)\n", "_________________________________________________________________\n" ] } ], "source": [ "model.summary()" ] }, { "cell_type": "code", "execution_count": 37, "id": "7bed6fa0-3925-4008-84a2-cd45c8356406", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Epoch 1/150\n", "4/4 - 1s - loss: 1.1076 - accuracy: 0.3500 - 806ms/epoch - 202ms/step\n", "Epoch 2/150\n", "4/4 - 0s - loss: 1.0977 - accuracy: 0.3000 - 8ms/epoch - 2ms/step\n", "Epoch 3/150\n", "4/4 - 0s - loss: 1.0895 - accuracy: 0.2400 - 10ms/epoch - 2ms/step\n", "Epoch 4/150\n", "4/4 - 0s - loss: 1.0806 - accuracy: 0.4000 - 10ms/epoch - 2ms/step\n", "Epoch 5/150\n", "4/4 - 0s - loss: 1.0737 - accuracy: 0.5500 - 9ms/epoch - 2ms/step\n", "Epoch 6/150\n", "4/4 - 0s - loss: 1.0673 - accuracy: 0.6400 - 10ms/epoch - 2ms/step\n", "Epoch 7/150\n", "4/4 - 0s - loss: 1.0606 - accuracy: 0.6300 - 11ms/epoch - 3ms/step\n", "Epoch 8/150\n", "4/4 - 0s - loss: 1.0537 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 9/150\n", "4/4 - 0s - loss: 1.0478 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 10/150\n", "4/4 - 0s - loss: 1.0413 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 11/150\n", "4/4 - 0s - loss: 1.0357 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 12/150\n", "4/4 - 0s - loss: 1.0293 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 13/150\n", "4/4 - 0s - loss: 1.0235 - accuracy: 0.6500 - 11ms/epoch - 3ms/step\n", "Epoch 14/150\n", "4/4 - 0s - loss: 1.0183 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 15/150\n", "4/4 - 0s - loss: 1.0114 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 16/150\n", "4/4 - 0s - loss: 1.0055 - accuracy: 0.6500 - 10ms/epoch - 2ms/step\n", "Epoch 17/150\n", "4/4 - 0s - loss: 0.9992 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 18/150\n", "4/4 - 0s - loss: 0.9930 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 19/150\n", "4/4 - 0s - loss: 0.9869 - accuracy: 0.6500 - 7ms/epoch - 2ms/step\n", "Epoch 20/150\n", "4/4 - 0s - loss: 0.9807 - accuracy: 0.6400 - 9ms/epoch - 2ms/step\n", "Epoch 21/150\n", "4/4 - 0s - loss: 0.9746 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 22/150\n", "4/4 - 0s - loss: 0.9686 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 23/150\n", "4/4 - 0s - loss: 0.9628 - accuracy: 0.6400 - 9ms/epoch - 2ms/step\n", "Epoch 24/150\n", "4/4 - 0s - loss: 0.9567 - accuracy: 0.6400 - 8ms/epoch - 2ms/step\n", "Epoch 25/150\n", "4/4 - 0s - loss: 0.9514 - accuracy: 0.6400 - 9ms/epoch - 2ms/step\n", "Epoch 26/150\n", "4/4 - 0s - loss: 0.9445 - accuracy: 0.6400 - 8ms/epoch - 2ms/step\n", "Epoch 27/150\n", "4/4 - 0s - loss: 0.9378 - accuracy: 0.6500 - 7ms/epoch - 2ms/step\n", "Epoch 28/150\n", "4/4 - 0s - loss: 0.9313 - accuracy: 0.6500 - 10ms/epoch - 2ms/step\n", "Epoch 29/150\n", "4/4 - 0s - loss: 0.9250 - accuracy: 0.6500 - 11ms/epoch - 3ms/step\n", "Epoch 30/150\n", "4/4 - 0s - loss: 0.9178 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 31/150\n", "4/4 - 0s - loss: 0.9112 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 32/150\n", "4/4 - 0s - loss: 0.9050 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 33/150\n", "4/4 - 0s - loss: 0.8984 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 34/150\n", "4/4 - 0s - loss: 0.8915 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 35/150\n", "4/4 - 0s - loss: 0.8845 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 36/150\n", "4/4 - 0s - loss: 0.8774 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 37/150\n", "4/4 - 0s - loss: 0.8699 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 38/150\n", "4/4 - 0s - loss: 0.8632 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 39/150\n", "4/4 - 0s - loss: 0.8559 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 40/150\n", "4/4 - 0s - loss: 0.8486 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 41/150\n", "4/4 - 0s - loss: 0.8412 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 42/150\n", "4/4 - 0s - loss: 0.8340 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 43/150\n", "4/4 - 0s - loss: 0.8268 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 44/150\n", "4/4 - 0s - loss: 0.8199 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 45/150\n", "4/4 - 0s - loss: 0.8131 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 46/150\n", "4/4 - 0s - loss: 0.8059 - accuracy: 0.6500 - 10ms/epoch - 2ms/step\n", "Epoch 47/150\n", "4/4 - 0s - loss: 0.7987 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 48/150\n", "4/4 - 0s - loss: 0.7914 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 49/150\n", "4/4 - 0s - loss: 0.7842 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 50/150\n", "4/4 - 0s - loss: 0.7767 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 51/150\n", "4/4 - 0s - loss: 0.7692 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 52/150\n", "4/4 - 0s - loss: 0.7617 - accuracy: 0.6500 - 9ms/epoch - 2ms/step\n", "Epoch 53/150\n", "4/4 - 0s - loss: 0.7540 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 54/150\n", "4/4 - 0s - loss: 0.7466 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 55/150\n", "4/4 - 0s - loss: 0.7388 - accuracy: 0.6500 - 10ms/epoch - 3ms/step\n", "Epoch 56/150\n", "4/4 - 0s - loss: 0.7309 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 57/150\n", "4/4 - 0s - loss: 0.7228 - accuracy: 0.6500 - 8ms/epoch - 2ms/step\n", "Epoch 58/150\n", "4/4 - 0s - loss: 0.7154 - accuracy: 0.6500 - 11ms/epoch - 3ms/step\n", "Epoch 59/150\n", "4/4 - 0s - loss: 0.7077 - accuracy: 0.6600 - 8ms/epoch - 2ms/step\n", "Epoch 60/150\n", "4/4 - 0s - loss: 0.7004 - accuracy: 0.6600 - 10ms/epoch - 2ms/step\n", "Epoch 61/150\n", "4/4 - 0s - loss: 0.6927 - accuracy: 0.6600 - 9ms/epoch - 2ms/step\n", "Epoch 62/150\n", "4/4 - 0s - loss: 0.6852 - accuracy: 0.6700 - 10ms/epoch - 2ms/step\n", "Epoch 63/150\n", "4/4 - 0s - loss: 0.6783 - accuracy: 0.6800 - 11ms/epoch - 3ms/step\n", "Epoch 64/150\n", "4/4 - 0s - loss: 0.6718 - accuracy: 0.6900 - 8ms/epoch - 2ms/step\n", "Epoch 65/150\n", "4/4 - 0s - loss: 0.6644 - accuracy: 0.6900 - 8ms/epoch - 2ms/step\n", "Epoch 66/150\n", "4/4 - 0s - loss: 0.6569 - accuracy: 0.6900 - 9ms/epoch - 2ms/step\n", "Epoch 67/150\n", "4/4 - 0s - loss: 0.6498 - accuracy: 0.6900 - 9ms/epoch - 2ms/step\n", "Epoch 68/150\n", "4/4 - 0s - loss: 0.6421 - accuracy: 0.6900 - 10ms/epoch - 2ms/step\n", "Epoch 69/150\n", "4/4 - 0s - loss: 0.6354 - accuracy: 0.6900 - 10ms/epoch - 2ms/step\n", "Epoch 70/150\n", "4/4 - 0s - loss: 0.6287 - accuracy: 0.6800 - 9ms/epoch - 2ms/step\n", "Epoch 71/150\n", "4/4 - 0s - loss: 0.6217 - accuracy: 0.6800 - 11ms/epoch - 3ms/step\n", "Epoch 72/150\n", "4/4 - 0s - loss: 0.6152 - accuracy: 0.6800 - 11ms/epoch - 3ms/step\n", "Epoch 73/150\n", "4/4 - 0s - loss: 0.6080 - accuracy: 0.6800 - 9ms/epoch - 2ms/step\n", "Epoch 74/150\n", "4/4 - 0s - loss: 0.6020 - accuracy: 0.6900 - 8ms/epoch - 2ms/step\n", "Epoch 75/150\n", "4/4 - 0s - loss: 0.5958 - accuracy: 0.7000 - 9ms/epoch - 2ms/step\n", "Epoch 76/150\n", "4/4 - 0s - loss: 0.5894 - accuracy: 0.7100 - 8ms/epoch - 2ms/step\n", "Epoch 77/150\n", "4/4 - 0s - loss: 0.5831 - accuracy: 0.7200 - 8ms/epoch - 2ms/step\n", "Epoch 78/150\n", "4/4 - 0s - loss: 0.5771 - accuracy: 0.7400 - 10ms/epoch - 3ms/step\n", "Epoch 79/150\n", "4/4 - 0s - loss: 0.5711 - accuracy: 0.7500 - 10ms/epoch - 2ms/step\n", "Epoch 80/150\n", "4/4 - 0s - loss: 0.5655 - accuracy: 0.7900 - 11ms/epoch - 3ms/step\n", "Epoch 81/150\n", "4/4 - 0s - loss: 0.5599 - accuracy: 0.8100 - 8ms/epoch - 2ms/step\n", "Epoch 82/150\n", "4/4 - 0s - loss: 0.5545 - accuracy: 0.8100 - 10ms/epoch - 2ms/step\n", "Epoch 83/150\n", "4/4 - 0s - loss: 0.5494 - accuracy: 0.8200 - 9ms/epoch - 2ms/step\n", "Epoch 84/150\n", "4/4 - 0s - loss: 0.5439 - accuracy: 0.8400 - 7ms/epoch - 2ms/step\n", "Epoch 85/150\n", "4/4 - 0s - loss: 0.5388 - accuracy: 0.8400 - 10ms/epoch - 2ms/step\n", "Epoch 86/150\n", "4/4 - 0s - loss: 0.5340 - accuracy: 0.8700 - 11ms/epoch - 3ms/step\n", "Epoch 87/150\n", "4/4 - 0s - loss: 0.5288 - accuracy: 0.8600 - 9ms/epoch - 2ms/step\n", "Epoch 88/150\n", "4/4 - 0s - loss: 0.5232 - accuracy: 0.8500 - 11ms/epoch - 3ms/step\n", "Epoch 89/150\n", "4/4 - 0s - loss: 0.5181 - accuracy: 0.8300 - 10ms/epoch - 2ms/step\n", "Epoch 90/150\n", "4/4 - 0s - loss: 0.5133 - accuracy: 0.8200 - 11ms/epoch - 3ms/step\n", "Epoch 91/150\n", "4/4 - 0s - loss: 0.5089 - accuracy: 0.8200 - 10ms/epoch - 2ms/step\n", "Epoch 92/150\n", "4/4 - 0s - loss: 0.5044 - accuracy: 0.8100 - 11ms/epoch - 3ms/step\n", "Epoch 93/150\n", "4/4 - 0s - loss: 0.4999 - accuracy: 0.8100 - 10ms/epoch - 2ms/step\n", "Epoch 94/150\n", "4/4 - 0s - loss: 0.4956 - accuracy: 0.8100 - 10ms/epoch - 3ms/step\n", "Epoch 95/150\n", "4/4 - 0s - loss: 0.4916 - accuracy: 0.8100 - 10ms/epoch - 2ms/step\n", "Epoch 96/150\n", "4/4 - 0s - loss: 0.4877 - accuracy: 0.8100 - 10ms/epoch - 2ms/step\n", "Epoch 97/150\n", "4/4 - 0s - loss: 0.4838 - accuracy: 0.8200 - 9ms/epoch - 2ms/step\n", "Epoch 98/150\n", "4/4 - 0s - loss: 0.4789 - accuracy: 0.8400 - 10ms/epoch - 3ms/step\n", "Epoch 99/150\n", "4/4 - 0s - loss: 0.4753 - accuracy: 0.8700 - 10ms/epoch - 3ms/step\n", "Epoch 100/150\n", "4/4 - 0s - loss: 0.4713 - accuracy: 0.8700 - 10ms/epoch - 3ms/step\n", "Epoch 101/150\n", "4/4 - 0s - loss: 0.4675 - accuracy: 0.8700 - 9ms/epoch - 2ms/step\n", "Epoch 102/150\n", "4/4 - 0s - loss: 0.4657 - accuracy: 0.8100 - 8ms/epoch - 2ms/step\n", "Epoch 103/150\n", "4/4 - 0s - loss: 0.4620 - accuracy: 0.8100 - 9ms/epoch - 2ms/step\n", "Epoch 104/150\n", "4/4 - 0s - loss: 0.4583 - accuracy: 0.8100 - 9ms/epoch - 2ms/step\n", "Epoch 105/150\n", "4/4 - 0s - loss: 0.4544 - accuracy: 0.8300 - 11ms/epoch - 3ms/step\n", "Epoch 106/150\n", "4/4 - 0s - loss: 0.4510 - accuracy: 0.8500 - 11ms/epoch - 3ms/step\n", "Epoch 107/150\n", "4/4 - 0s - loss: 0.4472 - accuracy: 0.8700 - 9ms/epoch - 2ms/step\n", "Epoch 108/150\n", "4/4 - 0s - loss: 0.4440 - accuracy: 0.8700 - 8ms/epoch - 2ms/step\n", "Epoch 109/150\n", "4/4 - 0s - loss: 0.4407 - accuracy: 0.8900 - 10ms/epoch - 3ms/step\n", "Epoch 110/150\n", "4/4 - 0s - loss: 0.4376 - accuracy: 0.9100 - 10ms/epoch - 2ms/step\n", "Epoch 111/150\n", "4/4 - 0s - loss: 0.4349 - accuracy: 0.9300 - 10ms/epoch - 2ms/step\n", "Epoch 112/150\n", "4/4 - 0s - loss: 0.4321 - accuracy: 0.9300 - 10ms/epoch - 3ms/step\n", "Epoch 113/150\n", "4/4 - 0s - loss: 0.4288 - accuracy: 0.9300 - 10ms/epoch - 2ms/step\n", "Epoch 114/150\n", "4/4 - 0s - loss: 0.4260 - accuracy: 0.9300 - 9ms/epoch - 2ms/step\n", "Epoch 115/150\n", "4/4 - 0s - loss: 0.4233 - accuracy: 0.9300 - 8ms/epoch - 2ms/step\n", "Epoch 116/150\n", "4/4 - 0s - loss: 0.4202 - accuracy: 0.9300 - 9ms/epoch - 2ms/step\n", "Epoch 117/150\n", "4/4 - 0s - loss: 0.4175 - accuracy: 0.9400 - 7ms/epoch - 2ms/step\n", "Epoch 118/150\n", "4/4 - 0s - loss: 0.4150 - accuracy: 0.9400 - 8ms/epoch - 2ms/step\n", "Epoch 119/150\n", "4/4 - 0s - loss: 0.4124 - accuracy: 0.9400 - 9ms/epoch - 2ms/step\n", "Epoch 120/150\n", "4/4 - 0s - loss: 0.4096 - accuracy: 0.9400 - 10ms/epoch - 2ms/step\n", "Epoch 121/150\n", "4/4 - 0s - loss: 0.4069 - accuracy: 0.9400 - 9ms/epoch - 2ms/step\n", "Epoch 122/150\n", "4/4 - 0s - loss: 0.4042 - accuracy: 0.9400 - 8ms/epoch - 2ms/step\n", "Epoch 123/150\n", "4/4 - 0s - loss: 0.4018 - accuracy: 0.9400 - 9ms/epoch - 2ms/step\n", "Epoch 124/150\n", "4/4 - 0s - loss: 0.3993 - accuracy: 0.9500 - 10ms/epoch - 2ms/step\n", "Epoch 125/150\n", "4/4 - 0s - loss: 0.3966 - accuracy: 0.9500 - 9ms/epoch - 2ms/step\n", "Epoch 126/150\n", "4/4 - 0s - loss: 0.3947 - accuracy: 0.9600 - 7ms/epoch - 2ms/step\n", "Epoch 127/150\n", "4/4 - 0s - loss: 0.3925 - accuracy: 0.9600 - 9ms/epoch - 2ms/step\n", "Epoch 128/150\n", "4/4 - 0s - loss: 0.3919 - accuracy: 0.9800 - 10ms/epoch - 2ms/step\n", "Epoch 129/150\n", "4/4 - 0s - loss: 0.3911 - accuracy: 0.9700 - 10ms/epoch - 3ms/step\n", "Epoch 130/150\n", "4/4 - 0s - loss: 0.3882 - accuracy: 0.9800 - 9ms/epoch - 2ms/step\n", "Epoch 131/150\n", "4/4 - 0s - loss: 0.3841 - accuracy: 0.9600 - 10ms/epoch - 3ms/step\n", "Epoch 132/150\n", "4/4 - 0s - loss: 0.3809 - accuracy: 0.9600 - 10ms/epoch - 2ms/step\n", "Epoch 133/150\n", "4/4 - 0s - loss: 0.3785 - accuracy: 0.9600 - 10ms/epoch - 2ms/step\n", "Epoch 134/150\n", "4/4 - 0s - loss: 0.3742 - accuracy: 0.9400 - 10ms/epoch - 3ms/step\n", "Epoch 135/150\n", "4/4 - 0s - loss: 0.3721 - accuracy: 0.9300 - 10ms/epoch - 2ms/step\n", "Epoch 136/150\n", "4/4 - 0s - loss: 0.3716 - accuracy: 0.9300 - 9ms/epoch - 2ms/step\n", "Epoch 137/150\n", "4/4 - 0s - loss: 0.3697 - accuracy: 0.9200 - 12ms/epoch - 3ms/step\n", "Epoch 138/150\n", "4/4 - 0s - loss: 0.3679 - accuracy: 0.9200 - 8ms/epoch - 2ms/step\n", "Epoch 139/150\n", "4/4 - 0s - loss: 0.3652 - accuracy: 0.9300 - 9ms/epoch - 2ms/step\n", "Epoch 140/150\n", "4/4 - 0s - loss: 0.3622 - accuracy: 0.9300 - 10ms/epoch - 3ms/step\n", "Epoch 141/150\n", "4/4 - 0s - loss: 0.3599 - accuracy: 0.9300 - 10ms/epoch - 3ms/step\n", "Epoch 142/150\n", "4/4 - 0s - loss: 0.3573 - accuracy: 0.9400 - 8ms/epoch - 2ms/step\n", "Epoch 143/150\n", "4/4 - 0s - loss: 0.3550 - accuracy: 0.9500 - 9ms/epoch - 2ms/step\n", "Epoch 144/150\n", "4/4 - 0s - loss: 0.3532 - accuracy: 0.9500 - 9ms/epoch - 2ms/step\n", "Epoch 145/150\n", "4/4 - 0s - loss: 0.3509 - accuracy: 0.9600 - 9ms/epoch - 2ms/step\n", "Epoch 146/150\n", "4/4 - 0s - loss: 0.3498 - accuracy: 0.9700 - 10ms/epoch - 3ms/step\n", "Epoch 147/150\n", "4/4 - 0s - loss: 0.3476 - accuracy: 0.9700 - 10ms/epoch - 2ms/step\n", "Epoch 148/150\n", "4/4 - 0s - loss: 0.3445 - accuracy: 0.9600 - 10ms/epoch - 3ms/step\n", "Epoch 149/150\n", "4/4 - 0s - loss: 0.3426 - accuracy: 0.9600 - 10ms/epoch - 2ms/step\n", "Epoch 150/150\n", "4/4 - 0s - loss: 0.3402 - accuracy: 0.9600 - 10ms/epoch - 3ms/step\n" ] }, { "data": { "text/plain": [ "" ] }, "execution_count": 37, "metadata": {}, "output_type": "execute_result" } ], "source": [ "model.fit(scaled_X_train,y_train,epochs=150,verbose=2)" ] }, { "cell_type": "code", "execution_count": 38, "id": "daba524e-8b87-4c11-b6f9-7060e3117360", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2/2 [==============================] - 0s 3ms/step\n" ] }, { "data": { "text/plain": [ "array([[2.5660876e-02, 5.7693714e-01, 3.9740190e-01],\n", " [9.6826130e-01, 3.0261274e-02, 1.4774721e-03],\n", " [3.3989915e-04, 1.4124337e-01, 8.5841674e-01],\n", " [1.9857993e-02, 5.5125231e-01, 4.2888966e-01],\n", " [1.5198113e-02, 5.3003418e-01, 4.5476770e-01],\n", " [9.4524556e-01, 5.1514626e-02, 3.2398596e-03],\n", " [7.1866505e-02, 6.6319549e-01, 2.6493800e-01],\n", " [2.5791815e-03, 3.2547855e-01, 6.7194217e-01],\n", " [1.1552515e-02, 3.8179025e-01, 6.0665727e-01],\n", " [4.9498573e-02, 6.4121217e-01, 3.0928919e-01],\n", " [5.2946820e-03, 4.1857359e-01, 5.7613170e-01],\n", " [9.3443048e-01, 6.0580030e-02, 4.9893782e-03],\n", " [9.6396846e-01, 3.4125272e-02, 1.9061510e-03],\n", " [9.4083208e-01, 5.4989863e-02, 4.1781911e-03],\n", " [9.7264546e-01, 2.6038794e-02, 1.3157299e-03],\n", " [1.7293988e-02, 6.0324085e-01, 3.7946513e-01],\n", " [1.4037594e-03, 2.3395938e-01, 7.6463687e-01],\n", " [5.3494815e-02, 6.1398017e-01, 3.3252504e-01],\n", " [2.7243551e-02, 5.6907320e-01, 4.0368327e-01],\n", " [1.4499853e-03, 2.1706852e-01, 7.8148144e-01],\n", " [9.4271326e-01, 5.3345233e-02, 3.9414656e-03],\n", " [8.4328735e-03, 4.4170189e-01, 5.4986519e-01],\n", " [9.4271642e-01, 5.3670656e-02, 3.6128345e-03],\n", " [1.7943066e-03, 2.3682037e-01, 7.6138526e-01],\n", " [1.9804239e-03, 4.1220322e-01, 5.8581632e-01],\n", " [2.1584225e-03, 2.8631058e-01, 7.1153092e-01],\n", " [2.0646816e-03, 2.3282878e-01, 7.6510650e-01],\n", " [1.2030160e-03, 2.4571741e-01, 7.5307959e-01],\n", " [9.2420042e-01, 7.0128702e-02, 5.6708129e-03],\n", " [9.3494052e-01, 6.0422003e-02, 4.6375031e-03],\n", " [9.7190821e-01, 2.6556456e-02, 1.5352169e-03],\n", " [9.8605019e-01, 1.3484978e-02, 4.6463314e-04],\n", " [2.6363395e-02, 6.5044850e-01, 3.2318807e-01],\n", " [9.5615995e-01, 4.1155674e-02, 2.6842828e-03],\n", " [9.4806534e-01, 4.8290167e-02, 3.6444350e-03],\n", " [3.9756601e-03, 2.8831717e-01, 7.0770705e-01],\n", " [2.2540325e-02, 6.3203305e-01, 3.4542656e-01],\n", " [9.6236718e-01, 3.5574075e-02, 2.0587239e-03],\n", " [9.6823776e-01, 3.0077439e-02, 1.6847462e-03],\n", " [9.8458588e-01, 1.4803067e-02, 6.1099150e-04],\n", " [4.5346618e-03, 3.0900484e-01, 6.8646055e-01],\n", " [2.4569798e-02, 6.3556093e-01, 3.3986923e-01],\n", " [1.7186603e-02, 5.8979988e-01, 3.9301351e-01],\n", " [9.7575426e-01, 2.3190815e-02, 1.0548759e-03],\n", " [9.7108781e-01, 2.7524605e-02, 1.3875616e-03],\n", " [7.0500165e-02, 6.2813795e-01, 3.0136183e-01],\n", " [1.0161010e-02, 4.4747257e-01, 5.4236633e-01],\n", " [4.8444206e-03, 3.8681534e-01, 6.0834026e-01],\n", " [2.5107380e-02, 6.2685710e-01, 3.4803557e-01],\n", " [8.9986093e-04, 2.6657054e-01, 7.3252958e-01]], dtype=float32)" ] }, "execution_count": 38, "metadata": {}, "output_type": "execute_result" } ], "source": [ "model.predict(scaled_X_test)" ] }, { "cell_type": "code", "execution_count": 43, "id": "2f1e22a9-bf06-4f20-9795-31eb06473057", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "2/2 [==============================] - 0s 3ms/step\n" ] } ], "source": [ "p = model.predict(scaled_X_test)" ] }, { "cell_type": "code", "execution_count": 44, "id": "9e913638-2d1c-42f0-9946-9e21a79e919a", "metadata": {}, "outputs": [ { "data": { "text/plain": [ "array([1, 0, 2, 1, 1, 0, 1, 2, 2, 1, 2, 0, 0, 0, 0, 1, 2, 1, 1, 2, 0, 2,\n", " 0, 2, 2, 2, 2, 2, 0, 0, 0, 0, 1, 0, 0, 2, 1, 0, 0, 0, 2, 1, 1, 0,\n", " 0, 1, 2, 2, 1, 2])" ] }, "execution_count": 44, "metadata": {}, "output_type": "execute_result" } ], "source": [ "classes = np.argmax(p,axis=1)\n", "classes" ] }, { "cell_type": "code", "execution_count": 47, "id": "f7161edd-f577-4ba8-aaae-f892d9457236", "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "[[19 0 0]\n", " [ 0 14 1]\n", " [ 0 0 16]]\n", " precision recall f1-score support\n", "\n", " 0 1.00 1.00 1.00 19\n", " 1 1.00 0.93 0.97 15\n", " 2 0.94 1.00 0.97 16\n", "\n", " accuracy 0.98 50\n", " macro avg 0.98 0.98 0.98 50\n", "weighted avg 0.98 0.98 0.98 50\n", "\n", "0.98\n" ] } ], "source": [ "from sklearn.metrics import confusion_matrix, classification_report, accuracy_score\n", "\n", "print(confusion_matrix(y_test.argmax(axis=1),classes))\n", "print(classification_report(y_test.argmax(axis=1),classes))\n", "print(accuracy_score(y_test.argmax(axis=1),classes))" ] }, { "cell_type": "code", "execution_count": null, "id": "7128e147-18dc-45d2-849c-3ea30ecdefd7", "metadata": {}, "outputs": [], "source": [ "model.save('irismodel.h5')" ] }, { "cell_type": "code", "execution_count": null, "id": "a8d29608-bace-4f54-9a2c-07e9ed700778", "metadata": {}, "outputs": [], "source": [ "from keras.models import load_model\n", "imported_model = load_model('irismodel.h5')" ] }, { "cell_type": "code", "execution_count": null, "id": "be68c6d3-feb3-4aa7-bfba-1a68be09a4a8", "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.11.5" } }, "nbformat": 4, "nbformat_minor": 5 }