An important concept regarding machine learning.

 Distribution: Distribution shows us how the probabilities of measurements are distributed.

1. Normal Distribution:- Normal distribution is always centered on the average value.



    Standard Deviation: The width of the curve defines the 'standard deviation'. It is called a central limit theorem. Width of the mean value. 

 Mean (x̅ ): Center value or average value of the distribution.

Both represent the population called as Population Parameter. The parameters that determine how a distribution fits the population data are called Population Parameters. 

2. Exponential Distribution:- It is also used for probabilities and statistics.



3. Gamma Distribution:- It is also used for probabilities and statistics. In this type of distribution, shape and rate are parameters.



Variance:  


OR





Standard Deviation:  


Model: A model is a way to explore a relationship. We use statistics to determine how useful and how reliable our model is.

Hypothesis: Hypothesis means the assumption of data. Trying to find out things are the same or not. There is hypothesis testing.

  1. Null hypothesis testing: In this testing, there is no difference between the two things. Or no difference between the mean of groups. it is denoted as HA. 

  2. Alternative hypothesis testing: It is opposite to the Null hypothesis. In this testing at least one group mean is different. It is denoted as Ho. 

There are two errors:
1] Type 1 error: Rejection of a true null hypothesis known as false positive.
2] Type 2 error: Non-rejection of a false null hypothesis known as a false negative.

Confusion Matrix: A confusion matrix is a table that is used to describe the performance of a classification model or classifier.  

  • True Positive: We predicted yes and the actual result is also yes.
  • True Negative: We predicted no and the actual result is also no.
  • False Positive: We predicted yes but the actual result is no
  • False Negative: We predicted no but the actual result is yes.
    Accuracy: (TP+TN)/Total
    Misclassification: Misclassification means error rate. (FP+FN)/Total
    True Positive Rate: TP/Actual Yes count
    True Negative Rate: Actual No Count/TN
    Precision: When it predicts yes, how often is it correct.
    Sensitivity: The percentage of the predicted answer is equal to the actual answer. 

Example: 


Sensitivity = TP/(TP+FN) = 139/(139+32) = 0.81
0.81*100 = 80% of peoples with heart disease were correctly identified by the logistics regression. 

Accuracy = (TP+TN)/Total = 251/303 = 0.8283
0.8283*100 = 82% accuracy of this model.

The size of the confusion matrix is determined by the number of things we want to predict.

Association Rule:- It is a rule-based machine learning method for discovering interesting relationships between variables in large databases. Discovering regularities between products in large-scale transactions.
    Types:                  
  1. Horizontal Data Format: 

  2. Vertical Data Format: 
    Apriori Algorithm: Identifying the frequent individual items in the database.
  • 100% of sets with apples contain bananas.
  • 50% of sets with apple, banana have watermelon.
  • 50% of sets with apple, banana have any other fruits.    
    Support: How to frequently the itemset appears in the dataset.
                    Support(XY) = count(XY) / Total number
    Confidence: Confidence(XY)  = support(XY) / support(X)

Statistics: 
  1. Mean: Avg value.  Used when data is not normally distributed. In this case, outliers occur. Outliers: It can occur by chance in distribution but they indicate either measurement error or heavy-tailed distribution.
  2. Median: Middle value. Used when dealing with ordinal data. Ex. Strongly dislike, dislike, like, strongly like.
  3. Mode: The value that occurs frequently in the dataset. Used when dealing with unordered categories data.
  4. Skewness: If it looks the same to the left and right of the center.
  5. Kurtosis: Measure of whether the data are peaked or flat relative to the rest of the data.


Thank you 😊 for reading. Please read other blogs. And also share with your friends and family.






        















    


  


  

Comments

Post a Comment

If you have any doubt, please let me know. To check my other blog kindly check the following links:
https://pythoholic.blogspot.com/

If you are interested in reading Marathi stories and other stuff, kindly check the following link.

https://pratilipi.page.link/q8dZ4ffZwKPHUx6R9

ꜰᴏʀ ᴇxᴘʟᴏʀɪɴɢ ᴛʜᴇ ᴡᴏʀʟᴅ ᴘʟᴇᴀꜱᴇ ʜᴀᴠᴇ ʟᴏᴏᴋ ᴀɴᴅ ꜰᴏʟʟᴏᴡ.
https://maps.app.goo.gl/jnKyzdDpKMFutUqR7

Popular posts from this blog

How to perform operations on emails and folders using imap_tools?

Image
  IMAP_TOOLS: imap_tools is a library used to perform operations on emails and folders. Installation: pip install imap-tools How to log in to the mail?  We need to pass the username and password to the login function. And also we can pass the initial_folder name. How to get subjects from a specific folder?   First searches email nums by criteria in the current folder, then fetch and yields. E-mail attributes:  You can fetch the required data of e-mail using email attributes. Like you can fetch sender of mail using from_ attribute. You can easily fetch the date of mail using date attributes.  There are lots of e-mail attributes, we see some of them. Search criteria: You can use three approaches to build search criteria.  Search using subject. Search using text. Search using charset. AND, OR, NOT, Header and UidRange these classes are used for search logic. How to perform actions on email? You can perform the following operations on email:  cop...
Read more

How to convert PDF file into audio file?

Image
To convert PDF files into an audio file, we use PyPDF2 and Pyttsx3 libraries. First, we use PyPDF2 for reading text from PDF and then use Pyttsx3 to convert extracted text into audio files. Let’s start with the PyPDF2 library. PyPDF2: PyPDF2 is a library in python that is used to read text from PDF. A Pure-Python library built as a PDF toolkit. It is capable of extracting document information, splitting documents page by page, merging documents page by page, etc. Pyttxs3: Pyttx3 is a text-to-speech library. It has many functions which will help the machine to communicate with us. It will help the machine to speak to us. How to install the above libraries? Pip install PyPDF2 Pip install pyttsx3 Example: import pyttsx3,PyPDF2 pdfObj = open('sample.pdf','rb') pdfreader = PyPDF2.PdfFileReader(pdfObj) speaker = pyttsx3.init() for page_num in range(pdfreader.numPages):          text = pdfreader.getPage(page_num).extractText()  ## extracting text fro...
Read more

Pillow Libary in Python.

Image
  Pillow library:    It is a lightweight image processing tool that aid in editing, creating, and saving images. Pillow supports many image file formats including BMP, PNG, JPEG, and TIFF.  Python Imaging Library is a free and open-source additional library for the Python programming language that adds support for opening, manipulating, and saving many different images file formats. How to install pillow: p ip install Pillow The most important class in the Python Imaging Library is the Image class. Defined in the module with the same name. You can create instances of this class in several ways.   How to load an image from a file? Open(): You can use an open () function in the Image module.  object. You can now use instance attributes to examine the file contents.  To read files from disk, use the open () from function. You don’t have to know the file format to open a file. The library automatically determines the format based on the contents of the...
Read more