Complete Guide For Feature Engineering

To develop an ML project first we find dataset relavent to the problem statement. Next we perform Exploratory Data Analysis(EDA) to find insights, then we perform Feature Engineering. Before knowing further details, for those who come from non technical or who came to just explore this blog you might not know what is a feature? It is nothing but a column in a dataset. Now ask ourself a very fundamental question....

Why Feature Engineering?


"Imagine our home's front door -it's designed as a vertical rectangle, allowing ur to enter without bending. Now, consider if it was shaped as a horizontal rectangle instead. Attempting to enter without bending would be impossible, right? That's because the door's shape is optimized for its purpose.

In a similar manner, feature engineering serves as the 'shaping' process for data in machine learning. Raw data is like the intial door shape - not perfectly suited for the algorithms to work efficiently. Feature engineering transforms these raw features into more suitable forms, just like the door's shape being optimized for easy entry. By performing feature engineering, we tailor the data to match the algorithm's requirements, enabling them to perform effectively and produce meaningful results."


What is Feature Engineering?

Simply it is the process of taking raw data and transforming it into suitable format so that we can enhance the model performance and accuracy.

Now let's findout what are types of feature Engineering?



1. Feature Transformation:

The what? : It is simply transforming or changing the given feature into a suitable form( I think you might have understood what is suitable form by now? if 'yes' your are following)

We have 4 possible techniques to transform a given column:

  1. Missing Value Imputation
  2. Handling Categorical Values
  3. Outlier Detection
  4. Feature Scaling




Comments

  1. ramesh pal26 August 2023 at 01:24

    sir jo aapne github pe youtube automation ki repo daali hai usko kese use kare google colab mai uske uper ek video bana do

    ReplyDelete

Post a Comment

Popular posts from this blog

Introduction to Natural language processing (NLP)

Image
What is NLP? NLP is a subfield of AI and computational linguistics that focuses on the interaction between the computers and natural language. It helps the computer to understand, interpret and generate human language in a way that is meaningful and useful. NLP is a technique used to teach computers to understand words, sentences, or even paragraphs and helps computers to read, write and even have conversations with people. Knowing the past is crucial because it enables us to understand the efforts made and challenges encountered to achieve this: History of NLP 1950s: Researchers thought " why not we can create a tool that helps the computer to understand and process human language". They started with simple rules and grammars to analyze language, but progress was limited. 1960s-1980s: NLP continued to evolve based on the heuristic approach, heuristics are nothing but the rules or guidelines or instructions that are given to machines to understand and work on human language. ...
Read more

Understanding Linear Regression Algorithm: A Comprehensive Guide

Image
Introduction : Linear regression is a popular and widely used machine learning algorithm. It is a powerful tool that can be used to predict numerical values based on a set of input data. In this blog post, I will provide a comprehensive guide to understanding linear regression, including how it works, its different types, and its applications. What is Linear Regression ? Linear regression is a supervised learning algorithm used to predict a target variable based on one or more input variables. It models the relationship between the target variable and the input variables by fitting a linear equation to the data. The linear equation is represented as y = mx + b, where y is the target variable, x is the input variable, m is the slope of the line, and b is the intercept. 1.Types of Linear Regression: There are two types of linear regression: simple linear regression and multiple linear regression.  1.1 Simple Linear Regression: Simple linear regression is used when there is only on...
Read more