Search This Blog

hobbyist

what is good dataset?

Get link
Facebook
X
Pinterest
Email
Other Apps

- May 15, 2021

First things first, we need

to learn how to identify good data set!

.I can make it easy for you

acronyms:

R-O-C-C-C

R for reliable.

Like a good friend, good data sources are reliable.

With this data you can

trust that you're getting accurate,

complete and unbiased information

that's been vetted and proven fit for use.

O is for original.

There's a good chance you'll discover data

through a second or third party source.

To make sure you're dealing with good data,

be sure to validate it with the original source.

C is for comprehensive.

The best data sources contain

all critical information needed to

answer the question or find the solution.

Think about it like this.

You wouldn't want to work for a company just because you

found one great online review about it.

You'd research every aspect of

the organization to make sure it was the right fit.

It's important to do the same for your data analysis.

C is for current.

The usefulness of data decreases as time passes.

If you wanted to invite

all current clients to a business event,

you wouldn't use a 10-year-old client list.

The same goes for data.

The best data sources are current

and relevant to the task at hand.

C is for cited.

If you've ever told a friend where you heard

that a new movie sequel was in the works,

you've cited a source.

Citing makes the information

you're providing more credible.

When you're choosing a data Sources,

think about three Question.

Who created the data set?

Is it part of a credible organization?

When was the data last refreshed?

If you have original data from

a reliable organization and it's

comprehensive,

current, and cited, it ROCCCs!

There's lots of places that are

known for having good data.

Your best bet is to go with the vetted public data sets,

academic papers, financial data,

and governmental agency data.

Now that you know how to spot the good data, which ROCCCs,

you're ready to learn about the mountain of

bad data and how to avoid it. Let's get moving.

Get link
Facebook
X
Pinterest
Email
Other Apps

Comments

Pcb Fault Detection(Deep Learning Technique)

- July 26, 2021

Hello, that's how I applied my deep Learning skills to my electronics industry application Technical except After iterating through many models we find this model to be giving good accuracy and least loss. we used #yolo v5 with 4000 epoch. here us the latest update to the dataset. I have gathered data related to pcb fault detection. I have gathered a huge amount of image data. and I have open sourced it via-Kaggle. feel free to explore it.

k nearest neighbors with well defined k value

- September 06, 2020

so let us understand how we can chooose the perfect k for our model from the last model i had prepared a function def regression(model): x_train,x_test,y_train,y_test= train_test_split(x,y,test_size=0.2) reg_all=model reg_all.fit(x_train,y_train) y_predict=reg_all.predict(x_test) rmse_value=np.sqrt(mean_squared_error(y_test,y_predict)) print("rms error={}".format(rmse_value)) i have prepared cross value squared to get the mean of rmse where k=3 denote the mean of three iterated value of rmse Lasso is a way to conterect over fitting (we can also use ridge) to check. from sklearn.model_selection import cross_val_score from sklearn.linear_model import Lasso def regression_cv(model,k=3): scores=cross_val_score(model,x,y,scoring='neg_mean_squared_error',cv=k) rmse=np.sqrt(-scores) print('reg rmse:',rmse) print('reg mean:',rmse.mean()) importi...

using your age and duration of workout finding how much calories you burned!

- January 07, 2021

dataset: https://www.kaggle.com/fmendes/fmendesdat263xdemos/download ......................................................................................................................................................... import pandas as pd import matplotlib.pyplot as plt import numpy as np import pickle from sklearn.model_selection import train_test_split from sklearn.linear_model import LinearRegression df_calories=pd.read_csv("ineuron/calories.csv") df_exercise=pd.read_csv("ineuron/exercise.csv") data=df_exercise.merge(df_calories, on='User_ID') #print(data.head()) #[:,0:-1] all rows and all expect last column (independent variable) also feature column #data_x = data.iloc[:,:-1].values data_x= df.loc[:,[ 'Weight','Age','Duration']] data_y=df.iloc[:,-1] #[:,-1]all rows and only last column (dependent variable) also target column #data_y = data.iloc[:,-1].values x_train,x_test,y_train,y_test = train_test_split(data_x,data_y,test...

Labels

#rubic cube