Data
okcupid-stem

okcupid-stem

active ARFF Publicly available Visibility: public Uploaded 10-01-2019 by Florian Pargent
0 likes downloaded by 0 people , 0 total downloads 0 issues 0 downvotes
Issue #Downvotes for this reason By


Loading wiki
Help us complete this description Edit
User profile data for San Francisco OkCupid users published in [Kim, A. Y., & Escobedo-Land, A. (2015). OKCupid data for introductory statistics and data science courses. Journal of Statistics Education, 23(2).]. The curated dataset was downloaded from [https://github.com/rudeboybert/JSE_OkCupid]. The original dataset was created with the use of a python script that pulled the data from public profiles on www.okcupid.com on 06/30/2012. It includes people (n = 59946) within a 25 mile radius of San Francisco, who were online in the last year (06/30/2011), with at least one profile picture. Permission to use this data was obtained by the author of the original paper from OkCupid president and co-founder Christian Rudder under the condition that the dataset remains public. As target, the variable 'job' was collapsed into three categories: 'stem', 'non_stem', and 'student'. STEM jobs were defined as 'job' %in% c('computer / hardware / software', 'science / tech / engineering'). Observations with 'job' %in% c('unemployed', 'retired', 'rather not say') or missing values in 'job' were removed. The original dataset also included ten open text variables 'essay0' to 'essay9', which were removed from the dataset uploaded here. The dataset further includes the date/time variable 'last_online' (ignored by default) which could be used to construct additional features. Using OkCupid data for predicting STEM jobs was inspired by Max Kuhns book 'Feature Engineering and Selection: A Practical Approach for Predictive Models' [https://bookdown.org/max/FES/].

20 features

job (target)nominal3 unique values
0 missing
agenumeric53 unique values
0 missing
body_typenominal12 unique values
3905 missing
dietnominal18 unique values
19382 missing
drinksnominal6 unique values
1552 missing
drugsnominal3 unique values
11622 missing
educationnominal32 unique values
3486 missing
ethnicitynominal208 unique values
3989 missing
heightnumeric57 unique values
1 missing
incomenominal12 unique values
39886 missing
last_online (ignore)string26169 unique values
0 missing
locationnominal184 unique values
0 missing
offspringnominal15 unique values
28914 missing
orientationnominal3 unique values
0 missing
petsnominal15 unique values
14938 missing
religionnominal45 unique values
15126 missing
sexnominal2 unique values
0 missing
signnominal48 unique values
7700 missing
smokesnominal5 unique values
3572 missing
speaksnominal7019 unique values
34 missing
statusnominal5 unique values
0 missing

62 properties

50789
Number of instances (rows) of the dataset.
20
Number of attributes (columns) of the dataset.
3
Number of distinct values of the target attribute (if it is nominal).
154107
Number of missing values in the dataset.
48622
Number of instances with at least one value missing.
2
Number of numeric attributes.
18
Number of nominal attributes.
50.41
Mean of means among attributes of the numeric type.
-0.57
First quartile of skewness among attributes of the numeric type.
0.57
Average class difference between consecutive instances.
0.04
Average mutual information between the nominal attributes and the target attribute.
3.97
First quartile of standard deviation of attributes of the numeric type.
1.12
Entropy of the target attribute values.
65.47
An estimate of the amount of irrelevant information in the attributes regarding the class. Equals (MeanAttributeEntropy - MeanMutualInformation) divided by MeanMutualInformation.
2.06
Second quartile (Median) of entropy among attributes.
0
Number of attributes divided by the number of instances.
424.17
Average number of distinct values among the attributes of the nominal type.
5.01
Second quartile (Median) of kurtosis among attributes of the numeric type.
31.63
Number of attributes needed to optimally describe the class (under the assumption of independence among attributes). Equals ClassEntropy divided by MeanMutualInformation.
0.33
Mean skewness among attributes of the numeric type.
50.41
Second quartile (Median) of means among attributes of the numeric type.
71.57
Percentage of instances belonging to the most frequent class.
6.67
Mean standard deviation of attributes of the numeric type.
0.01
Second quartile (Median) of mutual information between the nominal attributes and the target attribute.
36350
Number of instances belonging to the most frequent class.
0.46
Minimal entropy among attributes.
0.33
Second quartile (Median) of skewness among attributes of the numeric type.
6.52
Maximum entropy among attributes.
1.41
Minimum kurtosis among attributes of the numeric type.
5
Percentage of binary attributes.
6.67
Second quartile (Median) of standard deviation of attributes of the numeric type.
8.62
Maximum kurtosis among attributes of the numeric type.
32.47
Minimum of means among attributes of the numeric type.
95.73
Percentage of instances having missing values.
3.13
Third quartile of entropy among attributes.
68.34
Maximum of means among attributes of the numeric type.
0
Minimal mutual information between the nominal attributes and the target attribute.
15.17
Percentage of missing values.
8.62
Third quartile of kurtosis among attributes of the numeric type.
0.21
Maximum mutual information between the nominal attributes and the target attribute.
2
The minimal number of distinct values among attributes of the nominal type.
10
Percentage of numeric attributes.
68.34
Third quartile of means among attributes of the numeric type.
7019
The maximum number of distinct values among attributes of the nominal type.
-0.57
Minimum skewness among attributes of the numeric type.
90
Percentage of nominal attributes.
0.03
Third quartile of mutual information between the nominal attributes and the target attribute.
1.23
Maximum skewness among attributes of the numeric type.
3.97
Minimum standard deviation of attributes of the numeric type.
0.99
First quartile of entropy among attributes.
1.23
Third quartile of skewness among attributes of the numeric type.
9.38
Maximum standard deviation of attributes of the numeric type.
9.61
Percentage of instances belonging to the least frequent class.
1.41
First quartile of kurtosis among attributes of the numeric type.
9.38
Third quartile of standard deviation of attributes of the numeric type.
2.36
Average entropy of the attributes.
4882
Number of instances belonging to the least frequent class.
32.47
First quartile of means among attributes of the numeric type.
1646.95
Standard deviation of the number of distinct values among attributes of the nominal type.
5.01
Mean kurtosis among attributes of the numeric type.
1
Number of binary attributes.
0
First quartile of mutual information between the nominal attributes and the target attribute.

10 tasks

0 runs - estimation_procedure: 10-fold Crossvalidation - target_feature: job
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
0 runs - estimation_procedure: 50 times Clustering
Define a new task