Trained and evaluated Linear SVM (SVMlight), Naive Bayes, and Random Forest (randomforest) classifiers on facial recognition data provided on Kaggle

alt tag

Ran RANN's approximate nearest neighbor algorithm to match public figures from a database provided by Columbia's Public Figures Face Database

alt tag

Ran SVMlight's polynomial kernel to match public figures from a database provided by Columbia's Public Figures Face Database

• Training accuracy: 80.1 %
• Kaggle Eval: 76.480 %
• Results on Kaggle leaderboard "Skynet Dev Team"

Plotted a scatter matrix of the iris dataset from the UC Irvine learning data repository alt tag

Plotted the above data on first two principal components alt tag

Plotted above data using NIPALS algorithm for PLS1 regression alt tag

Plotted the eigenvalues of the covariance matrix in sorted order principal components of the wine dataset provided by the UC Irvine Machine Learning Repository using NIPALS alt tag

Plotted a stem plot of the first 3 principal components of the above data. Below is the first principal component alt tag

Plotted the above data on first two principal components alt tag

Plotted data on breast cancer diagnostics provided by the UC Irvine learning data repository across 3 principal components

alt tag

Plotted data on breast cancer diagnostics provided by the UC Irvine learning data repository across 3 discriminate directions using NIPALS algorithm for PLS1 regression

alt tag

Using the EM algorithm implemented a multinomial mixture of topics model using the NIPS dataset from the UCI Machine Learning dataset repository to generate clusters of topics and plot their priors alt tag

Plotted the most common words per cluster of the above
alt tag

Using the EM algorithm applied to a mixture of normal distribution model, segmented color images over multiple iterations. Below is an image segmented using 20 clusters over 5 iterations.

alt tag

Implemented linear regression on the Geographical Original of Music Data Set provided by the UCI Machine Learning Repository

Plotted a straightforward linear regression against features with respect to longitude and latitude of origin of said music data set.

Below is a latitude prediction over a linear regression on features that yields an R-squared) value of 0.3645767 alt-tag

Analyzed the residuals. Below are that of the latitude alt-tag

Produced a Box Cox transformation and analyzed its effect on linear regression performance. Below is a Box Cox plot with a max log likelihood value $$\lambda$$ of 3.6 alt-tag

Performed a ridge regression analysis ($$\alpha$$ values close to 0) using various regularization coefficients alt-tag

Below is a plot showing cross-validated error against [log regularization coefficient]((http://luthuli.cs.uiuc.edu/~daf/courses/LearningCourse/learning-book-31-Mar#page=200.pdf) for $$\alpha = 0.1$$ (ridge regression) (see report for detailed analysis) alt-tag

Lasso and Elastic Net Regression were performed and analyzed in a similar manner with their associated log regularization coefficients $$\alpha$$ (see report for more details)

A comparison of Unregularized, Lasso, Ridge, and Elastic Net Regression on the Geographical Original of Music Data Set provided by the UCI Machine Learning Repository alt-tag

Analyzed regression of spatial data using kernel functions, specifically data on temperature measurements from 112 weather stations in Oregon provided by Luke Spadavecchia of the University of Edinburgh

Used kernel smoothing to predict the average minimum annual temperature at each point on a 100x100 grid spanning these stations through the use of a Gaussian kernel. A scale was chosen through cross-validation, and combined to create the image below. This closely matches with Figure 4 which displays the result obtained from ordinary Kriging (see the report for further analysis). alt-tag

Regularized the kernel method shown here using lasso, and again predicted the average minimum annual temperatures across the 100x100 grid. As above, scale was chosen through cross-validation, and combined to create the image below (see report for images corresponding to a wider array of scales and kernel functions). alt-tag

Plotted the impact of the number of predictors on accuracy, much like in Figure 7.17. Note that the mean square error decreases from 0 to 24 predictors, where the regularization constant results in the residual hitting a knee indicating the point of diminishing returns. alt-tag

A similar procedure was performed with Elastic Net Regression (see report)

Worked with Google's TensorFlow in analyzing how convolutional neural networks are used to classify written digits from the MNIST database, and analyzing the results using TensorBoard. This closely follows the Deep MNIST for Experts tutorial.

Plotted accuracy of the convolutional neural networks over the number of steps, in this case nearly 2000, which yields a very impressive at nearly 97.44%! alt-tag

Modified the convolutional neural networks from the Deep MNIST for Experts tutorial in an effort to derive a better result.

Below is a plot of the accuracy of a network with the following configuration:

• 7x7 kernel, 32 features, no max pooling, 3 convolutional layers deep (see report for more details and configurations)
• Note that a peak accuracy of around 98% is achieved after a minimal number of steps alt-tag

A similar procedure was executed for the CIFAR data set