All Posts

In this post we describe the Nyström method for finding the eigenvalues and eigenfunctions of a kernel function. This has ...
Read More
In this post we describe the use of momentum to speed up gradient descent. We first describe the intuition for ...
Read More
Popular papers often have code on Github, but the authors are super busy writing new papers, so you may notice ...
Read More
In this post we describe how to do gradient descent with constraints. We first describe the problem, including why we ...
Read More
In this post we describe the high-level idea behind gradient descent for convex optimization. Much of the intuition comes from ...
Read More
An important class of machine learning models is decision trees: you can use them for both classification and regression. In ...
Read More
In this post we describe several methods for visualizing time series data. Time series visualization has several uses. First, it ...
Read More
In this post we describe basic visualization of missing data patterns in R with VIM. We describe how to see ...
Read More
In this post we describe stationary and non-stationary time series. We first ask why we want stationarity, then describe stationarity ...
Read More
In this post we describe the basics of time series smoothing in R. We first describe why to do smoothing, ...
Read More
In this post we describe how to solve the full rank least squares problem without inverting a matrix, as inverting ...
Read More
In this post we describe the basics of 1-d convolutional neural networks, which can be used in time series forecasting ...
Read More
In this post we describe multilayer perceptrons. We first describe why we want to use neural networks, and what feedforward ...
Read More
In this post we describe the basics of missing data. We first ask whether we should consider the data to ...
Read More
In this post we describe the autoregressive (AR) time series model. We define it, describe steps to take before fitting ...
Read More
In this post, we describe Granger causality, which helps us answer the question of whether one time series is useful ...
Read More
In this post we describe the basics of long-short term memory (LSTM). We first describe some alternative classical approaches and ...
Read More
In this post, we describe how to compare linear regression models between two groups. Without Regression: Testing Marginal Means Between ...
Read More
In this post we show how to predict future measurement values in a longitudinal setting using linear mixed models (LMMs) ...
Read More
In this post we describe centering features in linear regression: you should do it because it changes the interpretation of ...
Read More
In this post we briefly describe some interesting looking companies doing machine learning in the healthcare space. Flatiron Health Flatiron ...
Read More
In this post we describe the problem of class imbalance in classification datasets, how it affects classifier learning as well ...
Read More
In this post we describe how to do binary classification in R, with a focus on logistic regression. Some of ...
Read More
Introduction to Linear Regression Summary Printouts In this post we describe how to interpret the summary of a linear regression ...
Read More
In this article we discuss how to evaluate classification accuracy, with a focus on binary classification and using software from ...
Read More
In this post we describe how to do regression with count data using R. In many applications we want to ...
Read More
In this post we describe the Kaplan Meier non-parametric estimator of the survival function. We first describe what problem it ...
Read More
In this article we describe how to perform linear regression. We go over some linear regression basics and answer the ...
Read More
There are several reasons to log transform the response. The obvious one is to fix linearity violations, but in many ...
Read More
In linear regression, you fit the model \begin{align}y=X\beta+\epsilon\end{align} However, often the relationship between your $x$ and $y$ variables is not ...
Read More
In this post we analyze the residuals vs leverage plot. This can help detect outliers in a linear regression model ...
Read More
In this post we describe how to analyze a scale location plot. You may also be interested in the fitted ...
Read More
In this post we describe how to interpret a QQ plot, including how the comparison between empirical and theoretical quantiles ...
Read More
In this post we describe the fitted vs residuals plot, which allows us to detect several types of violations in ...
Read More
Note: this is loosely based on Coursera's A Crash Course on Causality: Inferring Causal Effects from Observational Data Introduction In ...
Read More
Background Classical statistics was developed to study how to collect and analyze data in the setting of controlled studies. However, ...
Read More
You should use non-parametric tests when the most naive distributional assumptions of a parametric test fail and you can’t invoke ...
Read More
We want to use wearable technology in healthcare to drive interventions. For example, an app might send a notification encouraging ...
Read More
Machine learning and statistics in healthcare have potentially game changing applications, but also pose new challenges for modeling and analysis ...
Read More
These are solutions to the intuition questions from Stanford's Convolutional Networks for Visual Recognition (Stanford CS 231n) assignment 1 inline ...
Read More
This article is in part based on http://www2.stat.duke.edu/~sayan/Sta613/2017/lec/LMM.pdf. In this post we describe how linear mixed models can be used ...
Read More
When you start you should learn a few basic algorithms and understand them well.  Here are five good ones. Linear ...
Read More
Machine learning and statistics use very similar tools: probability distributions, representations of conditional probability, maximum likelihood estimation, Bayesian inference, etc.  ...
Read More
In Survival Analysis, you have three options for modeling the survival function: non-parametric (such as Kaplan-Meier), semi-parametric (Cox regression), and ...
Read More
One way to learn anything quickly is to constantly apprentice yourself to people better than you at what you're trying ...
Read More
Math is difficult, but is extremely important for statistics and machine learning.  Sometimes when you work with great researchers, they ...
Read More
Logit and logistic regression are the same thing.  However, they actually relate to generalized linear models.  In a generalized linear ...
Read More
You are testing a new drug treatment for HIV, and your new drug costs 10x the old one.  You run ...
Read More
In survival analysis, we want to model the time to a first event, often death. One way to model the ...
Read More
Here are some books and courses for survival analysis that are useful for learning it.  People of various skill levels ...
Read More
Say you want to model the evolution over time of a disease like HIV in an individual, or the evolution ...
Read More
I'd often seen two different versions of Cauchy Schwartz (CS).  In analysis and linear algebra I'd learned that if $x,y$ ...
Read More
I recently read the paper "SARA: A Mobile App to Engage Users in Health Data Collection." [1]  The problem they ...
Read More
An important area in applied and methodological statistics as well as machine learning is disease progression modeling.  There are arguably ...
Read More
Python is the language of choice for many data scientists and researchers who analyze data, and it has far superior ...
Read More
Say you have an experiment and you want to test whether there is a difference in the treatment response between ...
Read More
In this post we check the assumptions of linear regression using Python. Linear regression models the relationship between a design ...
Read More
In a previous post, we introduced the basic terminology of hypothesis testing. We also wanted to test the null hypothesis ...
Read More
Here we'll go over the fundamental concepts of hypothesis testing. Generally we want to test two hypotheses. Let's say we ...
Read More
In a previous post, I mentioned some books that are useful if you want to eventually be able to read ...
Read More
Here we'll talk about multicollinearity in linear regression. This occurs when there is correlation among features, and causes the learned ...
Read More
I saw a question like this Quora, and have been meaning to start a blog so decided to answer it ...
Read More