Now

onRefresh is called after the end of the view motion animation.

Expected

onRefresh is called when the user has finished touching (from docs "Called when a swipe gesture triggers a refresh.").

Solution

Move block of code from onAnimationEnd to setRefreshing.

if (mNotify) {
	if (mListener != null) {
		mListener.onRefresh();
	}
}

Result:

private void setRefreshing(boolean refreshing, final boolean notify) {
	if (mRefreshing != refreshing) {
		mNotify = notify;
		ensureTarget();
		mRefreshing = refreshing;
		if (mRefreshing) {
			animateOffsetToCorrectPosition(mCurrentTargetOffsetTop, mRefreshListener);
		} else {
			startScaleDownAnimation(mRefreshListener);
		}
		if (mNotify) {
			if (mListener != null) {
				mListener.onRefresh();
			}
		}
	}
}