The rising and setting of the sun is accompanied by changes in both the irradiance and the spectral distribution of the sky. Since the discovery of intrinsically photosensitive retinal ganglion cells (ipRGCs) 20 years ago, considerable progress has been made in understanding melanopsin's contributions to encoding irradiance. Much less is known about the cone inputs to ipRGCs and how they could encode changes in the color of the sky. I will summarize our recent connectomic investigation into the cone-opponent inputs to primate ipRGCs and the implications of this work on our understanding of circadian photoentrainment and the evolution of color vision.