As an update:
I fully stripped and degreased it all today. There was a lot of crud in the lower race where the knockblock hole is for sure. Made sure to get that all out.
However, I also noticed the lower bearing was very scratchy. The top bearing was fine, so maybe it was luck of the draw -...