Good morning Rick. Dirt Road Moore and Johnny Miller are the only two people I know that have looked at the hole when they putted. Players usually get to this place by having a hard time staring at the ball and beginning their stroke. It is not a terrible thing, so if you like it stay with it.
One thing though. Do your eyes trace the roll line of the ball? Your eyes need to trace from the hole back to the ball, check your clubface, and then trace from ball to hole, ....and fire. By trace, I mean your eyes should move along the intended roll line AT THE SAME PACE THE BALL WILL BE ROLLING. Don't be haphazard in this.
Here is a drill. Go out to your course and drop two balls at ten feet. Hit the putt and count from the moment of impact until the ball gets to the hole. It will probably be in the range of 4 seconds. Now go back to twenty feet and do the same. It will probably be in the range of 6 seconds. Now go back to 30 feet. Now go to 5 feet. Get a TIME the ball will be rolling and plug that into your routine of eye tracing.
PS- Downhill putts use more time than uphill putts.