This has happened on the PGA Tour before:
The Only Par-4 Hole-in-One on the PGA Tour
The guy in the tee box drives/rolls the ball up the hole, it hits the putter of one of the guys standing on the green and went in the hole. So long as none of the players on the green hit it intentionally, they are all outside agents and just "rub of the green".