Later, video shows the deputy wearing just a white tank top, running across the street and hitting the man again.
At one point, the man is on the ground as the deputy pummels him and another deputy pulls him off.
Fulton County issued the following statement:
"Deputies are held to a higher standard and are expected to respond professionally to all incidents. This agency never condones any form of misconduct."
The Sheriff's Office has not identified the deputy in the fight or said if he will face any discipline.