Gregory M. Brown was born in Irvington, New Jersey to Warren John Brown, a stage actor, singer, and musician who was performing at the Papermill Playhouse in Millburn, New Jersey and Nell Joyce (Garlick) Brown, who at the time was a housewife. His mother would eventually become the first female member of the Stock Transfer Agents Association in New York while a manager at Union Pacific Corporation