It is very possible that Chauncey Brooks was not a button maker. He could have been a dealer in clothing. Most buttons made in the US were produced by one of four button manufacturers, Waterbury, Scovill, Horstmann & Steele and Johnson.
I think your button would date from about 1820 to the late 1830s.