Construction has started on a 24-unit apartment building on Town Hill Avenue in Danbury. The new four-story development will replace the former “barracks” apartment houses, which were considered a blight in the area. The project is expected to provide more housing options near downtown Danbury.