Some residents of the historic Manhattan neighborhood oppose the construction of two apartment towers.