Why was a section of Montague called "Brick House"?

Longtime residents may still recall a village that once existed within Montague township, referred to as "Brick House"  or as the village of Montague. It took its name from the hotel, constructed of bricks, which sat off the left side of the current approach via Route 206 to the Milford-Montague Bridge. 

The time of its first organization is far back, and the statements regarding it are too uncertain to fix on the exact period. It is, however, one of our oldest towns, and was originally settled by the Dutch. The place is also known as the " Brick House." It' takes its name from the hotel which is built of brick, and has been occupied as a public house for several generations.
There has been a post-office here for many years, as the old stage route from Newark crossed the Delaware at this point. Here the first bridge across the Delaware was built forty years ago. This bridge although of stone, was not a substantial structure, and becoming unsafe a new wooden one was put up. This was torn down about thirteen years ago, and the present beautiful suspension bridge was constructed. The length of this bridge is 525 feet, and cost $12,500.
There are in Montague, besides the hotel, two stores and a blacksmith's shop.
Excerpt from - The Historical Directory of Sussex County, N.J.: Containing a Brief Summary ...
 edited by Edward A. Webb, 1872.

Courtesy - New Jersey State Archives, Department of State
Courtesy
Library of Congress, Prints & Photographs Division,
HABS 
NJ-437

Today, a historic marker situated on CR 521 nearby, tells of the hamlet,
and 
a stone marker recalls the former location of the inn/hotel.