Brown College is situated on Monroe Hill, a historical site with connections dating to the early years of the University. Monroe Hill is home to the Hill House, the Sally Brown Reading Room, faculty housing, and administrative offices dedicated for Brown College. Brown's dorm rooms surround Monroe Hill, which plays a critical part in Brown's heritage and events, including Hauntings and Food Truck Fridays.

To learn more about Monroe Hill's history, please watch the following film by Eduardo Montes-Bradley:

Monroe Hill unearths the history of the site which contains the last remaining structures of Monroe's late 18th century southern plantation. These surviving structures are silent witnesses to Monroe’s struggle as a farmer and a politician from the late 1780’s until the laying of the cornerstone at the University of Virginia on October 6, 1817.