This is one of the oldest museums in Vidzeme and features interesting discoveries from the Middle Ages and the Iron Age, some of which were found around Lake Lubāna. Employees organise thematic exhibitions related to the culture and history of the administrative district, as well as art exhibitions.  The museum is in the historical buildings of the former Birži Estate.

The estate is in the centre of Ineši, 5 km to the south of Vecpiebalga.  The estate dates back to the latter half of the 17th century, when an ornate castle for the noble Sheremetyev family was built here in the style of Classicism and on the banks of the little Orisāre River.  The castle was built down during the 1905  Revolution, but restored four years later.  Around the castle is a lovely landscape park.  The castle served as the prototype for the Slātava Estate in the famous novel “Age of the Surveyors” by the Kaudzīte brothers.  In 1992, the Piebalga Administrative District Museum was opened in the wine cellar of the castle, which is home to the Ineši Parish Council and a porcelain painting studio.  Organised tours of the estate and its surrounding area are available.