Left: Taiwan has been controlled by a few different countries in it's history. For a while it was under the control of Japan. These fortified observation posts are from the (relatively short) Japanese era. Naturally they are perched on the most scenic mountain vantage points.
Below: I didn't get inside (Thought I would have loved to) but I did poke my camera stick in through the observation port.