You can get there by CAN bus. The rocks are a 15 minute walk from JR Futaminoura Station, which can be reached by JR trains.

Mount Tarumae
Seeing as Mount Tarumae is not accessible by public transport directly, you must first go to Lake Shikotsu Visitor Center.