You can learn about the history of Betsukai with a visit to Notsuke Lighthouse. While you're in the area, wander around the natural setting.
You can spend an afternoon browsing the exhibits at Bekkaicho Railway Memorial Museum in Betsukai. Take in the museums while you're in the area.