Yep, it's definitely a semaphore

Looks like the tracks were abandoned quite a few years ago, but they are still mapped on Google Maps. A lot of old depots kept their semaphores for historical purposes. Don't feel bad though, a lot of common things are mistaken for sirens all the time.