What can happen if I walk the railroad tracks?

Until a few years ago I did that all the time. You see a lot of deer in my area. Never heard of it being illegal, but I did hear a lot of the train will get you stuff.