Can you get in trouble for magnet fishing?

I started magnet fishing a couple of years ago and therefore tried various magnets. And always ended up buying new...