Could even be something like mullet/herring nibbling at the bait.
Paddle crabs when hungry enough would swim up to get a floating bait.
