Yes. Floating IPs are billed from the moment they are allocated, even when they aren't attached to a server.
To stop billing, release the IP. Released IPs cannot be recovered, so make sure you no longer need the address.
Floating IPs need a router on your network, and you can move them between servers by unassigning and assigning them again.
📖 Full guide: Public Cloud networking