That means that you have exactly same named post/page on your WP posts/pages and WP adds in -2 on autopilot to duplicates.
What services do you use before the link increases?
If you insist on having same page URL, go to your original post (old one), add something like "-old" to it (or delete it) and then you will be able to keep your post name without "-2" in it for sure.Oh, so it seems like the reason might be that I've duplicated this page before, but then I changed whole link name on a duplicated page so I thought it won't affect this one from before in any way. Can I do something with it?
If you insist on having same page URL, go to your original post (old one), add something like "-old" to it (or delete it) and then you will be able to keep your post name without "-2" in it for sure.