To remove one or more phone numbers navigate to Settings > Account Information and find the Contact Information section. If there are phone numbers listed in the following form:

Find the number(s) you wish to remove and click the Remove button. Once finished select Save Changes at the bottom of the screen.