There is no way to stop it without putting in a number, but it should only show up once a month or so. If it shows up every time you might have to clear you cache and cookies. Sorry, it doesn't look like gmail give the option just just plain turn it off.
The only option I can think of is if you have a skype online number you could set it to that instead, but they cost $18, I believe.