Microsoft vs. RIM Blackberry: This time we mean it (sort of)

Microsoft has once again declared war on the RIM Blackberry. This is probably the third or fourth time they have done so, and like the other times the full solution from Microsoft isn't quite shipping yet. But it's closer than it was before, so this is a good time to check in on the situation.

In the early 1990s, Microsoft went through a harrowing experience with IBM over the OS/2 operating system. First they worked together on it, then Microsoft shifted its focus to Windows. There are a lot of theories on whether the cooperation between the two companies was ever sincere, but what's clear to me is that along the way Microsoft learned a lot of handy business practices from IBM. One is FUD (fear, uncertainty, and doubt), the art of tantalizing customers with your future plans while at the same time scaring them about problems with competitors.

IBM was so well known for FUD that it spawned an off-color joke in the tech industry. I'm going to repeat it here because it vividly captures the current situation. I've tried to clean it up so it won't offend anyone. My apologies in advance if you're offended anyway.

Three women were at lunch comparing notes on their husbands. The first woman said, "My husband is from France. Every evening he holds me in his arms and fulfills my wildest fantasies." The second woman smiled and said, "My husband is from Italy. Every night he comes home early and devotes himself to my needs for hours." The third woman shook her head and said, "My husband is a sales rep from IBM. Every night he sits on the edge of the bed and tells me how great it's going to be until I fall asleep."

That's basically what Microsoft has been doing with Direct Push, its RIM-like mobile e-mail solution. The Microsoft faithful have been waiting for Direct Push a long time – Microsoft has talked about mobile e-mail for years, and this particular solution was first discussed publicly about a year ago. Some people on the mobile websites have been getting mighty testy about the delays.

The surprising thing to me about this week's announcement is that Microsoft is still sitting on the edge of the bed. Devices with the software built in won't be available until later this year. Upgrades are promised for existing devices, but again there's no date for availability. Several operators announced that they will support Direct Push, including Cingular, T-Mobile, Orange, and Vodafone. But I couldn't find any firm availability dates, just target quarters.

The other thing I'm not clear on is the business model for Direct Push in the long term. Microsoft's core pitch for its mobile mail solution is that it'll be free – the features are being built into Exchange Server, so any company with the latest version of Exchange gets free mobile e-mail automatically. There's no need to buy a RIM server, and if you have an IP connection, there's no need to pay e-mail service charges either.

This is supposed to be Microsoft's killer advantage over RIM. But the operators carrying Direct Push are all talking about charging around $30 a month or more for it – about the same as you'd pay for RIM service. Reuters even quoted Pieter Knook, Microsoft's SVP of the mobile team, as saying, "they (the operators) are pricing it pretty much the same."

I can understand why the operators don't want to give away Direct Push access. Many of them just installed RIM servers and are presumably getting a cut of the service fees from RIM. They wouldn't tolerate Microsoft destroying that revenue stream. If you thought iTunes got a frosty reception from the operators because it might interfere with their potential future music stores, picture how they'd feel about Microsoft messing with their existing mobile e-mail businesses.

As a result of all this, it's hard to tell how enthusiastic the operators are about Direct Push. They're usually willing to attend a product announcement with Microsoft, just for the PR value. But if they don't like the economics of it, they may leave it on their price lists but put the aggressive marketing against other mail systems. My guess is that they don't want any single mobile mail vendor to dominate, so they would have more options and more negotiating leverage in the future.

The operators' involvement changes the market dynamics around Direct Push, and I'm not sure that all of the people predicting RIM's demise have thought it through. It looks like the free thing about Direct Push will generally be the server, not the service. That's obviously important to IT managers, but it's not very meaningful to the users and departmental managers who have been some of the most passionate supporters of RIM. They generally don't have to pay for a server installed by the corporation, or deal with the hassle of maintaining it. So for them, switching from RIM to Windows Mobile would mean retraining and lost productivity for no direct cost savings.

Rather than setting up a classic Explorer vs. Netscape conflict in which the users themselves benefited from Microsoft's giveaway, Microsoft may be creating a user and department vs. IT conflict within corporations. I don't know how that's going to play out. In general, IT hasn't been very successful at driving uniform mobile standards in corporations the way they did with PCs. Mobile devices are cheap enough that most employees buy their own, and because they're used for both personal and corporate use it's much harder for companies to dictate the choice of device.

Perhaps Microsoft is counting on a second wave of mobile e-mail deployment in which corporations will provide Windows Mobile devices to all employees. In departments where there is no RIM today, it'd be much easier to get Microsoft embraced as a standard. But I'm not convinced that mobile e-mail is ever going to be as broadly used as, for example, desktop e-mail is today. In the user research I've been involved in, some people are communication fanatics who eagerly embrace mobile mail, but a lot of others don't really want it. Even if you gave them a mobile mail device, they might not use it much – in which case the corporation would have trouble justifying $360 a year in data service charges per employee.

There's going to be more mobile mail deployment in corporations, but I think the penetration is going to vary enormously by company and by industry. Companies have personalities, just like people. I think some of them will embrace mobile mail broadly and some won't. The patchier the deployment, the better for RIM, because IT departments will have less control over the deployment decision.


Does this mean RIM is safe?

Hardly. The idea of reducing the number of servers a company supports is intensely appealing to IT managers, and Microsoft has a history of crushing competitors in similar situations. History isn't prophecy, but RIM must at least show convincingly that it can counter Microsoft's pitch.

So far its performance is not at all encouraging. Some publications reported that RIM was not available to comment on the Microsoft announcement, which was pretty surprising to me considering the importance of the issue. RIM should have made sure everyone had its perspective. Other stories quoted RIM CEO Jim Balsillie as saying that RIM's solution is still better than Microsoft because it's more secure and uses less network bandwidth. That may or may not be true, but by making that sort of detailed argument its main pitch, RIM loses automatically. Essentially, RIM is acknowledging that Microsoft has copied most of its functionality, and we're now reduced to arguing minutiae. I tried that personally at both Apple and Palm, and it doesn't work. Once Microsoft has copied 90% of your solution, and especially if its product is free, most customers will either default to Microsoft because it's less of a hassle, or wait patiently for Microsoft to deliver the remaining 10% functionality.

I think RIM would be much better served if it went on the offensive, to convince its current customers that they'd be fools to remove their RIM servers, and to persuade new customers that there's a compelling, positive reason to buy. Communication fanatics care about all forms of communication, not just e-mail. It would be nice to see RIM try to add other types of communication to its solutions. Also, RIM has been working for years on other services, many of them enterprise apps, that can run on its servers. Now's the time to publicize those. (Or, if the additional services aren't compelling enough to give the company an edge, now is the time to ask what RIM's engineers have been doing for the last three years.)

The time may finally be approaching when RIM will need to choose between its device business and its server business. For a couple of years the story inside the industry has been that RIM knows it's a server company; that's why it was willing to license its client software to other firms. But that client software has been agonizingly slow to appear, and now RIM may face a stark choice. If it wants to preserve its device sales, it should make Blackberries work with Microsoft's e-mail system in addition to its own servers. Then there would be no reason to remove Blackberry from corporations. But that could hurt RIM server sales. On the other hand, RIM could keep its devices tied to the RIM servers, but in that case it might lose the whole company.

If I were running the place, I'd allow Blackberry devices to connect directly to Direct Push. If the RIM server is truly superior, customers will continue to buy it no matter what other options are on the devices. If the server's not superior, tying the devices to it won't save the company. I think RIM's not big enough to win by holding its customers prisoner.

Now the damage caused by RIM's legal situation with NTP becomes visible. For the last year or more, when RIM should have been preparing for the Microsoft assault, it has been distracted by the patent lawsuit. I don't know how big the distraction was for RIM's execs; maybe they were able to compartmentalize their thinking and focus on Microsoft anyway. But that would require amazing mental discipline. I don't think most managers could do it.

For a long time I've been puzzling over why RIM has fought the NTP case so vigorously. I even asked a friend who's an attorney and has worked a lot of major corporate and government cases. We agreed that most companies would have settled long ago, just to get the thing out of the way. Why didn't RIM do it? I believe pride is a factor. RIM is still controlled by its founders, and sometimes the people who built a company are violently opposed to letting anyone else benefit from what they see as their work. One of the angriest business documents I've ever seen is the public commentary that Jim Balsillie wrote for the Wall Street Journal. A sample: "Unlike NTP, RIM actually created something -- a company and a new market segment through over 20 years of innovation, risk-taking, partnering, customer service, growth and re-investment."

I think it's also possible that as the case has progressed, RIM's management has started to worry about shareholder liability if they settle before the last possible instant. Suppose RIM settled and the next day the patent office invalidated NTP's patents. Could shareholders sue RIM for settling too soon? I don't know, but it's the sort of thing management teams worry about these days.


I should add that I'd feel a lot more sympathetic toward RIM's managers if they hadn't been so quick to sue competitors who violated their patents in the past.

Regardless of the internal distractions, the biggest damage caused by the case is distraction to RIM's customers. RIM needs customer loyalty more than anything else right now, and rather than rallying the troops it has to answer things like a Gartner brief recommending that companies stop Blackberry deployment because of the lawsuit. It's also spending precious time explaining its workaround to avoid the NTP patent, which is creating its own set of uncertainties. Inconvenience and uncertainty are deadly when you're selling against Microsoft to IT managers. At some point, the managers will just throw up their hands and say, "forget it, we're moving to Microsoft's solution." And once that happens, there's no getting those customers back.

I think this is exactly what Microsoft is counting on, and it's a reason why they once again pre-announced their mobile e-mail solution even though it's not actually available. Microsoft probably hopes to stall RIM sales for now, and eventually to win the IT managers over to its side, exsanguinating RIM in the process. That would leave the operators with no choice but to support Microsoft's solution, even if they feel ambivalent about it.

I'm not saying that RIM is in danger of being wiped out overnight. But unless they elevate their marketing game, and get rid of the distractions quickly, I think their growth may be capped and they'll gradually be turned into the Lotus Notes of mobile e-mail.


Watch your back

The other interesting side effect of the Microsoft-RIM conflict is its impact on other companies. The other e-mail server companies, like Visto and Good, are obviously in danger of being squeezed between the titans. I don't think they're necessarily dead, but they'll need to be very crisp about their advantages.

The mobile operating system situation is more tantalizing. In the process of defending Exchange server from Blackberry server, Microsoft is opening some interesting opportunities to attack Windows Mobile. Microsoft is licensing other companies to sync directly to Exchange. There's already a client for some Symbian devices, and you've got to believe that Access would do one for Palm OS. If you really can push mail from Exchange on a level playing field to any device, one of the most potent arguments for Windows Mobile has been undercut. Microsoft might win on the server side only to lose the mobile device battle.

I'm sure Exchange is the more important franchise in their minds. But I bet they're trying to come up with ways to win in both.

How to read tech analysts' shipment reports and forecasts

We're entering what I like to think of as the silly season, the time when the major tech analysis companies issue their quarterly reports on mobile device sales. IDC already released its report on Q4, while Canalys is due any day. These reports always generate press coverage; some of it insightful, most of it just repeating whatever the analysis companies said.

Once all the reports are out, I'm going to look through them and try to give some comments on what I think they mean. But in the meantime, I thought it would be good to post a note on the numbers themselves – how they're gathered, what they mean, and what to watch for.

First, let's differentiate between shipment reports and forecasts. The shipment reports typically discuss what happened in the previous calendar quarter, and are issued about a month after the quarter ended. Forecasts are generally issued about once a year, and predict what sales will be in the next five years or so. We'll do forecasts first.


"You don't actually use these things to make business decisions, do you?"
--A horrified industry analyst, when she realized why we had requested the latest forecast

I think tech industry forecasts are worthless. Completely worthless. That may sound harsh, but think about it for a minute – can you reliably predict the future? Can anyone you know do it? If anyone could predict the future, don't you think they'd get rich off the stock market rather than working at an analysis company? I once asked a very senior manager at one of the biggest tech analysis firms how they created their forecasts. He laughed. "The process involved pizza, beer, and a dart board."

Here's an example of how bad tech forecasts can be: In the handheld market, the big analysis firms once predicted that handheld sales would be 60 million units a year by now. Instead they're 20 million. That's a margin of error of about 200%. If NASA forecasted that badly, Neil Armstrong would have landed in Arkansas.

Since the forecasts are useless, why do the analysis companies create them? Two words: publicity, and money. If you create a forecast and issue a press release about it, a lot of reporters will write articles on it, all of them crediting your company and publicizing its name. The tech websites will repost your press release, and even more people will read about your work.

The other reason to do a forecast is because companies will buy it. If you work in a company and you're tasked with creating a business plan, your management will insist on having a forecast as a part of it. No one believes an internally-created forecast, because the employees are assumed to be biased. So you buy an external forecast. If management is trying to be especially conscientious, you'll be asked to buy several forecasts for due diligence.

I've seen companies assign teams of senior people to spend months massaging and cleaning and polishing the industry forecasts, so they can be prepared for use in the business plan.

It's all a waste if time. When you start with a cow pie, no matter how much you polish it, all you'll get is a polished cow pie. Companies would be much better served by getting together their brightest people, asking them to make a guess, and then writing that down. Chances are the folks in your company are more in touch with the market than the analysts (you talk to a lot more of your customers than they do).


Now let's talk about the quarterly shipment numbers

To be fair, I should acknowledge that the quarterly numbers are a lot more accurate than the forecasts. But there are still major problems. No one, absolutely no one, knows what's really happening in mobile device sales. The market's too complex, and some critical numbers simply aren't available. For example, Dell won't tell anyone what its precise unit sales are by product line. It's also notoriously difficult to get phone shipment numbers out of the operators. Sometimes that seems to be because they view the information as confidential, and sometimes it seems to be because the operators themselves don't have very good inventory tracking programs for their retail stores (they care a lot more about how many service plans they sell than which phones).

The most accurate sales numbers generally come from two companies, NPD and GfK. Both of them directly track sales of electronic devices through retailers (NPD in the US, GfK in Europe and several other countries). So, for example, with the NPD numbers you can find out exactly how many handhelds were sold last week at retail in the US. You'll get a database that includes brand, model, average selling price, and a lot of other information. But those numbers won't include the things NPD can't track -- Dell, direct sales by any manufacturer to a business, and smartphones and other devices sold through the operators.

You'll also never see the NPD and GfK numbers in public. They're pretty close to monopolies in sales tracking, and they charge enormous sums of money for their data. Nothing is given away free.

That means most of us are left looking at the quarterly shipment numbers compiled by companies like Gartner, IDC, and Canalys. At all three companies, the methodology is basically the same – they call every hardware vendor, ask them how many units they shipped in the quarter, and total up the numbers. The people who make the calls and compile the numbers are generally honest and hard-working, and they're doing the best they can with the (limited) resources available to them. But there are several things you need to be aware of when reading their numbers:

--The vendors can lie. It's hard for a relatively small company like Palm to lie about its unit shipments; you can just take Palm's quarterly revenue and divide it by whatever you think the average selling price is for its devices. But for a large company like Dell or HP, mobile devices are such a small percentage of their overall sales that there's no independent way to check their numbers. I am not saying that Dell or HP fabricate the numbers they report to the industry analysts; they're pretty conservative about their reputations, and US stock market regulators frown on a company lying about anything that might move its stock price. But the rules are looser in some other parts of the world, and I've heard persistent rumors of other companies cooking their shipment numbers to make themselves look good in the quarterly reports.

If you think about it, people working in tech companies have a very strong financial incentive to mislead the share tracking companies. It's fairly common for sales and marketing managers to have performance bonuses tied to market share. Guess how share is measured. It's like asking an eight-year-old to fill out his own report card.

--The numbers measure shipments into stores, not sales to customers. When a big company like Nokia ships a new smart phone, it rushes hundreds of thousands of units into stores and distribution warehouses. Those first shipments typically happen in a single quarter, and can cause a company's share to rise dramatically in the quarter of first shipment, and then plummet the next. The analysis companies and press rarely explain this, which is why you'll get dramatic press reports that a particular handheld or smartphone company jumped from nowhere to become a top five vendor in a single quarter. Ask yourself if that's really possible – do people really change their buying preferences that quickly? And does it happen every quarter or two?

--The third problem with the quarterly numbers is that they don't report shipments by model (because companies refuse to give out their model-specific shipments). So all of Nokia's smartphone sales are reported as a single lump, or at best are cut into a couple of not-very-helpful categories such as flip phone vs. candy bar phone. This makes it incredibly difficult to figure out what's happening in different market segments.

--The fourth problem is that different analysis companies cut the mobile market differently. To Gartner, a RIM Blackberry is a PDA but a Palm Treo is a smartphone. To IDC and Canalys, both are smartphones. This makes for huge disagreements about market size. Gartner says the PDA market is growing at a healthy clip; IDC says it's dropping steadily. (By the way, if you want to hear some catty comments, ask Gartner or IDC or Canalys to tell you what they think of the way the other company classifies RIM shipments.)

Given all of these challeges, why do the analysis companies bother to compile the quarterly numbers? Once again, publicity plays a role. The quarterly score-keeping press releases get lots of coverage. (I just did a Google search for "+Gartner +PDA +share". It produced 243,000 hits.)

But also, I have to admit it – as bad as the quarterly shipment numbers are, they're better than nothing. If you know their flaws, you can try to correct for them, and sometimes you'll be able to dig out a few insights. That's what I'm hoping to do after the new round of shipment press releases comes out.

The turning point creeps closer in music

A couple of follow-ups to my post regarding music distribution.

--"If Aerosmith sold only 100,000 copies on the Internet, we'd make more than selling a million for a big label. No matter how you slice it, everybody's making more than the band." --Aerosmith's Steven Tyler, noting that the band's recording contract is up for renewal after the next album

--The LA Times runs a lot of articles giving the entertainment industry's view of technology. Some of them are a tad...skeptical. But there was a very interesting article today on Pandora, an online service that creates a customized music feed for you based on your favorite songs. You tell it which songs you like; it picks songs that have similar aural characteristics and plays them for you.

I haven't spent enough time with Pandora to decide if I like it or not; in general, I'm not a big fan of listening to music on my PC. But I love the spirit of what its founders are attempting – they want to help people discover new music that they wouldn't have found otherwise. I think services like Pandora will play an important role in removing the middleman from music. If new artists can be discovered more easily, artists will be less dependant on the record labels' marketing infrastructure.

Pandora doesn't advertise; it relies on word of mouth and blog referrals to get traffic. So I'm happy to give them a plug here.

An apology to my RSS readers: You have probably received more than one copy of this post. This is the third time I have posted it to my blog. The first two times, it mysteriously disappeared after a while. I presume this is related to the serious technical problems that the Blogger folks have been reporting all weekend. Their status report includes the not so reassuring message: "The Blogger and Google engineers and ops folks are not just sitting around waiting for the next failure; we’re actively improving our infrastructure to lessen both the planned and unplanned Blogger outages."

I know they mean well, and it's a free service, so I shouldn't complain. But I have to say that I'd expect Google, of all companies, to run a reliable service. It makes me wonder what else might be screwed up behind the scenes.