John Roese’s Blog CTO, Nortel

The Future of the Internet Core

In the last few weeks there has been a large volume of dialog around which technology should define the “core packet transport” of the Internet. Mostly that dialog has been focused on the ongoing debate between the MPLS technology camp and the Carrier Ethernet camp. If you are not familiar with this debate I have included (at the end of this post) some links from various trade and other web sites that show the level of passion and, in some cases, hostility in this dialog.  

The reason I point this out is that one easy way to determine the significance of a technical inflection is the level of defensiveness that emerges when a technology is challenged by a viable alternative. I remember when the Token ring camp (which I was involved in) determined that “this Ethernet thing” was not robust, predictable or mainstream enough to be relevant. I also remember when the Novell IPX and DECnet camps argued that Internet Protocol (TCP/IP) was also not sufficiently mature to be used in the corporate world. Obviously they were both wrong and the world moved forward. Today, most new IT people don’t even know what Token ring or IPX or DECnet are (not to mention APPN, LAT, Banyan Vines, AppleTalk, and others).  

What is clear is that the technology that ultimately won each debate and became the common model was the technology that offered the lowest cost, the simplest operating model and the greatest scalability and flexibility to move forward. The industry has always gravitated to technology with those benefits.   

Once again the industry is in this debate. We are debating if the future is about the multi-protocol label switching (MPLS) path or if it will ultimately evolve to a model that is Carrier Ethernet over a high-performance optical layer. At its very core the debate is around whether or not we should use Ethernet to transport Ethernet services or if Ethernet is best transported over another technology, such as IP/MPLS.

Today, the industry is split. There are clearly many MPLS carrier customers, but there is also a rapidly growing number of operators using Carrier Ethernet (more than 40 using Nortel’s gear alone). Additionally, there are millions of enterprise customers using Ethernet as their primary transport technology. The contentious point is that Ethernet as defined by IEEE 802.3 and 802.1 was not initially designed for carrier applications. Today, however, the IEEE 802.1ah (Provider Backbone Bridging), 802.1Qay (Provider Backbone Transport) and 802.1ag (connectivity and fault management) amendments in the standards track are emerging to add the needed carrier services to an Ethernet switched network. With these technologies it is very easy to provide most Ethernet VPN services over large-scale carrier infrastructure at much lower capital cost and a simplified operating model.  

When we look at the MPLS side we see that there is significant active work and a host of draft documents and requests for comments (RFCs), which are the IETF code for a defined and generally accepted specification or document (note that I am simplifying dramatically the IETF standards process, as defined by RFC 2026, as it is easily one of the most rigorous and complex in the industry and, as such, results in very few fully standardized technologies). Even though MPLS has been in existence in some flavor since roughly 1996 (I was at many of the first meetings back before MPLS as a term existed), it is not fully standardized in all dimensions because of both the complexity and the process to solidify its real objectives.  

Additionally, the MPLS model has evolved in terms of what it was originally trying to do. Initially it was designed to accelerate the forwarding of software-based routers. That became somewhat irrelevant as hardware-based routing emerged. The technology then became a mechanism to provide QoS using complex signaling and label stacking. That was of use but largely not used because the industry simply created more capacity and was comfortable with CoS. It then became a technology focused on providing virtualization of subscribers. This is of use but not unique to MPLS; many VPN solutions exist that can do the same thing.

What makes MPLS interesting is that it has a broad set of optional capabilities because it is a conglomeration of many iterative technology streams applied to recreate the TDM carrier network over a packet switched network. It gets even more complex when you look at the actual core of MPLS and realize that there are actually many different approaches under this umbrella, including VPLS, T-MPLS, and a host of other vendor-specific approaches. 

The bottom line is that the MPLS world is a complex space. The MPLS working group (to quote the group’s charter) is “responsible for standardizing a base technology for using label switching and for the implementation of label-switched paths over various packet based link-level technologies, such as Packet-over-Sonet, Frame Relay, ATM, and LAN technologies (e.g. all forms of Ethernet, Token Ring, etc.). This includes procedures and protocols for the distribution of labels between routers and encapsulation.” 

So, why would there be a huge debate over Carrier Ethernet versus MPLS? Three reasons. One, is that the telecom core is still in an evolutionary phase where there has been broad adoption of the various MPLS technologies. Two, most MPLS networks work reasonably well at providing the services they were chosen for over the past decade. And, three, the carrier landscape is usually fairly slow to adopt new technologies because the capital and operating costs of change are nothing to trivialize when one considers the scale of a national or international carrier’s network. Compounding this is the fact that many equipment vendors have made significant investment in both time and dollars to build up MPLS product lines and the idea that this technology investment may not be suitable for one of the most rapidly growing elements of the equipment market (metro networking) is unimaginable.

The bottom line is that there are as many near-term reasons to defend the status quo as there are longer-term reasons to move to an Ethernet over Ethernet technology, such as Carrier Ethernet.

The purpose of this post is not to educate you on MPLS or Carrier Ethernet, but rather to put into context the dialog, which is now front page news every time a customer makes a decision about one of them and every time a product or standard is launched.

Over the next few months, I will try to update the story as it unfolds and add additional context, but for now I ask you to keep in mind that this debate is really no different than many technology inflections of the past. This, too, will unfold with much debate and passion and, like every technology evolution before, we will see a continued movement to simpler, more effective transport and IT systems. The challenge will be in managing the transition and evolution to what is the inevitable. 

References:
IETF MPLS Working Group Link 
IETF Standards Process: 
IEEE 802.1 Web Site 
Face Off: MPLS vs. Carrier Ethernet 
Ethernet Goes Carrier ClassWhat’s
Next for PBT-less BT?
 
Analyst: PBT is Not Dead Yet 
Nortel Wins PBB Deal with Verizon

Trackbacks/Pings

  1. […] providers. And so on. Take for instance a blog post by Nortel’s CTO, John Roese, discussing The Future of the Internet Core. Essentially he is hyping PBT by pitting it against MPLS. But I don’t buy it. This […]

Comments

  1. John,

    I am not sure I really understand the point of your post. As you know the simplest or most elegant solution does not always win. Betamax vs. VHS, ATM (cell) vs. Packet switching, Windows vs. OS2, Next, Minidisk, Newton, ISDN are but a few examples.

    I think one more corollary you missed was that carriers have learned the hard way that when any technology is brought to them (as the next sliced bread) by a single vendor, they tend to shy away. They do not want vendor lockout or even vendor dominance of a particular technology that their network depends on (e.g. appletalk).

    I understand the history and I have been around a lot longer than you. I remember the nethead vs bellhead ATM wars, ipsilons original proposal, cisco’s tag switching and cell switching being discussed back in the 1995. Nothing has really changed.

    The reason MPLS is so popular is that it allows carriers to leverage their existing investments in Sonet and ATM while still transporting IP. The promise is merging traffic from several networks onto a single backbone. The success has been ok but not remarkable, predicted problems with traffic engineering and excessive network management complexity have not materialized because of abundant bandwidth, but that might change soon.

    IMO what is holding up the simpler switched ethernet solution is an entrenched MPLS empire which has just won very hard and costly battles against ATM for the control of layer 2 (layer 2&1/2?). The wounds are still fresh and organizations have not completely healed and then along comes switched ethernet :) There are half hearted organizational “discussions” about to spin up over switched ethernet vs. MPLS in most carrier organizations, but no one is really wanting a repeat of the past conflicts anytime soon, plus they need to fully amortize all of theis MPLS gear they just got done deploying.

    I believe it will take a technical (bandwidth) or organizational (network management) crisis to change the MPLS path most big carriers are on anytime soon.

  2. I have lots of comments that I would take the trouble to enter if this were a real blog. But it isn’t. This site is a marketing bulletin site with NO interaction from the author. Nortel clearly doesn’t understand what a blog is. No surprise.

  3. ANW. I have comments “awaiting moderation” on Phil’s blog since the 20th of last month :)

  4. Hi John — it was great to meet you last monday… and I would like to explore your asnwer to my question re the “greening” agenda item. You mentioned that Nortel had stumbled onto your green strategy by luck more than by design… Your products already include a number of energy efficient tools… my question however, what are you proposing to do for the future? - what is your future Strategy in this arena, how will your company help an organisation of my type (Local Authority) to reduce our energy consumption and be CO2 neutral (0%)?

    It is all very well visioning the Future Internet Core as the way forward - however, we MUST do something about the amount of energy we use because of the escalation in the use of the Internet. Mobile telecommunication also has its energy “overutilisation”. etc etc..

    Thanks again.

    Mario

  5. it’s july 11… a month has elapsed… is NT dead?

  6. John,

    With all of this talk about power consumption, I am interested in another topic that is important to me.

    In light of Kevin Martins recent press release about Comcast’s restriction of peer to peer traffic
    http://www.nytimes.com/2008/07/12/technology/12comcast.html?partner=rssyahoo&emc=rss
    And with Nortel products providing “Peer-to-Peer traffic inspection, redirection, bandwidth rate limiting” features where does Nortel stand with respect to net neutrality, censorship?

  7. many, re your question (#6) … Net neutrality is obviously a heated industry discussion, to put it mildly. If you look at it from a technical perspective, though, the Internet is a very complex system that requires significant control mechanisms to keep it operational. Sometimes those control mechanisms are used for protection and stability and sometimes they’re used for monetization. Although we can debate how to best utilize those control technologies, what is abundantly clear is that those control mechanisms are absolutely necessary. If any legislation or regulation was to occur that would prohibit the use of technology to control the characterization of the Internet for any purpose whatsoever, the Internet would cease to function.

    Our guidance to the FCC has been to proceed very cautiously about recognizing that on one side you have the potential for overzealous use of control and on the other side you have an irrational position that the removal of all control mechanisms would be a sufficient solution. Neither is correct.

    I encourage you to have a look at the paper we submitted to the FCC last year, which articulates our position in more detail. You can find it here: http://fjallfoss.fcc.gov/prod/ecfs/retrieve.cgi?native_or_pdf=pdf&id_document=6519724305

  8. John,

    Thank you for a straight forward answer to a difficult question. I agree some of the deep packet inspection technology can be useful in security at the edge. I hate to see it (mis)used to restrict and censor content though and I encourage everyone who cares to express their opinion and lend encouragement to the FCC in their current direction.

  9. Mario (#4) … I agree with you that a focus on the “greening” of telecom is essential as we go forward. It’s certainly a growing focus in Nortel (and a growing one in the industry). We’ve been pretty vocal about some of our efforts lately, particularly around the fact that we have a significant power efficiency and carbon footprint advantage over our major competitor. You can expect some other announcements from us in coming months, and I’ll be blogging about this more in the future, but in the meantime I’ll also reach out to some of our “green” experts to respond in a bit more detail.

  10. Let me take a moment and add my thoughts to the conversation. I lead our Green efforts within Nortel and was intrigued by Mario’s (#4)comments. Nortel and our ICT peers are in a very unique position in the overall green discussion, as the communications products which we design and sell can aid in reducing the carbon footprints of our customers, end users, and even our own footprint (running Nortel on Nortel). That being said, Telepresence, Unified Communications, and Energy Efficiency are all key areas of interest within Nortel, not only from a product and solution aspect, but as a way to reduce travel, increase productivity, manage costs, and reduce one’s carbon footprint.
    Additionally, surveys which attempt to capture green themes and trends in business all seem to converge on a common theme: green is good as long as a positive business impact can be derived from it. The ability to reduce costs and carbon emissions at the same time is what captures the interest of a business. That is why our focus on energy efficiency is so captivating.

    I look forward to continued dialogue in this evolving, dynamic area; that’s how we learn. Climate Change is a challenge that will be solved collaboratively, using the best each one of us has to offer.

  11. Rick, I believe that many of your flagship carrier products are terribly energy-inefficient relative to the competition. My belief is based on the age of the technology and the physical footprint in the CO. Two that stand out to me are the CS2000 VoIP switch and the Passport product line. Do you have any comments or any data that is more precise than my basic assumptions? Is there any platform overhaul work underway to modernize these product lines while simultaneously making them more green?

  12. ANW, I have seen you post this question in various ways, not getting much of a response. Here is what I know on the subject.

    I am participating on the customer side in lab trial and small rollouts of Nortel’s Call Server software (somewhat modified) on COTS (ATCA) platforms. I can’t elaborate too much because of NDAs but suffice it to say these offer more port density and use less energy than the Brown & Green or the big ol’ honkin’ Passports. This should be no surprise. I think you are correct about the Brown & Green based CS2Ks, they are not any more energy efficient that the old DMS.

    I would think that simply removing all the software that drove the proprietary Brown & Green hardware would save huge amounts of memory, and power. I expect that software is more that 60% of the memory right there. :)

    Passport VSS frames (PP7K, 15K & 20K) are being replaced in the core by Junipers an at the edge by Tellabs and ALU at a rapid clip but I don’t know if there is energy being saved. To be sure energy consumption on a per port or per frame basis would need to be calculated Nortel did have some proposals to upgrade the Passports for the PE but it was far too little, far too late and somewhat ironically required a custom processor enhancement. :)

    I am interested how the COTS/ATCA based AGW (which I think is based on the VSE platform) for LTE compare with the competition (I think I asked this elsewhere on Roese’s or Edholm’s blogs). I have a (typically) huge 3.5 meg 122+ page (energy in-efficient) PDF slide deck from Nortel on AGW, but it really does not go into any depth on power consumption. :) I would expect similar numbers to the ATCA Call Server though you don’t really have a comparable legacy product to compare. A brief discussion on the VSE can be found here: (pg. 74) www.nortel.com/corporate/news/collateral/ntj6_newsbriefs.pdf

    It is interesting also to me that the VSE seems to depart very much from the old NIH (Not Invented Here) mindset at Nortel and leverages some low level commercial off the shelf software (COTSSW?) such as NGCL. It also appears that the development environment might have completely changed from proprietary PLS and VxWorks as well.

  13. many - thanks for the insight. Moving to COTS h/w and s/w platforms is the right direction. I guess power consumption will become a higher-ranking 3rd party platform selection criteria given that Nortel is basing a marketing campaign on Green. As far as overcoming NIH goes, the easiest way to make it happen is to cut budgets.

    I’m not surprised by Nortel’s silence on my question regarding energy efficiency of the Carrier portfolio. I’m betting that the total energy deficiency of the carrier portfolio relative to the competition is far greater than the total energy efficiency of the enterprise data products relative to the competition, which would put Nortel in an uncomfortable position. The reason I pose the question is that I don’t think people who live in glass houses should throw rocks (at Cisco). There are better battles for Nortel to pick than energy consumption.

  14. ANW

    Another way to look at it is that the “green” advantage (if there is in fact one) is perceived as effective against Cisco enterprise.

    It is not (yet) as much of a consideration on the “Big Iron” side, even in places Cisco is trying to gain traction.

    I suspect that it will become more important to the carriers going forward, although it will always be less than enterprise because to most enterprises communication is a cost center, not a profit center.

  15. ANW

    BTW & IMO Cisco suffers seriously from the NIH phenomenon. In fact, my sense is that they suffer from it more so than Nortel ever did, so look for some of the same problems as Routers, switches and bridges become even more commoditized in the core.

  16. many - Nortel is indeed focusing the green advantage against cisco enterprise. No doubt. That’s what motivates me to post. I believe Nortel is launching that attack from a glass house.

    Interesting comment on cisco NIH. my experience is that cisco NIH is overcome by a much more empowered and powerful sales team. the sales team tells the GM what sells and the GM does what it takes to grow the business. I guess we’ll see how it plays out.

  17. ANW. WRT cisco sales, I agree. However people are becoming blatedly aware what the true cost of the cisco premium is. It reminds me a bit of when IBM or Western Electric ruled there respective markets, at the end of the day a single powerful vendor was a serious problem for the customers. I agree, we will see how it plays out. I am a very interested spectator.

Leave a Reply