Email a colleague    

November 2013

Hadoop and M2M Meet Device and Network Management Systems

Hadoop and M2M Meet Device and Network Management Systems

Predicting the uptake of new technologies is about as accurate a game as throwing darts at a wall blindfolded.

Vendor press releases, blogs, and PowerPoints contain a good measure of bias.  Then there are the “independent” analyst reports with their hockey stick adoption curves.

But tracking the activity of high-tech OEMs is a legitimate technique for spotting trends.  For instance, camping outside Foxconn factories in China should be a fruitful place to do electronics industry research because Foxconn, the world’s largest electronic contract manufacturer, makes the iPhone, iPad, Kindle, PlayStation, and countless other devices.

Well, the equivalent of Foxconn in the network management space in WebNMS.  For a decade or more, WebNMS, the telecom OEM software side of Zoho Corporation, has led the market for commercial frameworks used to build either Network or Element Management Systems (NMS/EMS) In fact, there are more than 800 WebNMS deployments each quarter and they range from applications that manage $25 cable modems to multi-million dollar optical long haul switches that number in the dozens.

I caught up with WebNMS through Eric Wegner, the firm’s Marketing VP and regular contributor to the B/OSS blog site.  I was curious to get Eric’s view on a couple key trends: M2M and analytics, especially as those technologies intersect with network management.

Dan Baker: I know one of the areas you’re increasingly serving is Machine-to-Machine (MTM) or the Internet of Things market.

Eric Wegner: Yes, Dan.  As part of a wider communications package or family plan, M2M is very attractive.  For instance, an M2M service like medical or security monitoring in the home has a high perceived value: it’s a sticky service because consumers fear losing coverage if they switch their mobile broadband provider.

The M2M applications themselves don‘t carry a lot of bandwidth services like video.  In fact, the messages are rather small — like SMS.  Where the complexity comes in is where you have a huge number of devices out there: medical diagnostic gear, industry process controllers, and the like.

And today many of these devices don‘t have a good means to communicate back with the manager of these devices.  That’s where our WebNMS comes into play: we offer them a path to do fault monitoring, performance management, and security.

One of the problems with M2M as a software market is that it’s highly fragmented.  It’s everything from cell tower management and medical devices... to solar / wind power remote management and grocery stores monitoring the hydrogen in their refrigerators.

And in many cases the people involved are end users, not developers or system architects so they don‘t have the internal capability to use our framework.  For example, one customer needs remote management of IT infrastructure on the oil rigs sitting out in the Gulf of Mexico.  Now the people who run those rigs are more system admin types, so we need to customize solutions for them.  And because we can’t afford to address the wide array of M2M uses, we often get systems integrators involved.

But as I say, the biggest issue in M2M is the explosion of devices because the amount of performance metrics grows very quickly.

Now the M2M market is a far cry from the carrier-grade business you do with carriers, OEMs, and network equipment vendors like Alcatel Lucent.

Yes, we are serving a wide array of customers in long haul optical, metro-optical, mobile backhaul, satellite, and wireless access.  And that market plays to our framework’s strength in helping clients build custom network/element management solutions.

Now in that space, we’ve recently taken steps to speed the design-to-deployment cycle.  We now build APIs to the framework to enable things like SDN (Software Defined Network).  Likewise, we have a Carrier Ethernet “feature pack” that smoothes the path to using the MEF standards.  These design aids mean customers don‘t need to build everything from scratch.

I saw press release announcing WebNMS’s support for the Apache Hadoop architecture.  What’s that about?

Yes, we figure Hadoop is the next big thing so we’re gearing up for it.

A satellite application customer is looking strongly at the WebNMS and Hadoop combination for their project.  It’s a bandwidth optimization use case involving satellite-to-ground comms: gobs of data and plenty of latency/jitter issues to sort out.

One of the beauties of Hadoop is you can distribute the load across, say, a cluster of 20 commodity CPUs instead of having one huge database and hardware.

We tested Hadoop’s performance in one of our largest deployments: 7 million cable modems stored in a relational database.  When we compared the Hadoop application to a traditional one, Hadoop boosted query performance by a factor of 10.

We feel high-end fault management is perfect for Hadoop.  That application involves correlating faults from neighboring devices or comparing the current fault with similar fault types in a historical store.  So if you have several terabytes of data coming in and you need to analyze that in real-time, the Hadoop architecture can handle that.  In fact, the Hadoop ecosystem supports lots of new real-time databases.

What are the drawbacks of Hadoop?

The technology is strong, but will people adopt Hadoop in sufficient numbers?  That’s the key question.  For companies who have a strong relationship with the large hardware firms, it will certainly be a fairly long adoption curve.

But for companies who are looking for value, the cost savings are compelling: in the order of $50,000 versus the low millions of dollars.

On final question, Eric: what’s your opinion of search engines that explore unstructured or machine data, such as Ontology, Splunk and HP’s Autonomy?  Will they gain traction in network management applications?

Actually Splunk’s method of searching syslogs is similar to what we do with our Event Log Analyzer.

For troubleshooting, devices spit out syslogs -- raw messages telling you what the device is doing.  So if something bad happens, the NMS sends an alert.  And if you need to look at all the gory details, that’s typically where the syslogs come in.

Ultimately this is a design choice.  WebNMS could pull in the syslogs and convert them into alerts.  From a telco point of view, then, a syslog alert is an alternative to alerting with SNMP or another protocol.

So far, we haven‘t seen Splunk in network management.  My guess is that Splunk’s strong suite is in enterprise compliance reporting and security.  WebNMS also has a few large data center enterprise customers.  One of them is a large bank who uses our Event Analyzer to check syslogs for security.

Thanks for getting us up to data on, Eric.  It’s highly interesting perspective.

Copyright 2013 Black Swan Telecom Journal

 

About the Expert

Eric Wegner

Eric Wegner

Eric Wegner is a 20-year veteran of the industry and has 10 years of experience with ZOHO Corp. (formerly AdventNet) working on large and complex network management infrastructures for network equipment manufacturers, service providers and military contractors.  Eric joined the company as the first sales person and is now business development manager leading the WebNMS division in North America.   Contact Eric via

Related Stories

  • Pure Play NFV: Lessons Learned from Masergy’s Virtual Deployment for a Global Enterprise interview with Prayson Pate — NFV is just getting off the ground, but one cloud provider to enterprises making a stir in virtual technology waters is Masergy.  Here are lessons learned from Masergy’s recent global deployment using a NFV pure play software approach.
  • Hadoop and M2M Meet Device and Network Management Systems interview with Eric Wegner — Telecom big-data in networks is more than customer experience managment: it’s also about M2M plus network and element management systems.  This interview discusses the explosion in machine-to-machine devices, the virtues and drawbacks of Hadoop, and the network impact of shrink-wrapped search.
  • NEC Takes the Telecom Cloud from PowerPoint to Live Customers interview with Shinya Kukita — In the cloud computing world, it’s a long road from technology success to telecom busness opportunity.  But this story about how NEC and Telefonica are partnering to offer cloud services to small and medium enterprises shows the experience of early cloud adoption.  Issues discussed in the article include: customer types, cloud application varieties, geographic region acceptance, and selling challenges.
  • Telco-in-a-Box: Are Telecoms Back in the B/OSS Business? interview with Jim Dunlap — Most telecoms have long since folded their merchant B/OSS software/services businesses.  But now Cycle30, a subsidiary of Alaskan operator GCI, is offering a order-to-cash managed service for other operators and utilities.  The article discusses the company’s unique business model and contrasts it with billing service bureau and licensed software approaches.

Related Articles

  • Pure Play NFV: Lessons Learned from Masergy’s Virtual Deployment for a Global Enterprise interview with Prayson Pate — NFV is just getting off the ground, but one cloud provider to enterprises making a stir in virtual technology waters is Masergy.  Here are lessons learned from Masergy’s recent global deployment using a NFV pure play software approach.
  • The Digital Enabler: A Charging, Self-Care & Marketing Platform at the Core of the Mobile Business interview with Jennifer Kyriakakis — The digital enabler is a central platform that ties together charging, self-care, and marketing.  The article explains why leading operators consider digital enablers pivotal to their digital strategies.
  • Delivering Service Assurance Excellence at a Reduced Operating Cost interview with Gregg Hara — The great diversity and complexity of today’s networks make service assurance a big challenge.  But advances in off-the-shelf software now permit the configuring and visualizing of services across multiple technologies on a modest operating budget.
  • Are Cloud-Based Call Centers the Next Hot Product for the SMB Market? interview with Doron Dovrat — Quality customer service can improve a company’s corporate identity and drive business growth.  But many SMBs are priced out of acquiring modern call center technology.  This article explains the benefits of affordable and flexible cloud-based call centers.
  • Flexing the OSS & Network to Support the Digital Ecosystem interview with Ken Dilbeck — The need for telecoms to support a broader digital ecosystem requires an enormous change to OSS infrastructures and the way networks are being managed.  This interview sheds light on these challenges.
  • Crossing the Rubicon: Is it Time for Tier Ones to Move to a Real-Time Analytics BSS? interview with Andy Tiller — Will tier one operators continue to maintain their quilt works of legacy and adjunct platforms — or will they radically transform their BSS architecture into a new  system designed to address the new telecom era?  An advocate for radical transformation discusses: real-time analytics, billing for enterprises, partnering mashups, and on-going transformation work at Telenor.
  • Paradigm Shift in OSS Software: Network Topology Views via Enterprise-Search interview with Benedict Enweani — Enterprise-search is a wildly successful technology on the web, yet its influence has not yet rippled to the IT main stream.  But now a large Middle Eastern operator has deployed a major service assurance application using enterprise-search.  The interview discusses this multi-dimensional topology solution and compares it to traditional network inventory.
  • The Multi-Vendor MPLS: Enabling Tier 2 and 3 Telecoms to Offer World-Class Networks to SMBs interview with Prabhu Ramachandran — MPLS is a networking technology that has caught fire in the last decade.  Yet the complexity of MPLS has relegated to being mostly a large carrier solution.  Now a developer of a multi-vendor MPLS solutions explains why the next wave of MPLS adoption will come from tier 2/3 carriers supporting SMB customers.
  • Enabling Telecoms & Utilities to Adapt to the Winds of Business Change interview with Kirill Rechter — Billing is in the midst of momentous change.  Its value is no longer just around delivering multi-play services or sophisticated rating.  In this article you’ll learn how a billing/CRM supplier has adapted to the times by offering deeper value around the larger business issues of its telecom and utility clients.
  • Driving Customer Care Results & Cost Savings from Big Data Facts interview with Brian Jurutka — Mobile broadband and today’s dizzying array of app and network technology present a big challenge to customer care.  In fact, care agents have a hard time staying one step ahead of customers who call to report problems.  But network analytics comes to the rescue with advanced mobile handset troubleshooting and an ability to put greater intelligence at the fingertips of highly trained reps.
  • Hadoop and M2M Meet Device and Network Management Systems interview with Eric Wegner — Telecom big-data in networks is more than customer experience managment: it’s also about M2M plus network and element management systems.  This interview discusses the explosion in machine-to-machine devices, the virtues and drawbacks of Hadoop, and the network impact of shrink-wrapped search.
  • The Data Center & Cloud Infrastructure Boom: Is Your Sales/Engineering Team Equipped to Win? by Dan Baker — The build-out of enterprise clouds and data centers is a golden opportunity for systems integrators, carriers, and cloud providers.  But the firms who win this business will have sales and engineering teams who can drive an effective and streamlined requirements-to-design-to-order process.  This white paper points to a solution — a collaborative solution designs system — and explains 8 key capabilities of an ideal platform.
  • Big Data: Is it Ready for Prime Time in Customer Experience Management? interview with Thomas Sutter — Customer experience management is one of the most challenging of OSS domains and some suppliers are touting “big data” solutions as the silver bullet for CEM upgrades and consolidation.  This interview challenges the readiness of big data soluions to tackle OSS issues and deliver the cost savings.  The article also provides advice on managing technology risks, software vendor partnering, and the strategies of different OSS suppliers.
  • Calculated Risk: The Race to Deliver the Next Generation of LTE Service Management interview with Edoardo Rizzi — LTE and the emerging heterogeneous networks are likely to shake up the service management and customer experience management worlds.  Learn about the many new network management challenges LTE presents, and how a small OSS software firm aims to beat the big established players to market with a bold new technology and strategy.
  • Decom Dilemma: Why Tearing Down Networks is Often Harder than Deploying Them interview with Dan Hays — For every new 4G LTE and IP-based infrastructure deployed, there typically a legacy network that’s been rendered obsolete and needs to be decommissioned.  This article takes you through the many complexities of network decom, such as facilities planning, site lease terminations, green-safe equipment disposal, and tax relief programs.
  • Migration Success or Migraine Headache: Why Upfront Planning is Key to Network Decom interview with Ron Angner — Shutting down old networks and migrating customers to new ones is among the most challenging activities a network operators does today.  This article provides advice on the many network issues surrounding migration and decommissioning.  Topics discussed include inventory reconciliation, LEC/CLEC coordination, and protection of customers in the midst of projects that require great program management skills.
  • Navigating the Telecom Solutions Wilderness: Advice from Some Veteran Mountaineers interview with Al Brisard — Telecom solutions vendors struggle mightily to position their solutions and figure out what to offer next in a market where there’s considerable product and service crossover.  In this article, a veteran order management specialist firm lays out its strategy for mixing deep-bench functional expertise with process consulting, analytics, and custom API development.
  • Will Telecoms Sink Under the Weight of their Bloated and Out-of-Control Product Stacks? interview with Simon Muderack — Telecoms pay daily for their lack of product integration as they constantly reinvent product wheels, lose customer intelligence, and waste time/money.  This article makes the case of an enterprise product catalog.  Drawing on central catalog cases at a few Tier 1 operators, the article explains the benefits: reducing billing and provisioning costs, promoting product reuse, and smoothing operations.
  • Virtual Operator Life: Enabling Multi-Level Resellers Through an Active Product Catalog interview with Rob Hill — The value of product distribution via virtual operators is immense.  They enable a carrier to sell to markets it cannot profitably serve directly.  Yet the need for greater reseller flexibility in the bundling and pricing of increasingly complex IP and cloud services is now a major channel barrier.  This article explains what’s behind an innovative product catalog solution that doubles as a service creation environment for resellers in multiple tiers.
  • Telecom Blocking & Tackling: Executing the Fundamentals of the Order-to-Bill Process interview with Ron Angner — Just as football teams need to be good at the basics of blocking and tackling, telecoms need to excel at their own fundamental skillset: the order-to-cash process.  In this article, a leading consulting firm explains its methodology for taking operators on the path towards order-to-cash excellence.  Issues discussed include: provisioning intervals; standardization and simplicity; the transition from legacy to improved process; and the major role that industry metrics play.
  • Wireline Act IV, Scene II: Packaging Network & SaaS Services Together to Serve SMBs interview with John Frame — As revenue from telephony services has steadily declined, fixed network operators have scrambled to support VoIP, enhanced IP services, and now cloud applications.  This shift has also brought challenges to the provisioning software vendors who support the operators.  In this interview, a leading supplier explains how it’s transforming from plain ol‘ OSS software provider to packager of on-net and SaaS solutions from an array of third party cloud providers.
  • Telecom Merger Juggling Act: How to Convert the Back Office and Keep Customers and Investors Happy at the Same Time interview with Alan Burgess & Curtis Mills — Billing and OSS conversions as the result of a merger are a risky activity as evidenced by famous cases at Fairpoint and Hawaiian Telcom.  This article offers advice on how to head off problems by monitoring key operations checkpoints, asking the right questions, and leading with a proven conversion methodology.
  • Is Order Management a Provisioning System or Your Best Salesperson? by John Konczal — Order management as a differentiator is a very new concept to many CSP people, but it’s become a very real sales booster in many industries.  Using electronics retailer BestBuy as an example, the article points to several innovations that can — and are — being applied by CSPs today.  The article concludes with 8 key questions an operator should ask to measure advanced order management progress.
  • NEC Takes the Telecom Cloud from PowerPoint to Live Customers interview with Shinya Kukita — In the cloud computing world, it’s a long road from technology success to telecom busness opportunity.  But this story about how NEC and Telefonica are partnering to offer cloud services to small and medium enterprises shows the experience of early cloud adoption.  Issues discussed in the article include: customer types, cloud application varieties, geographic region acceptance, and selling challenges.
  • Billing As Enabler for the Next Killer Business Model interview with Scott Swartz — Facebook, cloud services, and Google Ads are examples of innovative business models that demand unique or non-standard billing techniques.  The article shows how flexible, change-on-the-fly, and metadata-driven billing architectures are enabling CSPs to offer truly ground breaking services.
  • Real-Time Provisioning of SIM Cards: A Boon to GSM Operators interview with Simo Isomaki — Software-controlled SIM card configuration is revolutionizing the activation of GSM phones.  The article explains how dynamic SIM management decouples the selection of numbers/services and delivers new opportunities to market during the customer acquisition and intial provisoining phase.
  • A Cynic Converted: IN/Prepaid Platforms Are Now Pretty Cool interview with Grant Lenahan — Service delivery platforms born in the IN era are often painted as inflexible and expensive to maintain.  Learn how modern SDPs with protocol mediation, high availability, and flexible Service Creation Environments are delivering value for operators such as Brazil’s Oi.
  • Achieving Revenue Maximization in the Telecom Contact Center interview with Robert Lamb — Optimizing the contact center offers one of the greatest returns on investment for a CSP.  The director of AT&T’s contact center services business explains how telecoms can strike an “artful balance” between contact center investment and cost savings.  The discussion draws from AT&T’s consulting with world class customers like Ford, Dell, Discover Financial, DISH Network, and General Motors.
  • Mobile Broadband: The Customer Service Assurance Challenge interview with Michele Campriani — iPhone and Android traffic is surging but operators struggle with network congestion and dropping ARPUs.  The answer?  Direct  resources and service quality measures to ensure VIPs are indeed getting the quality they expect.  Using real-life examples that cut to the chase of technical complexities, this article explains the chief causes of service quality degradation and describes efficient ways to deal with the problem.
  • Telco-in-a-Box: Are Telecoms Back in the B/OSS Business? interview with Jim Dunlap — Most telecoms have long since folded their merchant B/OSS software/services businesses.  But now Cycle30, a subsidiary of Alaskan operator GCI, is offering a order-to-cash managed service for other operators and utilities.  The article discusses the company’s unique business model and contrasts it with billing service bureau and licensed software approaches.
  • Bricks, Mortar & Well-Trained Reps Make a Comeback in Customer Management interview with Scott Kohlman — Greater industry competition, service complexity, and employee turnover have raised the bar in the customer support.  Indeed, complex services are putting an emphasis on quality care interactions in the store, on the web, and through the call center.  In this article you’ll learn about innovations in CRM, multi-tabbed agent portals,  call center agent training, customer treatment philosophies, and the impact of  self-service.
  • 21st Century Order Management: The Cross-Channel Sales Conversation by John Konczal — Selling a mobile service is generally not a one-and-done transaction.  It often involves several interactions — across the web, call center, store, and even kiosks.  This article explains the power of a “cross-channel hub” which sits above all sales channels, interacts with them all, and allows a CSP to keep the sales conversation moving forward seamlessly.
  • Building a B/OSS Business Through Common Sense Customer Service by David West — Delivering customer service excellence doesn‘t require mastering some secret technique.  The premise of this article is that plain dealing with customers and employees is all that’s needed for a winning formula.  The argument is spelling out in a simple 4 step methodology along with some practical examples.