Email a colleague    

March 2014

From Alarms to Analytics: The Paradigm Shift in Service Assurance

From Alarms to Analytics: The Paradigm Shift in Service Assurance

Longstanding thought patterns are hard to shake.  When you hear the word “assurance,” what’s the first thing that comes to mind?

For me, it’s the image of a 1980s AT&T NOC (Network Operations Center) — a massive control room with high ceilings.  There’s a huge network map on the wall, and two dozen techies are monitoring three CRT screens apiece as they respond to fault and performance alarms.

OK, how realistic is this NOC paradigm as a service assurance model for today’s IP-centric carnival?

In the circuit-based telephony world, watching the status of a few thousand network nodes was a satisfactory answer to assuring network health.  But today, the number of alarm points to monitor has scaled to the millions — and to the point of being ridiculous.  No operator has the money to constantly monitor the performance issues of individual smartphone users.

Folks, it’s time for operators to get real and invest more in proactive analytics than in reactive alarms.  What’s more, the gap between network planning and assurance has to be closed.  Why?  Because the cause of today’s customer experience problem is yesterday’s lack of good data for capacity planning.

Kelvin Hall, a self-professed data geek, big data architect, and one of SAS‘ lead consultants in network analytics, has firsthand experience of the severe problems network operations faces — and the big opportunities that await them through a greater mastery of analytics techniques.

Dan Baker: Kelvin, you are inside the network ops of some very large carriers.  What are you seeing?

Kelvin Hall: When I work with big network teams at telcos, it’s readily apparent that they are not used to working with big computer data.

Information is not the problem.  The network teams have big silos of data.  But it’s a matter of knowing what to do with it.  The network guys know how to keep the network running, but in many cases they are too busy rolling out LTE to really get excellent on the data side.

And by combining analytics with all that rich network data, well, there’s a gold mine of information there waiting to be discovered and exploited.

Why haven‘t the carriers taken action and implemented big data solutions already?

Well, in many ways, large carriers are their own worst enemy when comes to innovating within.  I’ve worked at more than one large telco, and I’ll tell you it’s much easier to get things done as an outside consultant

As an employee, you’re rather constrained in what you can do.  But as an outsider, you have the power to come in and tell them what they really need to hear — and not what they want to hear.

Other consultants I’ve worked with have noticed the same thing.  When they began to work as an employee of a large carrier, they were shocked at the lack of flexibility and got frustrated.

It also sounds like there’s a big mismatch between the knowledge resident at the carriers and the expertise they need.

The fast expansion of the data in the network brings its own set of problems.  In some places it’s doubling every nine months, but the equipment is not handling the growth.  And because it’s so new, the network teams don‘t recognize the problems they are having with these network elements.  Plus there are generally no alarms to notify them.

I see big mistakes being made.  For instance, one carrier I know was growing its network based on the customer’s home address.  And that seems silly considering you can use real data to figure out where you need to add capacity.

They were making big rollouts of LTE deployment, but eight of the 10 regions where they were adding capacity were prepaid areas that had no LTE handsets.  So they were growing the network where it wasn‘t needed!

So capacity planning is critical, and it requires that you triangulate three data streams: handset features, cell tower capability, and the service you give the customer.

Network Analytics Functions

Can you give us an example of how analytics can help in service assurance?

How about this one?  In one state within a mobile operator’s territory, they were experiencing a 5 percent drop call rate — very high.  But using analytics, we were able to trace that problem to a configuration change that affected the whole region.  The operator was able to turn that into a 0.5 percent drop call rate.

It was an issue they had in the mobile switching center (MSC) affecting many cells.

The problem is they couldn‘t take action on that using traditional service assurance tools.  Alarm triggers are too little, too late, and too broad to find what you’re looking for.  Instead you need analytics to sift through the data, look at the statistics and see how things are trending.

Another example: One particular software release of the iPhone happened to have a bunch of issues — but only with certain switches.  Only certain MSCs and SGSNs had trouble with it.

So imagine somebody in the NOC trying to address that issue.  The customer calls to complain, but where do I start?  I’ve got 60 devices out there.  You know something’s wrong, but where do you go?

But when you apply real analytics to it, you can turn that around and say: This cell is performing badly with a particular type of handset or whatever the case may be, and you can pinpoint the issues more precisely.

Where do you start when you come in and consult with network teams?

The first thing we usually look for is stranded assets.  And to do that you overlay usage on top of the network inventory.  And it’s not unusual to find 4 percent of their spending is sitting on network elements that were never turned up or the customer’s gone and they continue to be paying bills to a partner for leased facilities.

Also comparing their best-performing cells versus their worst-performing cells, you’re able to see where the problems are — not from alarm triggers or waiting on the traditional threshold alerts that they look at.

Instead, by looking at data from a customer’s perspective, you can readily see what’s performing badly and what’s performing well.

At another operator, we found 6 percent of mobile data was being dropped.

Wow, 6 percent is an incredible amount to lose.  Of course, depending on where that data was lost, it won‘t translate to a 6 percent revenue loss.

Yes, let me qualify that a bit.  Say the user has a 2 gig limit on data usage, well that’s included with their plan.  But with 6 percent of the data usage not being recorded, a lot of customers were going over their limit and not being charged for it.

What sort of technology do you bring in to help?

Well, being a data geek, I do lots of coding and am pretty adept at SQL.  But actually SAS‘ newest product, SAS Visual Analytics, has a complete drag-and-drop capability that network guys really like, so the user no longer needs to do coding.

Another technology we bring in is Hadoop.  You know, at telcos, it’s not unusual to get 10 billion rows a day off of one network element.  Trouble is, it’s expensive to put those 10 billion rows in a database.

But with Hadoop, you can store huge amounts of data at low cost — and it can be either structured or unstructured data.  You’re talking about a cost savings of 10 percent to 20 percent of traditional database costs.

Now Hadoop is not a database, and you can‘t access it as such.  So at SAS we help the operator use Hadoop properly, and when you do that, the access speed can be just as fast as using a database.

Kelvin, thanks for the great real-world examples.

SAS Institute is one of 40 key analytics suppliers profiled in TRI’s new market research report, The Telecom Analytics & Big Data Solutions Market.

Copyright 2014 Black Swan Telecom Journal

 

About the Expert

Kelvin Hall

Kelvin Hall

Kelvin D. Hall, Principal Telecommunications Consultant at SAS, has served the telecom industry for over 30 years.  Most recently Kelvin served as the director of analytics servicing AT&T network engineering.  A pioneer in network data algorithms, his approach pinpoints detailed network problems through a new analytical approach exposing problems that were not visible previously.   Contact Kelvin via

Related Stories

  • Telecoms Failing Badly in CAPEX: The Desperate Need for Asset Management & Financial Visibility interview with Ashwin Chalapathy — A 2012 PwC report put the telecom industry on the operating table, opened the patient up, and discovered a malignant cancer: poor network CAPEX management, a problem that puts telecoms in grave financial risk.  In this interview, a supplier of network analytics solutions provides greater detail on the problem and lays out its prescription for deeper asset management, capacity planning and data integrity checks.
  • History Repeats: The Big Data Revolution in Telecom Service Assurance interview with Olav Tjelflaat — The lessons of telecom software history teach that new networks and unforeseen industry developments have an uncanny knack for disrupting business plans.  A service assurance incumbent reveals its strategy for becoming a leader in the emerging network analytics and assurance market.
  • From Alarms to Analytics: The Paradigm Shift in Service Assurance interview with Kelvin Hall — In a telecom world with millions of smart devices, the service assurance solutions of yesteryear are not getting the job done.  So alarm-heavy assurance is now shifting to big data solutions that deliver visual, multi-layered, and fine-grained views of network issues.  A data architect who works at large carriers provides an inside view of the key service provider problems driving this analytics shift.
  • The Shrink-Wrapped Search Engine: Why It’s Becoming a Vital Tool in Telecom Analytics interview with Tapan Bhatt — Google invented low cost, big data computing with its distributed search engine that lives in mammoth data centers populated with thousands of commodity CPUs and disks.  Now search engine technology is available as “shrink wrapped” enterprise software.  This article explains how this new technology is solving telecom analytics problems large and small.
  • Harvesting Big Data Riches in Retailer Partnering, Actionable CEM & Network Optimization interview with Oded Ringer — In the analytics market there’s plenty of room for small solution firms to add value through a turnkey service or cloud/licensed solution.  But what about large services firms: where do they play?  In this article you’ll learn how a global services giant leverages data of different types to help telcos: monetize retail partnerships, optimize networks, and make CEM actionable.
  • Raising a Telco’s Value in the Digital Ecosystem: One Use Case at a Time interview with Jonathon Gordon — The speed of telecom innovation is forcing software vendors to radically adapt and transform their business models.  This article shows how a deep packet inspection company has  expanded into revenue generation, particularly  for mobile operators.  It offers a broad palette of value-adding use cases from video caching and parental controls to application-charging and DDoS security protection.
  • Radio Access Network Data: Why It’s Become An Immensely Useful Analytics Source interview with Neil Coleman — It’s hard to overstate the importance of Radio Access Network (RAN) analytics to a mobile operator’s business these days.  This article explains why the RAN data, which lives in the air interface between the base station and the handset --  can be used for a business benefit in network optimization and customer experience.
  • Analytics Biology: The Power of Evolving to New Data Sources and Intelligence Gathering Methods interview with Paul Morrissey — Data warehouses create great value, yet it’s now time to let loose non-traditional big data platforms that create value in countless pockets of operational efficiency that have yet to be fully explored.  This article explains why telecoms must expand their analytics horizons and bring on all sorts of new data sources and novel intelligence gathering techniques.
  • Connecting B/OSS Silos and Linking Revenue Analytics with the Customer Experience by Anssi Tauriainen — Customer experience analytics is a complex task that flexes B/OSS data to link the customer’s network experience and actions to improve it and drive greater revenue.  In this article, you’ll gain an understanding of how anayltics data needs to be managed across various customer life cycle stages and why it’s tailored for six specific user groups at the operator.
  • Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators interview with Mark Trudeau — Cable operators in North America are being overwhelmed by the surge in video and audio traffic.  In this article you’ll learn how Multi Service Operators (MSOs) are now monitoring their traffic to make critical decisions to protect QoS service and monetize bandwidth.  Also featured is expert perspective on trends in: network policy; bandwidth caps; and  customer care issues.
  • LTE Analytics:  Learning New Rules in Real-Time Network Intelligence, Roaming and Customer Assurance interview with Martin Guilfoyle — LTE is telecom’s latest technology darling, and this article goes beyond the network jargon, to explain the momentous changes LTE brings.  The interview delves into the marriage of IMS, high QoS service delivery via IPX, real-time intelligence and roaming services, plus the new customer assurance hooks that LTE enables.

Related Articles

  • The Customer Engagement Era: How Personalization & Backend Integration Leads to a Richer Mobile Biz interview with Rita Tochner — How does a mobile operator move its subscribers to higher levels of spending and profit?  Fierce competition, social media scrutiny, and the high cost of new networks all conspire against these goals.  In this interview, however, you’ll learn how engaging better with customers, getting more personal, and being more sensitive to their individual needs is the path forward.
  • Telecoms Failing Badly in CAPEX: The Desperate Need for Asset Management & Financial Visibility interview with Ashwin Chalapathy — A 2012 PwC report put the telecom industry on the operating table, opened the patient up, and discovered a malignant cancer: poor network CAPEX management, a problem that puts telecoms in grave financial risk.  In this interview, a supplier of network analytics solutions provides greater detail on the problem and lays out its prescription for deeper asset management, capacity planning and data integrity checks.
  • Batting for More Churn Reduction and Revenue Assurance Home Runs interview with Peter Mueller — What’s it like to transform an IT shop to big data and cloud?  In this interview, the CTO of a boutique revenue assurance explains how his firm made the leap.  He shows how project-oriented programs and working with carrier customers to explore RA and churn reduction “hunches” is where much of the action is.
  • History Repeats: The Big Data Revolution in Telecom Service Assurance interview with Olav Tjelflaat — The lessons of telecom software history teach that new networks and unforeseen industry developments have an uncanny knack for disrupting business plans.  A service assurance incumbent reveals its strategy for becoming a leader in the emerging network analytics and assurance market.
  • From Alarms to Analytics: The Paradigm Shift in Service Assurance interview with Kelvin Hall — In a telecom world with millions of smart devices, the service assurance solutions of yesteryear are not getting the job done.  So alarm-heavy assurance is now shifting to big data solutions that deliver visual, multi-layered, and fine-grained views of network issues.  A data architect who works at large carriers provides an inside view of the key service provider problems driving this analytics shift.
  • The Shrink-Wrapped Search Engine: Why It’s Becoming a Vital Tool in Telecom Analytics interview with Tapan Bhatt — Google invented low cost, big data computing with its distributed search engine that lives in mammoth data centers populated with thousands of commodity CPUs and disks.  Now search engine technology is available as “shrink wrapped” enterprise software.  This article explains how this new technology is solving telecom analytics problems large and small.
  • Sharing Intelligence, Services, and Infrastructure across the Telecom Galaxy interview with Gary Zimmerman — The telecom industry is an industry of sharing.  In fact, the rise of mobile broadband is driving a greater reliance on real-time intelligence, services trading, and infrastructure exchange.  In this article, a leading info exchange provider explains the value of its services portfolio and points to other interoperability and sharing ideas under development.
  • Data Monetization: Why Selling Intelligence is a Hot New Revenue Stream for Mobile Carriers interview with Joe Levy — Data monetization is a revenue dream come true for mobile carriers: a highly profitable sideshow where the carrier analyzes and sells data it already collects for other purposes.  In this article you’ll learn how operators monetize their data through use cases in corporate advertising and media branding.
  • Harvesting Big Data Riches in Retailer Partnering, Actionable CEM & Network Optimization interview with Oded Ringer — In the analytics market there’s plenty of room for small solution firms to add value through a turnkey service or cloud/licensed solution.  But what about large services firms: where do they play?  In this article you’ll learn how a global services giant leverages data of different types to help telcos: monetize retail partnerships, optimize networks, and make CEM actionable.
  • Raising a Telco’s Value in the Digital Ecosystem: One Use Case at a Time interview with Jonathon Gordon — The speed of telecom innovation is forcing software vendors to radically adapt and transform their business models.  This article shows how a deep packet inspection company has  expanded into revenue generation, particularly  for mobile operators.  It offers a broad palette of value-adding use cases from video caching and parental controls to application-charging and DDoS security protection.
  • Radio Access Network Data: Why It’s Become An Immensely Useful Analytics Source interview with Neil Coleman — It’s hard to overstate the importance of Radio Access Network (RAN) analytics to a mobile operator’s business these days.  This article explains why the RAN data, which lives in the air interface between the base station and the handset --  can be used for a business benefit in network optimization and customer experience.
  • Back Office Streamlining to Enterprise Support: The Many Flavors of Wireline Analytics interview with Tom Nolting — Mobile analytics gets plenty of press coverage, but analytics is just as crucial for wireline operators.  In this article, a billing VP at a leading wireline operator discusses several diverse uses of analytics in billing, enterprise sales/retention, and network partner margin assurance.
  • Analytics Biology: The Power of Evolving to New Data Sources and Intelligence Gathering Methods interview with Paul Morrissey — Data warehouses create great value, yet it’s now time to let loose non-traditional big data platforms that create value in countless pockets of operational efficiency that have yet to be fully explored.  This article explains why telecoms must expand their analytics horizons and bring on all sorts of new data sources and novel intelligence gathering techniques.
  • B/OSS Mathematics: The Quest to Analyze Business Problems & Drive Operating Decisions interview with Matti Aksela — Analytics is the glory of mathematics brought to practical use.  And in telecom, analytics has merely stratched the surface of its full potential.  In this article, you’ll learn how machine learning is being combined with the power of CDR number crunching to optimize mobile top-ups, control churn -- and in the future, help telecoms make critical network and operating decisions.
  • Leveraging the RA/FM Platform to Deliver Business Insights to Finance & Marketing by Amit Daniel — Carrier professionals using RA and fraud management tools are getting requests from internal customers who want the role of RA/FM platforms expanded to deliver up-to-date analytics data for finance and marketing purposes.  This article advocates a cross-product layer to serve such broader use cases.  The effect would be to transform the existing RA/FM platform into a combined business protection and business growth analytics engine.
  • A Mobile Marketer Service: Bridging Personalization & B/OSS Flowthrough interview with Efrat Nakibly — Marketing analytics is a prescriptive program for driving  actions such as sending a timely promotion to a mobile subscriber.  But completeness demands that you also be able to provision that treatment, qualify the promotion, and keep billing fully in the loop.  This article shows how a managed services program can deliver such an end-to-end process and manage customer life cycles on a one-to-one basis.
  • Science of Analytics: Bringing Prepaid Top Ups & Revenue Maximization under the Microscope interview with Derek Edwards — Prepaid subscribers are the customers that carriers know the least about.  The operator is not interacting with prepaid customers on a monthly basis.  You’re not sending a bill, nor do you have detailed profiles on these customers, especially in the developing world where customers are buying SIMs at a grocery store.  This interview explains how contextual marketing meets the unique analytics challenge of prepaid customers.
  • Connecting B/OSS Silos and Linking Revenue Analytics with the Customer Experience by Anssi Tauriainen — Customer experience analytics is a complex task that flexes B/OSS data to link the customer’s network experience and actions to improve it and drive greater revenue.  In this article, you’ll gain an understanding of how anayltics data needs to be managed across various customer life cycle stages and why it’s tailored for six specific user groups at the operator.
  • Profitable 3G: China’s Mobile Operators Monetize Networks with Retailers & Partners interview with Kevin Xu — Mobile operators are at the center of explosive growth in wireless services.  But to exploit this opportunity requires IT ingenuity and a broader view on how the mobile user can be served.  In this article you’ll learn the innovative techniques Chinese operators use to monetize 3G networks via analytics and partnerships with retailers, social networks, and advertisers.
  • Customer Analytics: Making the Strategic Leap From Hindsight to Foresight interview with Frank Bernhard — Are your company’s analytics programs scattered?  Is there a strategy in place for customer analytics?  This interview with a leading telecom analytics consultant explains why strategy and planning around the analytics function is crucial to getting your money’s worth.  Topics discussed include: hindsight vs. foresight; an advanced analytics program; and the interface sophistication required to support high end vs. low end analytics users.
  • Meeting the OTT Video Challenge: Real-Time, Fine-Grain Bandwidth Monitoring for Cable Operators interview with Mark Trudeau — Cable operators in North America are being overwhelmed by the surge in video and audio traffic.  In this article you’ll learn how Multi Service Operators (MSOs) are now monitoring their traffic to make critical decisions to protect QoS service and monetize bandwidth.  Also featured is expert perspective on trends in: network policy; bandwidth caps; and  customer care issues.
  • Analytics Meditations: The Power of Low-Cost Hardware and the Social Network Within interview with Ken King — Analytics didn‘t arrive yesterday.  Data warehousing and BI have been in the telecom vocabulary for twenty-five or more years.  In this interview, you’ll gain a perspective on why “big data” changes the game and why social network (or social circles) analysis promises the next level of insights.  Other interesting topics include: segmenting the analytics market, engaging with carrier clients, and upgrading from older- to newer-style methodologies.
  • LTE Analytics:  Learning New Rules in Real-Time Network Intelligence, Roaming and Customer Assurance interview with Martin Guilfoyle — LTE is telecom’s latest technology darling, and this article goes beyond the network jargon, to explain the momentous changes LTE brings.  The interview delves into the marriage of IMS, high QoS service delivery via IPX, real-time intelligence and roaming services, plus the new customer assurance hooks that LTE enables.
  • Shared Data Plans: The Challenge of Managing a Family of Pricing, Revenue Assurance, Fraud, and Network Policy Issues by Amit Daniel — Verizon Wireless‘ recent announcement of its move to shared data plans for families shook the mobile industry.  In this column, cVidya’s Amit Daniel shines a spotlight on the knowhow and analytics tools that operators now deperately need to offer the right  shared data price plans, ensure bandwidth throttling is handled correctly, and address new fraud concerns.
  • Analytics Guru: Are Telecoms Ready for the Biz Intelligence Explosion? interview with John Meyers — Business intelligence is evolving from the creation of dashboards and reports to taking action based on a deep knowledge of the environmental context.  The article explores the implications of “big data” in terms of IPTV, storage requirements, hardware, event collection, and deep packet inspection.
  • Social Networking for Telecoms: How To Enlist Friends and Family as Mobile Marketers interview with Simon Rees — Social Network Analysis (SNA) is about exploiting data on “friends and family” connections to combat churn and win new CSP business.  The article explores how an analysis of the ebb and flow of CDRs, phone calls, and messages, can identify key influencers and drive powerful marketing campaigns.
  • Making the Strategic Leap From Billing to Merchandising interview with Humera Malik — Today billing/charging technology has progressed to the point where the usage intelligence, the charges, the user behaviors, and the analytics can all come together in near real-time.  This article discusses the organizational and marketing strategies that enable a operator to create a true “merchandising” system that can revolutionize a CSP’s business.