Big Data Assessment and Strategy

Case Study Data and Analytics

A communications provider utilizes Apex's Data & Analytics solution to assess their ETL framework and produce a future state assessment. 

SITUATION

Our client created a homegrown ETL process using T-SQL and stored procedures, for the purpose of loading reporting tables to satisfy customer data requests. The ETL required extensive custom coding that became too labor intensive and costly to maintain, rendering it impractical to meet the scalability needs of an expanding customer base. Without a more practical solution, our client’s future growth would cease without the ability to meet customer demand. We were asked to review our client’s current ETL framework, produce a future state assessment based on client requirements, a high-level target architecture and strategic roadmap to help them get there.

Completed ETL Assessment

SOLUTION

Our solution consisted of:

  • Third party ETL frame work
  • A throughput tool to satisfy real-time reporting requirement
  • Dimensional data stored on MS SQL Server ’12
  • Fact data stored on a Hadoop file system to meet total data volume approaching a petabyte

Our consulting team consisted of an ETL subject matter expert (SME) and a database structure SME. These technical experts conducted in-depth interviews with client stakeholders and performed reviews of current state ETL, database structures and client data requirements to determine future state. The consultants performed an unbiased assessment of ETL, throughput tools and database technologies that would help them arrive at the future state/target architecture.

RESULT

The assessment was completed on budget and satisfied all significant client requirements. The consulting services team’s findings were presented to and well received by the Chief Technology Officer and Sr. Technical management team.