BDA studies large volumes of data to discover unseen links and correlations
BDA studies large volumes of data to discover unseen links and correlations

UAE firms must illuminate dark data or miss out on massive opportunity, experts say



The UAE is home to a massive accumulation of dark data in key industries, the untapped potential of which represents a business-critical opportunity, according to a new report.

Dark data - or digital information that is stored but not used - accounts for 48 per cent of the total data stored by organisations in the UAE, according to the 2018 UAE Databerg Report released last week by Veritas Technologies, a California-based global data management firm.

“Large volumes of dark data that stays in the UAE points to the fact that managing dark data is becoming a business-critical issue for organisations,” said Damian Wilk, senior regional director – Middle East, Veritas Technologies.

“By identifying the value of such data, organisations can move towards faster decision-making, greater operational efficiency and increased productivity.”

_______________

Read more:

_______________

In most cases, businesses leave dark data dormant for practical reasons. The data might take too long to clean and any information gleaned from organising it would then be too old to be useful. In such instances, records may be incomplete or outdated or be stored in file formats or on devices that have become obsolete.

Examples of dark data include server log files that could provide clues to website visitor behaviour, customer call detail records that incorporate unstructured consumer sentiment data and mobile geolocation data that could reveal traffic patterns that would help with business planning, according to TechTarget, a publisher of data security information.

Bringing dark data into the light - that is, actually using it - can create new revenue streams, reduce waste and cut down on costs by providing insights that can make businesses more efficient and attuned to their customers' needs.

Big data analytics studies large volumes of data to discover unseen links and correlations. Companies are increasingly adopting big data analysis applications to turn dark data into usable information to better understand consumer behaviour, make decisions and offer more tailored services.

In 2016, big data analytics generated around $2 billion (Dh7.3bn) in revenue in Middle East and Africa (MEA) region, and is expected to reach $3.2bn by 2020, according to Statista.

“Data has been the most valuable commodity since the industrial revolution...there is huge potential in the data that is yet to be managed,” said Hemesh Dogiparthi, director of technical services and support at Dubai-headquartered StorIT, a specialist in enterprise data storage. He said that tapping into dark data could help address pressing matters like climate change, global hunger and poverty.

Clean data – or data that is useful to businesses – has more than doubled from 8 per cent in 2016 to 19 per cent in 2018 in the UAE, as per the Databerg report. The rise in clean data has led to a significant reduction in so-called 'Redundant, Obsolete or Trivial (ROT) data' from 43 to 33 per cent in the past two years. ROT data is documented by companies but presents no business value.

The public sector carries the largest data burden with 42 per cent redundant data, followed by industry (36 per cent), finance (33 per cent) and utilities (30 per cent).

________________

Read more:

________________

“While nearly half of UAE organizations’ data is “dark data”, there is reason to be optimistic: “clean data” has more than doubled to 19 percent, showing that CIOs (chief information officers) are prioritising BDA and digital business models,” said Gergi Abboud, sen­ior vice president and general manager of SAP Middle East South – which includes the UAE, Oman, Qatar, Egypt, Lebanon and Jordan.

“Digital officers can implement policies to share data across different lines of business to turn raw data into actionable insights,” said Mr Abboud.

While the big data analytics industry is expected to grow significantly in the coming years to capitalise on dark data, the region is also being tested. Data backup, according to experts, or safely storing this potential treasure trove of ever-increasing business intelligence, is a major challenge and adoption rates of secure data storage remains low.

"You need to backup the big data platform as well as archives of ageing data," Santhosh Rao, research director at Gartner, a global research and advisory company, told The National. "This is still a new concept and not very evolved in the [MEA] region."

UK-EU trade at a glance

EU fishing vessels guaranteed access to UK waters for 12 years

Co-operation on security initiatives and procurement of defence products

Youth experience scheme to work, study or volunteer in UK and EU countries

Smoother border management with use of e-gates

Cutting red tape on import and export of food

BMW M5 specs

Engine: 4.4-litre twin-turbo V-8 petrol enging with additional electric motor

Power: 727hp

Torque: 1,000Nm

Transmission: 8-speed auto

Fuel consumption: 10.6L/100km

On sale: Now

Price: From Dh650,000

MATCH INFO

Group B

Bayern Munich v Tottenham, midnight (Thursday)

Brief scores:

England: 290 & 346

Sri Lanka: 336 & 243

The National's picks

4.35pm: Tilal Al Khalediah
5.10pm: Continous
5.45pm: Raging Torrent
6.20pm: West Acre
7pm: Flood Zone
7.40pm: Straight No Chaser
8.15pm: Romantic Warrior
8.50pm: Calandogan
9.30pm: Forever Young

The burning issue

The internal combustion engine is facing a watershed moment – major manufacturer Volvo is to stop producing petroleum-powered vehicles by 2021 and countries in Europe, including the UK, have vowed to ban their sale before 2040. The National takes a look at the story of one of the most successful technologies of the last 100 years and how it has impacted life in the UAE.

Read part three: the age of the electric vehicle begins

Read part two: how climate change drove the race for an alternative 

Read part one: how cars came to the UAE

Business Insights
  • As per the document, there are six filing options, including choosing to report on a realisation basis and transitional rules for pre-tax period gains or losses. 
  • SMEs with revenue below Dh3 million per annum can opt for transitional relief until 2026, treating them as having no taxable income. 
  • Larger entities have specific provisions for asset and liability movements, business restructuring, and handling foreign permanent establishments.
Key facilities
  • Olympic-size swimming pool with a split bulkhead for multi-use configurations, including water polo and 50m/25m training lanes
  • Premier League-standard football pitch
  • 400m Olympic running track
  • NBA-spec basketball court with auditorium
  • 600-seat auditorium
  • Spaces for historical and cultural exploration
  • An elevated football field that doubles as a helipad
  • Specialist robotics and science laboratories
  • AR and VR-enabled learning centres
  • Disruption Lab and Research Centre for developing entrepreneurial skills
Mobile phone packages comparison
The years Ramadan fell in May

1987

1954

1921

1888

ONCE UPON A TIME IN GAZA

Starring: Nader Abd Alhay, Majd Eid, Ramzi Maqdisi

Directors: Tarzan and Arab Nasser

Rating: 4.5/5

VEZEETA PROFILE

Date started: 2012

Founder: Amir Barsoum

Based: Dubai, UAE

Sector: HealthTech / MedTech

Size: 300 employees

Funding: $22.6 million (as of September 2018)

Investors: Technology Development Fund, Silicon Badia, Beco Capital, Vostok New Ventures, Endeavour Catalyst, Crescent Enterprises’ CE-Ventures, Saudi Technology Ventures and IFC

Profile

Name: Carzaty

Founders: Marwan Chaar and Hassan Jaffar

Launched: 2017

Employees: 22

Based: Dubai and Muscat

Sector: Automobile retail

Funding to date: $5.5 million

Dust and sand storms compared

Sand storm

  • Particle size: Larger, heavier sand grains
  • Visibility: Often dramatic with thick "walls" of sand
  • Duration: Short-lived, typically localised
  • Travel distance: Limited 
  • Source: Open desert areas with strong winds

Dust storm

  • Particle size: Much finer, lightweight particles
  • Visibility: Hazy skies but less intense
  • Duration: Can linger for days
  • Travel distance: Long-range, up to thousands of kilometres
  • Source: Can be carried from distant regions
It Was Just an Accident

Director: Jafar Panahi

Stars: Vahid Mobasseri, Mariam Afshari, Ebrahim Azizi, Hadis Pakbaten, Majid Panahi, Mohamad Ali Elyasmehr

Rating: 4/5

UAE currency: the story behind the money in your pockets
Profile box

Company name: baraka
Started: July 2020
Founders: Feras Jalbout and Kunal Taneja
Based: Dubai and Bahrain
Sector: FinTech
Initial investment: $150,000
Current staff: 12
Stage: Pre-seed capital raising of $1 million
Investors: Class 5 Global, FJ Labs, IMO Ventures, The Community Fund, VentureSouq, Fox Ventures, Dr Abdulla Elyas (private investment)

MISSION: IMPOSSIBLE – FINAL RECKONING

Director: Christopher McQuarrie

Starring: Tom Cruise, Hayley Atwell, Simon Pegg

Rating: 4/5

COMPANY PROFILE
Name: Kumulus Water
 
Started: 2021
 
Founders: Iheb Triki and Mohamed Ali Abid
 
Based: Tunisia 
 
Sector: Water technology 
 
Number of staff: 22 
 
Investment raised: $4 million 
Company Profile:

Name: The Protein Bakeshop

Date of start: 2013

Founders: Rashi Chowdhary and Saad Umerani

Based: Dubai

Size, number of employees: 12

Funding/investors:  $400,000 (2018) 

House-hunting

Top 10 locations for inquiries from US house hunters, according to Rightmove

  1. Edinburgh, Scotland 
  2. Westminster, London 
  3. Camden, London 
  4. Glasgow, Scotland 
  5. Islington, London 
  6. Kensington and Chelsea, London 
  7. Highlands, Scotland 
  8. Argyll and Bute, Scotland 
  9. Fife, Scotland 
  10. Tower Hamlets, London 

 

The%20specs
%3Cp%3E%3Cstrong%3EPowertrain%3A%20%3C%2Fstrong%3ESingle%20electric%20motor%0D%3Cbr%3E%3Cstrong%3EPower%3A%20%3C%2Fstrong%3E201hp%0D%3Cbr%3E%3Cstrong%3ETorque%3A%20%3C%2Fstrong%3E310Nm%0D%3Cbr%3E%3Cstrong%3ETransmission%3A%20%3C%2Fstrong%3ESingle-speed%20auto%0D%3Cbr%3E%3Cstrong%3EBattery%3A%20%3C%2Fstrong%3E53kWh%20lithium-ion%20battery%20pack%20(GS%20base%20model)%3B%2070kWh%20battery%20pack%20(GF)%0D%3Cbr%3E%3Cstrong%3ETouring%20range%3A%20%3C%2Fstrong%3E350km%20(GS)%3B%20480km%20(GF)%0D%3Cbr%3E%3Cstrong%3EPrice%3A%20%3C%2Fstrong%3EFrom%20Dh129%2C900%20(GS)%3B%20Dh149%2C000%20(GF)%0D%3Cbr%3E%3Cstrong%3EOn%20sale%3A%3C%2Fstrong%3E%20Now%3C%2Fp%3E%0A
The specs

Engine: 1.5-litre 4-cyl turbo

Power: 194hp at 5,600rpm

Torque: 275Nm from 2,000-4,000rpm

Transmission: 6-speed auto

Price: from Dh155,000

On sale: now

The biog

Favourite car: Ferrari

Likes the colour: Black

Best movie: Avatar

Academic qualifications: Bachelor’s degree in media production from the Higher Colleges of Technology and diploma in production from the New York Film Academy

The years Ramadan fell in May

1987

1954

1921

1888