CO - Markinnovation

Challenges in Deep Learning technology

Challenges in Deep Learning technology

Although the estimated market growth for Deep Learning is $10.2 billion by the end of 2025, it has significant bottlenecks that need to be addressed.

Challenges in Deep Learning (DL) Technology:

1. Deep Learning requires Quality and a Large Amount of Data:

Deep Learning algorithms are trained to learn progressively using the data. Lots of data sets are needed to ensure the machine delivers the desired results. Just the way the human brain requires a lot of experiences to learn and deduce information, the analogous artificial neural network also needs a copious amount of data. DL best works when it has lots of quality data, and this performance increases as the availability of data grow. Likewise, the DL system fails badly when the quality data isn’t available enough to feed the system.

2. Optimised Hyperparameters:

The Hyperparameters are those, whose values are defined before the commencement of the learning process. Any change in the value of such parameters even by a small amount can invoke a significant shift in the performance of the model. Relying on default parameters and not performing the Hyperparameter optimisation could have a tremendous impact on the performance model.

>In 2017 researchers fooled Google’s DL system into making errors after altering the data available by adding a “noise.” The researchers’ forcefully unearthed the errors related to trivial matters, like mistaking rifles for a helicopter in an image recognition algorithms, which exemplifies the dependence of DL on the right quality and quantity of data for it to perform accurately. The Google researchers explained that – “The algorithms, unlike humans, are susceptible to a specific type of problem called an “adversarial example.” These are specially designed optical illusions that fool computers into doing things like, mistake a picture of a panda for one of a gibbon. They can be images, sounds, or paragraphs of text. Think of them as hallucinations for algorithms.”

If by such a small input variation in quality data can have such significant outcomes on the result and the predictions, there is a real need to ensure the accuracy and stability in DL. An adversarial example could thwart the AI system that controls a self-driving car causing it to mistake a stop sign for a speed limit. Therefore, in some of the industries, such as Industrial Applications, due to the availability of insufficient data might limit the adoption of Deep Learning.

3. High-Performance Hardware Requirement:

To train the data sets in a Deep Learning solution requires an enormous amount of data. For the task to be performed and solve real-time problems, the machine needs to be equipped with sufficient processing power. To ensure high efficiency and less time consumption, the data scientists move to multicore high performing GPUs and processing units which are expensive and consume a lot of power.

Also, the Deep Learnings systems at the Industry level require high-end Data Centers whereas smart devices like robots, drones, mobile and other devices need small and efficient processing units. Deployment of DL solutions in the real world thus becomes a power consuming and costly affair.

4. Lack of Multitasking and Flexibility:

Deep Learning models once trained can deliver phenomenally accurate and efficient solution to a specific problem. Although, in the present landscape, the neural network architectures are highly specialised to a particular domain of application. Google’s DeepMind’s Scientist Raia Hadsell has found that “There is no neural network in the world, and no method right now that can be trained to identify objects and images, play Space Invaders, and listen to music.”

Most of the systems work on this format and are incredibly good at solving one problem. Solving similar problems also require reassessment and retraining. Research Scientists are working hard to develop the DL models that can multitask without needing to rework on the entire architecture. Despite small advancements in the multitask using Progressive Neural Networks, there is significant progress yet to be done towards Multi-Task Learning (MTL). However, researchers from Google Brian Team and the University of Toronto presented a paper on MultiModel, a neural network architecture which draws from the success of vision, audio networks, language for simultaneously solving many problems from multiple domains, including speech or image recognition and language translation.

5. Security Concerns for Deep Learning:

Deep Learning networks potentially have some exciting applications for empowering cybersecurity. However, when you take a step back to the system themselves and keeping in mind the propensity for the outputs from these models to alter after the input modifications, these networks might be vulnerable to malicious attacks. For, eg, Self-driving vehicles are partially powered by DL. If one were to access the DL model and alter the inputs, the vehicle behaviour could be potentially controlled maliciously by the perpetrator. This highlights the black-box attack on several DL networks that might result in them making misclassifications.

6. Investments:

The funding or capital required for Deep Learning is enormous, whereas, the ROI is long-term basis depending on how successful the company in being able to build a solution that will solve the real-time problems for the industry verticals. Google acquired the UK based Artificial Intelligence start-up DeepMind reportedly for approx $525 million, the company’s co-founder Demis Hassabis described its vision to “Solve Intelligence, and using that to solve other problems in this world.” However, all of this research and development comes at a considerable price. The company needs the next level of investment to continue with its advanced level research activities. The management service fee includes the costs of real estate, running and maintenance of its high-end computer systems and other infrastructures. The most significant loss it incurred was for expenses towards staff costs, payroll, office software and hardware and also stock-based compensation.

To summarise, Deep Learning although a subset of Machine Learning which is a subset of Artificial Intelligence is not flawless. While exploring new and unexplored territories of Cognitive Technology, it is but, natural to come across specific bottlenecks and difficulties which is a case with any technological advancement. However, no challenges are insurmountable. The data scientists and developers are working tirelessly to refine and enhance the underlying models in DL. I am sure in the next five to ten years DL is going to make a significant breakthrough and impact in the world of Artificial Intelligence disrupting every Industry and individuals way of living, working and doing things.

  • Rajashree Rao
    Rajashree Rao
    ThoughtLeader |AI, Cloud, BlockC, IoT, IIoT, SmartCities, Leadership I Mentor I Speaker I Writer

    Rajashree Rao (Raj) is an internationally acclaimed Industry Thought leader, visionary, advisor, principal consultant, and mentor on next-gen transformational technologies - AI, Cloud Computing, Blockchain, Data Analytics, Robotics, Industry 4.0, IoT, IIoT, and Smart Cities/Nation across industry verticals. After working for 20 years in the corporate, she is back to her roots to venture onto an entrepreneurial journey bringing her rich industry experience of working with IBM, Intel, and SAP, leading and influencing the technology adoption within the Singapore Government and Public Sector for building the Smart City and Smart Nation Initiatives in the APAC region.

You May Also Like

Brand Equity – How can the credit function help?
Brand Equity – How can the credit function help?

Investing in Brand Equity is becoming an effective business strategy not only to retain customers an...

Innovation-Driven Marketing vs.  Marketing-Driven Innovation
Innovation-Driven Marketing vs. Marketing-Driven Innovation

Is your company adding value or are you pretending and trying to make a name for yourself? Why do I...

Why Is Corporate Identity  Important For Any Business?
Why Is Corporate Identity Important For Any Business?

Corporate identity is quite similar to what we talk about our own identity, and the specifics that d...

Out-of-Box, In-the-Box,  New-Box, Other-Box, No-Box
Out-of-Box, In-the-Box, New-Box, Other-Box, No-Box

Thinking For years supporters and detractors of creative thinking in the workplace have talked about...

Pricing Strategy
Pricing Strategy

In general, the pricing strategy is very important for retail companies in order to achieve the sale...

Why Content is the true north of Account-based Marketing? – Final
Why Content is the true north of Account-based Marketing? – Final

We began exploring the four-legs of the content strategy tool, and uncovered just why context is eve...

5 Trends and Challenges for the Agency Industry
5 Trends and Challenges for the Agency Industry

One of the trends to continue will be brands bringing agency work in-house. As Ramchandani writes, &...

Why winning customer trust is key to startup success
Why winning customer trust is key to startup success

Interview of Philipp Kristian, author of 'The Trust Economy’ What are the top three emerg...

How to choose a domain name?
How to choose a domain name?

A domain name is the website name that people can type into their browser like >google.com,&...

How to promote your Business on Google Maps with Google Posts
How to promote your Business on Google Maps with Google Posts

Google has just rolled out yet another useful tool, especially for small business owners: Google Pos...

Tactics to increase conversion rate
Tactics to increase conversion rate

ALPHA Sales System Most sales systems focuses on the presentation, objection handling and closing...

Content Marketing Phooey
Content Marketing Phooey

I agree "Content Marketing" is a VITALLY important component of the Promotional Mix and es...

On Becoming Customer Centric
On Becoming Customer Centric

On Becoming Customer Centric     Some say “customer centricity” has become ...

It’s the stakeholder, stupid!
It’s the stakeholder, stupid!

Why it took me four years to build a website... This week marked an important milestone in my profe...

UltraCreativity -
UltraCreativity - "Cannot" does not exist in my vocabulary!

I’ve decided long ago that the word “cannot” does not exist in my vocabulary. For ...

Platforms And Content – The Business Model Of The 21th Century
Platforms And Content – The Business Model Of The 21th Century

Amazon is buying the rights of UEFA Championships, Disney is launching/expanding its own content pla...

Tools & Resources Every Marketer Needs To Navigate COVID-19 Crisis
Tools & Resources Every Marketer Needs To Navigate COVID-19 Crisis

It’s clear that COVID-19 has drastically altered the advertising and marketing landscape as mo...

The Hidden Truth In Creating Best Airbnb Experience
The Hidden Truth In Creating Best Airbnb Experience

Here are Questions That I have Got This Week Around Airbnb Experience From Fellow Friends and Contac...

What is the future of Programmatic Advertising?
What is the future of Programmatic Advertising?

Data in the 21st century is like oil in the 19th century. Data is currently seen as valuable asset w...

From PR to e-PR - Future of media relations
From PR to e-PR - Future of media relations

Imagine if 20 years ago, someone told you that every organization will need accounting software, wha...

When personal brands go to war...
When personal brands go to war...

The start of this past weekend was highly interesting for Twitter users. It wasn’t actually a ...

Surviving and soon thriving again: what you're doing now really matters
Surviving and soon thriving again: what you're doing now really matters

Five weeks ago, before any of us really knew ‘how bad things would get’ I wrote on Linke...

Good Brands Sell Products; Great Brands Tell Stories
Good Brands Sell Products; Great Brands Tell Stories

If you need to survive in this dog-eat-dog business world, then you need to connect with customers i...

Customer Experience lessons we learned and applied in our Art Gallery
Customer Experience lessons we learned and applied in our Art Gallery

WE OPENED OUR ART GALLERY IN 2011 We learned a lot of Customer Experience lessons in the 7 years si...

Stay Connected With Us