Netskope named a Leader in the 2022 Gartner® Magic Quadrant™ for Security Service Edge. Get the Report.

  • Security Service Edge Products

    Protect against advanced and cloud-enabled threats and safeguard data across all vectors.

  • Borderless SD-WAN

    Confidently provide secure, high-performance access to every remote user, device, site, and cloud.

  • Platform

    Unrivaled visibility and real-time data and threat protection on the world's largest security private cloud.

Netskope Named a Leader in the 2022 Gartner Magic Quadrant™ for SSE Report

Get the report Go to Products Overview
Netskope gartner mq 2022 sse leader

Gartner® Quick Answer: How Does Netskope’s Acquisition of Infiot Impact SD-WAN, SASE, and SSE Projects?

Get the report
Quick Answer: How Does Netskope’s Acquisition of Infiot Impact SD-WAN, SASE and SSE Projects?

Netskope delivers a modern cloud security stack, with unified capabilities for data and threat protection, plus secure private access.

Explore our platform
Birds eye view metropolitan city

Make the move to market-leading cloud security services with minimal latency and high reliability.

Learn more
Lighted highway through mountainside switchbacks

Prevent threats that often evade other security solutions using a single-pass SSE framework.

Learn more
Lighting storm over metropolitan area

Zero trust solutions for SSE and SASE deployments

Learn more
Boat driving through open sea

Netskope enables a safe, cloud-smart, and fast journey to adopt cloud services, apps, and public cloud infrastructure.

Learn more
Wind turbines along cliffside
  • Our Customers

    Netskope serves more than 2,000 customers worldwide including more than 25 of the Fortune 100

  • Customer Solutions

    We are here for you and with you every step of the way, ensuring your success with Netskope.

  • Training and Certification

    Netskope training will help you become a cloud security expert.

We help our customers to be Ready for Anything

See our Customers
Woman smiling with glasses looking out window

Netskope’s talented and experienced Professional Services team provides a prescriptive approach to your successful implementation.

Learn more
Netskope Professional Services

Secure your digital transformation journey and make the most of your cloud, web, and private applications with Netskope training.

Learn more
Group of young professionals working
  • Resources

    Learn more about how Netskope can help you secure your journey to the cloud.

  • Blog

    Learn how Netskope enables security and networking transformation through security service edge (SSE).

  • Events & Workshops

    Stay ahead of the latest security trends and connect with your peers.

  • Security Defined

    Everything you need to know in our cybersecurity encyclopedia.

Security Visionaries Podcast

Episode 18: Fostering Relationships for Security Awareness

Play the podcast
Black man sitting in conference meeting

Read the latest on how Netskope can enable the Zero Trust and SASE journey through security service edge (SSE) capabilities.

Read the blog
Sunrise and cloudy sky

SASE Week

Netskope is positioned to help you begin your journey and discover where Security, Networking, and Zero Trust fit in the SASE world.

Learn more
SASE Week

What is Security Service Edge?

Explore the security side of SASE, the future of network and protection in the cloud.

Learn more
Four-way roundabout
  • Company

    We help you stay ahead of cloud, data, and network security challenges.

  • Why Netskope

    Cloud transformation and work from anywhere have changed how security needs to work.

  • Leadership

    Our leadership team is fiercely committed to doing everything it takes to make our customers successful.

  • Partners

    We partner with security leaders to help you secure your journey to the cloud.

Netskope enables the future of work.

Find out more
Curvy road through wooded area

Netskope is redefining cloud, data, and network security to help organizations apply Zero Trust principles to protect data.

Learn more
Switchback road atop a cliffside

Thinkers, builders, dreamers, innovators. Together, we deliver cutting-edge cloud security solutions to help our customers protect their data and people.

Meet our team
Group of hikers scaling a snowy mountain

Netskope’s partner-centric go-to-market strategy enables our partners to maximize their growth and profitability while transforming enterprise security.

Learn more
Group of diverse young professionals smiling

ChatGPT: Dispelling FUD, Driving Awareness About Real Threats

Jan 20 2023

Summary

ChatGPT is an artificial intelligence chatbot created by OpenAI, reaching 1 million users at the end of 2022. It is able to generate fluent responses given specific inputs. It is a variant of the GPT (Generative Pre-trained Transformer) model and, according to OpenAI, it was trained by mixing Reinforcement Learning from Human Feedback (RLHF) and InstructGPT datasets. Due to its flexibility and ability to mimic human behavior, ChatGPT has raised concerns in several areas, including cybersecurity.

Its popularity has grown specially because it provides fluent responses to questions about virtually any subject, including history, math, literature, and technology.

Asking ChatGPT what is its purpose.

The chatbot is also a great tool for developers, able to create, review, improve, and explain code in multiple languages, such as C++, Java, Python, Go, and Rust. It also provides an API that can be used by plugins in different platforms such as Slack, Microsoft Teams, and IDEs like VS Code.

And what happens if someone asks ChatGPT to create malware or ransomware? No need to panic right now, as ChatGPT will not create novel, functional malware automatically. But it can still be abused by attackers to improve social engineering skills or to understand and build common malware components.

For social engineering, it can generate novel, fluent bait messages. For malware, it can serve as an interactive interface into the many malware tutorials and examples that already exist on the internet, but it still requires a certain knowledge from the person to use this tool to create a functional malware.

There is also good news for cybersecurity defenders. ChatGPT has also been trained on examples of common code vulnerabilities and can pick them out when you share the source code with ChatGPT. So, like many inventions, ChatGPT can be used for both good and evil. Here’s a closer look at how:

Malware Development

Can ChatGPT automatically create novel, functional malware? The short answer is no, but, the tool can be used by attackers to aid in the malware development process, especially by those without experience.

The first use case is to use it to learn and get code examples about malicious techniques. For example, we asked ChatGPT to explain details about a common process injection technique named Process Hollowing.

ChatGPT explaining what Process Hollowing is.

The answer was quite precise and included an example in C++, which could be easily modified to embed this functionality to a malware.

We asked more questions about specific techniques that could be incorporated into malware, such as downloading and executing files from remote URLs or how to encrypt a file using AES on Windows, and the chatbot was able to generate and explain all of them.

ChatGPT showing a C++ code that encrypts a file using AES

However, during our tests, we found that ChatGPT generated incomplete codes for questions that add a certain level of complexity. For example, the AI wasn’t able to provide us with the entire code for a program that searches for files on Windows and encrypts them using a combination of symmetric and asymmetric encryption, which is a behavior that could be used to create ransomware.

Incomplete code generated by ChatGPT.

The AI is also able to identify malicious intent depending on how the question is asked. For example, we failed in obtaining a single code that downloads a base64 encoded executable and executes it using process hollowing.

ChatGPT telling us that it cannot create the code we asked for.

But although the code wasn’t generated in a single answer, nothing stops the attacker from splitting the question by:

  1. Asking for a code example on how to download base64 encoded files;
  2. Asking for an example of Process Hollowing technique;
  3. Combine both answers to perform process injection with the downloaded file.
Code created by ChatGPT that downloads a base64 encoded file from an external URL.

Therefore, ChatGPT won’t create a novel or a complete malware for someone, but it can indeed be used as a resource to study and create snippets of code that when combined could be used to create a functional malware.

Social Engineering

Attackers can use ChatGPT to improve their social engineering skills. It can help to write specific texts that would be used on phishing emails, redirecting victims to malicious websites or luring them into downloading attached malware. 

For example, we asked ChatGPT to write an email that makes it look like the person just won $100,000 in a lottery named “BigMoney.” We specifically asked ChatGPT to randomly generate the ticket number and to convince the person to open a link that will supposedly claim the prize.

The text generated by the AI could be easily employed in phishing emails to redirect people to a website that attempts to steal sensitive information, such as email accounts and passwords.

Email generated by ChatGPT that tells a person won in the lottery.

Another example is spear phishing. With previous knowledge about the target, an attacker can provide details about the victim to ChatGPT and ask help to generate a text that convinces the person to open an attached file.

To exemplify this, we asked ChatGPT to generate an email from a person named Ruth to another person named Glenn, asking help on a fictional project. The project details would be attached in the email, which could be a weaponized file created by the attacker.

Email generated by ChatGPT that could be used in spear phishing attacks.

Attackers could also abuse ChatGPT to create fake news, luring victims to a website that steals sensitive data, such as email or bank accounts. As an example, we asked the AI to generate an email that contains fake news about the California government providing $5,000 to COVID-19 victims.

Text generated by ChatGPT that contains fake news to support a phishing email.

These examples demonstrate that ChatGPT has the potential to significantly decrease the barrier of entry for cybercriminals in building their social engineering attacks.

Benefits for Cybersecurity

ChatGPT is not only useful for attackers, but it can also be a valuable tool for defenders, who can use the tool to spot vulnerabilities in code or assess security posture to improve defenses overall.

For example, we shared a piece of Python code with ChatGPT that contains a SQL injection vulnerability, and the AI was able to spot the problem, explain why it happens, and also provided suggestions to fix the code.

ChatGPT spotting an SQL injection vulnerability.

However, by sharing pieces of code with ChatGPT, users could very easily and unintentionally leak personal or corporate information, which could eventually harm organizations. This is even something that is advised by the platform once an account is created. We do not recommend submitting any confidential code to ChatGPT for analysis.

ChatGPT advises to not share sensitive information in the conversations.

Conclusions

The availability of an AI tool able to mimic human behavior and provide coding knowledge increases cybersecurity risks for organizations, as it can be used by attackers to enhance social engineering attacks and create components to aid malware development. 

It is common for novices to create new malware by copying existing code instead of writing it from scratch, which at this point is likely a faster path than circumventing ChatGPT’s security measures and having to grab pieces of code that need to be adjusted and combined to create functional malware.

However, new attack vectors and malware families that we may see developed with ChatGPT’s help, or any upcoming AI, can largely be addressed by maintaining an effective security posture. This includes keeping software patched and up-to-date, maintaining effective data protection policies and technologies, and equipping the organization’s most valuable assets with additional security software such as an EDR (endpoint detection and response) and a secure web gateway solution. 

For social engineering attacks that may emerge with the AI’s help, it’s important for organizations to rebuild the ‘human firewall’, training employees and customers to spot the small clues, such as misplaced details in phishing emails, and to always verify the identity of the person they are talking to.

As we demonstrated, ChatGPT is not only a tool that can be used by attackers, but it can also be used in favor of developers and security professionals to spot code vulnerabilities and assess security posture. Also, having a better understanding of how attackers could potentially abuse this tool can help security teams to be better protected. Last but not least, the chatbot is still under development, so we should expect more robust security measures from OpenAI to prevent abuse of the tool.

author image
Gustavo Palazolo
Gustavo Palazolo is an expert in malware analysis, reverse engineering and security research, working many years in projects related to electronic fraud protection. He is currently working on the Netskope Research Team, discovering and analyzing new malware threats.