ChatGPT — Prompt and Knowledge Hacking GPTs

David Such
12 min readNov 16, 2023

Hacking is not what it used to be! In my day hackers had a deep knowledge of operating systems and programming languages (or at least knew how to download a script), these days you just need to have a casual conversation with an AI.

Figure 1. Old School Hacker! [Image Credit — OpenAI DALL-E]

Recently, OpenAI made it possible for you to release custom GPTs based on your own data and carefully sculptured prompts. These can be monetised by publishing to the GPT Store. Should you publish a popular GPT which is raking in the money, it is likely someone will try to copy your secret sauce. In the context of GPTs this is the prompt and any custom data files that you have uploaded. In this article we will investigate how easy it is to extract these by trying to hack our GPT called Oz Trivia. We will also talk about ways that you can harden your GPT security.

Prompt Hacking

Prompt hacking, in the context of ChatGPT and other GPT models, refers to the practice of crafting specific, often cleverly designed prompts to elicit specific types of responses or to navigate around the model’s limitations and restrictions. This…

--

--

David Such

Reefwing Software · Embedded Systems Engineer · iOS & AI Development · Robotics · Drones · Arduino · Raspberry Pi · Flight Control