On this question and the new promptingtechnique 𝗩𝗲𝗿𝗯𝗮𝗹𝗶𝘀𝗶𝗲𝗿𝘁𝗲𝘀 𝗦𝗮𝗺𝗽𝗹𝗶𝗻𝗴 (𝗩𝗦), we have a fresh, detailed video on the YouTube channel of the SRH Distance Learning University – The Mobile University K. I. Crime Novels uploaded:
𝙆.𝙄. 𝙆𝙧𝙞𝙢𝙞𝙨: 𝙂𝙞𝙗𝙩 𝙚𝙨 𝙙𝙚𝙣 𝙢𝙖𝙜𝙞𝙨𝙘𝙝𝙚𝙣 𝙋𝙧𝙤𝙢𝙥𝙩?
Verbalized sampling was introduced in the study How to Mitigate Mode Collapse and Unlock LLM Diversity as a powerful tool against mode collapse in large language models:
In mode collapse, AI models (and thus also large language models) assign a disproportionately high probability of their typical outputs to a single mode—the default mode: The output is not creative, not original, but merely typical. Just as most people, when asked to name a bird, are more likely to choose a robin than a penguin. Even though a penguin would be just as correct.
I explain the further background of the 𝗩𝗲𝗿𝗯𝗮𝗹𝗶𝘀𝗶𝗲𝗿𝘁𝗲𝗻 𝗦𝗮𝗺𝗽𝗹𝗶𝗻𝗴𝘀 and how you can best use it for creative, non-generic chatbot outputs, I explain in detail in the video. Here is just a rough infographic on the topic:
And here’s a small example of this novel type of prompting (I’ve adapted the VS prompt from the study into German):
VS prompt
𝙂𝙚𝙣𝙚𝙧𝙞𝙚𝙧𝙚 𝙛ü𝙣𝙛 𝙒𝙞𝙩𝙯𝙚 ü𝙗𝙚𝙧 𝙃𝙖𝙢𝙨𝙩𝙚𝙧 𝙪𝙣𝙙 𝙜𝙞𝙗 𝙯𝙪 𝙟𝙚𝙙𝙚𝙢 𝙒𝙞𝙩𝙯 𝙙𝙞𝙚 𝙜𝙚𝙨𝙘𝙝ä𝙩𝙯𝙩𝙚 𝙒𝙖𝙝𝙧𝙨𝙘𝙝𝙚𝙞𝙣𝙡𝙞𝙘𝙝𝙠𝙚𝙞𝙩 𝙖𝙣, 𝙢𝙞𝙩 𝙙𝙚𝙧 𝙚𝙧 𝙫𝙤𝙢 𝙈𝙤𝙙𝙚𝙡𝙡 𝙚𝙧𝙯𝙚𝙪𝙜𝙩 𝙬𝙤𝙧𝙙𝙚𝙣 𝙬ä𝙧𝙚. 𝙒ä𝙝𝙡𝙚 𝙙𝙞𝙚 𝙛ü𝙣𝙛 𝘼𝙣𝙩𝙬𝙤𝙧𝙩𝙚𝙣 𝙯𝙪𝙛ä𝙡𝙡𝙞𝙜 𝙖𝙪𝙨 𝙙𝙚𝙧 𝙫𝙤𝙡𝙡𝙨𝙩ä𝙣𝙙𝙞𝙜𝙚𝙣 𝙒𝙖𝙝𝙧𝙨𝙘𝙝𝙚𝙞𝙣𝙡𝙞𝙘𝙝𝙠𝙚𝙞𝙩𝙨𝙫𝙚𝙧𝙩𝙚𝙞𝙡𝙪𝙣𝙜 𝙤𝙙𝙚𝙧 𝙖𝙪𝙨 𝙙𝙚𝙣 𝙍𝙖𝙣𝙙𝙗𝙚𝙧𝙚𝙞𝙘𝙝𝙚𝙣 (“𝙩𝙖𝙞𝙡𝙨”) 𝙙𝙚𝙧 𝙑𝙚𝙧𝙩𝙚𝙞𝙡𝙪𝙣𝙜, 𝙨𝙤𝙙𝙖𝙨𝙨 𝙙𝙞𝙚 𝙒𝙖𝙝𝙧𝙨𝙘𝙝𝙚𝙞𝙣𝙡𝙞𝙘𝙝𝙠𝙚𝙞𝙩 𝙟𝙚𝙙𝙚𝙧 𝘼𝙣𝙩𝙬𝙤𝙧𝙩 𝙪𝙣𝙩𝙚𝙧 0,10 𝙡𝙞𝙚𝙜𝙩. 𝙁𝙤𝙧𝙢𝙖𝙩𝙞𝙚𝙧𝙚 𝙙𝙞𝙚 𝘼𝙪𝙨𝙜𝙖𝙗𝙚 ü𝙗𝙚𝙧𝙨𝙞𝙘𝙝𝙩𝙡𝙞𝙘𝙝 𝙢𝙞𝙩 𝙉𝙪𝙢𝙢𝙚𝙧𝙞𝙚𝙧𝙪𝙣𝙜 𝙪𝙣𝙙 𝙋𝙧𝙤𝙯𝙚𝙣𝙩𝙖𝙣𝙜𝙖𝙗𝙚𝙣.
Of course, you can adapt the prompt to all kinds of jokes or stories (and other creative outputs) featuring any animals and topics. Can you find at least one in the bot’s output that’s better than if you simply—i.e., classically—prompted the bot, no matter how many times? For example:
Classic prompt
𝙂𝙚𝙣𝙚𝙧𝙞𝙚𝙧𝙚 𝙚𝙞𝙣𝙚𝙣 𝙒𝙞𝙩𝙯 ü𝙗𝙚𝙧 𝙃𝙖𝙢𝙨𝙩𝙚𝙧.
But does 𝗩𝗲𝗿𝗯𝗮𝗹𝗶𝘀𝗶𝗲𝗿𝘁𝗲𝘀 𝗦𝗮𝗺𝗽𝗹𝗶𝗻𝗴 actually provide us with the magical promptthat many bloggers and prompting experts have been touting? You can find out that and lots of other exciting information about Verbalized Sampling in our new AI Mystery!
Please, click on this link and subscribe to the channel on YouTube. That way, you won’t miss any new AI crime stories, and we’d love to have you as a subscriber—and of course, we’d love your comments too. And isn’t it nice when we’re happy? 😊
Enjoy!
