This file gets outdated quickly!

See ‣ for some example prompts for a chat agent like Claude

See LLM Coding Rules and Prompts for some rules to use with a Coding Assistant.

Generic Advice

OpenAI has some advice about it

OpenAI API

See ChatGPT Prompting Notes

Types

• Can do SGD on the prompt embeddings.
• Can use RL with discrete prompt sets
• In The Wisdom of Hindsight Makes Language Models Better Instruction Followers, they say that “prompt engineering and finetuning have orthogonal benefits”

Tricks

• Ask the LLM to identify problems with its answer, and then answer again

Please criticize your previous answer and tell me ways in which it was unhelpful, or ways in which it could have been approached better.

Given this criticism, can you try answering again?

Links

Promptsource has a collection of prompts for many different eval tasks:

promptsource/promptsource at main · bigscience-workshop/promptsource

Advice from the Web