Reading (and watching) list for getting started on Generative AI and Prompting.
Prompt Engineering
- site OpenAI Cookbook : Example code for executing tasks with the OpenAI API.
- course Prompt Engineering: How to Talk to the AIs : A compact introduction and some advanced topics in prompt engineering by Xavier Amatriain.
- course ChatGPT Prompt Engineering for Developers : DeepLearning.ai course on prompt engineering.
- post Brex’s Prompt Engineering Guide : Prompt engineering guide created by Brex. Contains a brief history of language models.
- post Prompt Engineering 101: Introduction and resources : Xavier Amatriain’s introduction to prompt engineering.
- post Chunking Strategies for LLM Applications : When dealing with Knowledge Bases it is necessary to split your documents into chunks. This post discusses some strategies.
- book Prompt Engineering Guide : Online book with tips, applications, and examples of prompts.
- paper Chain-of-Thought Prompting Elicits Reasoning in Large Language Models : Paper that explored the effects of COT prompting.
Prompt Marketplaces
- site Roseta : My personal library with interesting prompts.
- site Snack Prompt : Prompt library with popularity system.
- site PromptBase : Prompt marketplace.
Tools
- site Clipdrop Stable Diffusion XL : Free access to Stable Diffusion XL.
- site Midjourney Prompt Helper : Online tool that helps creating Midjourney prompts.
- site PromptoMANIA : Prompt generator for diffusion models. A lot of ideas for cameras, scenes, and styles.
- site Guidance : Lib with a language for interacting with different LLMs. It handles special tokens, output structure, and more.
Models and Systems
- post Building LLM applications for production : Chip Huyen has a lot of material on deploying Machine Learning models. This post is her considerations on moving LLM applications to production.
- post Open LLMs : List of LLMs licensed for commercial use.
- post Numbers every LLM developer should know : Post inspired by Jeff Dean’s Numbers every engineer should know .
- paper Sparks of Artificial General Intelligence: Early experiments with GPT-4 : Paper that discusses the emergent capabilities of GPT-4 and how this could be viewed as a primitive AGI.
- paper GPT-4 Technical Report : Technical report of GPT-4, its performance and limitations.
- paper LoRA: Low-Rank Adaptation of Large Language Models : Method that greatly reduce costs for fine-tuning large models.
Changelog
- [2023-05-19] Added more posts about systems and prompt engineering.
- [2023-05-08] Published first version.