Thiago Cardoso :: Generative AI reading (and watching) list

Reading (and watching) list for getting started on Generative AI and Prompting.

Prompt Engineering

site OpenAI Cookbook : Example code for executing tasks with the OpenAI API.
course Prompt Engineering: How to Talk to the AIs : A compact introduction and some advanced topics in prompt engineering by Xavier Amatriain.
course ChatGPT Prompt Engineering for Developers : DeepLearning.ai course on prompt engineering.
post Brex’s Prompt Engineering Guide : Prompt engineering guide created by Brex. Contains a brief history of language models.
post Prompt Engineering 101: Introduction and resources : Xavier Amatriain’s introduction to prompt engineering.
post Chunking Strategies for LLM Applications : When dealing with Knowledge Bases it is necessary to split your documents into chunks. This post discusses some strategies.
book Prompt Engineering Guide : Online book with tips, applications, and examples of prompts.
paper Chain-of-Thought Prompting Elicits Reasoning in Large Language Models : Paper that explored the effects of COT prompting.

site Clipdrop Stable Diffusion XL : Free access to Stable Diffusion XL.
site Midjourney Prompt Helper : Online tool that helps creating Midjourney prompts.
site PromptoMANIA : Prompt generator for diffusion models. A lot of ideas for cameras, scenes, and styles.
site Guidance : Lib with a language for interacting with different LLMs. It handles special tokens, output structure, and more.

post Building LLM applications for production : Chip Huyen has a lot of material on deploying Machine Learning models. This post is her considerations on moving LLM applications to production.
post Open LLMs : List of LLMs licensed for commercial use.
post Numbers every LLM developer should know : Post inspired by Jeff Dean’s Numbers every engineer should know .
paper Sparks of Artificial General Intelligence: Early experiments with GPT-4 : Paper that discusses the emergent capabilities of GPT-4 and how this could be viewed as a primitive AGI.
paper GPT-4 Technical Report : Technical report of GPT-4, its performance and limitations.
paper LoRA: Low-Rank Adaptation of Large Language Models : Method that greatly reduce costs for fine-tuning large models.