Library

We are often asked about the resources we can recommend. This is a non-exhaustive list of resources that we have found useful. If you have any suggestions, please raise a PR (opens in a new tab).

Prompting

• Learn Prompting, docs page (opens in a new tab)
• The Prompt Report: A Systematic Survey of Prompting Techniques, paper on arxiv (opens in a new tab), summary in tweets (opens in a new tab)

LLMOps

• What We Learned from a Year of Building with LLMs, by Eugene Yan, Bryan Bischof, Charles Frye, Hamel Husain, Jason Liu and Shreya Shankar, Part 1 (opens in a new tab), Part 2 (opens in a new tab), Part 3 (opens in a new tab)
• Traceability and Observability in Multi-Step LLM Systems, webinar
• Data Flywheels for LLM Applications blog post (opens in a new tab), by Shreya Shankar
• Latency optimization cookbook (opens in a new tab), by OpenAI

LLMs

• Intro to Large Language Models talk (opens in a new tab) by Andrej Karpathy

News / Research

• Last Week in AI podcast (opens in a new tab), weekly summary AI news and research
• Latent Space podcast (opens in a new tab), deep dives and interview episodes

Libraries / Tools

• Instructor, library for structured outputs with LLMs.
• Vercel AI SDK, TypeScript toolkit designed to help developers build AI-powered applications with React, Next.js, Vue, Svelte, Node.js, and more.
• LiteLLM: Use 100+ LLMs as a drop in replacement for OpenAI GPT models, either library or proxy.
• Popular frameworks to get started quickly with RAG/Chains/Agents: LangChain, LlamaIndex, Haystack

Misc

• Stratechery newsletter/podcast (opens in a new tab), tech/business strategy deep dives and news, many episodes related to AI/Labs