Agent System

• Planning

  • Task Decomposition

    • Chain of thought (CoT; Wei et al. 2022)

      • https://arxiv.org/abs/2201.11903

    • Tree of Thoughts (Yao et al. 2023)

      • https://arxiv.org/abs/2305.10601

    • LLM+P (Liu et al. 2023)

      • https://arxiv.org/abs/2304.11477

  • Self-Reflection

    • ReAct (Yao et al. 2023

      • https://arxiv.org/abs/2210.03629

    • Reflexion (Shinn & Labash 2023)

      • https://arxiv.org/abs/2303.11366

    • Chain of Hindsight (CoH; Liu et al. 2023)

      • https://arxiv.org/abs/2302.02676

      • Algorithm Distillation (AD; Laskin et al. 2023)

        • https://arxiv.org/abs/2210.14215

• Memory

  • Types of Memory

    • Sensory Memory

      • conic memory (visual)

      • echoic memory (auditory)

      • haptic memory (touch)

    • Short-term memory

    • Long-term memory

      • Explicit / declarative memory

        • episodic memory (events and experiences)

        • semantic memory (facts and concepts)

      • Implicit / procedural memory

  • Maximum Inner Product Search

    • LSH

    • ANNOY

    • HNSW

    • FAISS

    • ScaNN

• Tool use

  • MRKL (Karpas et al. 2022)

  • TALM (Tool Augmented Language Models; Parisi et al. 2022)

  • Toolformer (Schick et al. 2023)

  • HuggingGPT (Shen et al. 2023)

  • API-Bank (Li et al. 2023)

• Case Studies

  • Scientific Discovery Agent

  • Generative Agents Simulation

  • Proof-of-Concept Examples

• https://lilianweng.github.io/posts/2023-06-23-agent/