PinnedExtending GPT-3’s context window infinitely by storing context in GPT-3 itself or in secondary layersLet’s give GPT-3 what it needs to power an AGI. Feedback is welcome. — Context OpenAI’s GPT-3 is one the best (and most underrated) things that happened to mankind in 2020. …Gpt 34 min readGpt 34 min read