Well, that’s what Microsoft’s newest architecture, LongNet, may be able to deliver sometime in the close future, while right now it’s already promising 1-billion-token prompts, a human’s lifetime read count, in half a second.
Hard to fathom.
In hard contrast, the most advanced AI chatbot in the world in terms of length of its context window, Claude, ‘only’ reaches 100,000 tokens, or around 75,000 words, a complete Harry Potter book.