Granite 3.1 3b instruct is an open-source LLM supporting a 128k context window. This demo uses only 2K context. View Documentation