This post discusses the performance of GPT-4-128K with long context recall. The findings reveal that recall performance starts to degrade above 73K tokens, low recall is correlated with facts placed between 7%-50% document depth, and facts placed at the beginning or 2nd half of the document are recalled better. It is advised not to guarantee fact retrieval, reduce context for more accuracy, and consider the position of facts. The process involved using Paul Graham essays as background tokens and evaluating GPT-4's answers. Further steps include using a sigmoid distribution and key:value retrieval. More testing is needed to fully understand GPT4's abilities.