Do LLMs Benefit From Their Own Words? — ThinkLLM