Stroke
If you have had a stroke, that means you have a blood clot that cuts off the blood supply in your brain and this will do damage to your memory as well. If you are having a small stroke without you even displaying symptoms that in itself can hurt your memory as well. Anytime the blood supply is cut off, there is damage being done.