Antihistamines
Those allergy drugs such as Benadryl or Vistaril, unfortunately, can have a negative impact on your memory as well. They also stop the action of acetylcholine which is why they are effective for treating nausea, anxiety, as well as insomnia. However, this drug also interferes with the role of acetylcholine sending proper messages that will result in memory loss and cognitive decline.
When it comes to most of these drugs listed, you cannot stop taking them cold turkey. What you need to do is work with your doctor for weaning yourself off of them. And talk to your doctor about alternative treatments that do not have an effect on your memory. They are out there.