A source said Brennan's handwritten notes were taken after briefing Obama on the matter