"I forgot that," he mused under his breath. He began to wonder what else he'd forgotten over all these years.
Other options:
no subject
"I forgot that," he mused under his breath. He began to wonder what else he'd forgotten over all these years.