Was it really all that repurposed? The Temple of Time is the entrance to the Light Temple - Link ends up there after pulling the Master Sword from the pedestal in the back room. 

Get out of my cheese, get into my corn!