On either side of the top floor, lifting the top pot is very slightly faster than the side pot, and arguably easier to execute optimally, though you lose out on the heart drop.

Using the hookshot to hook to the pot on the way up doesn't save any time.

This applies on the return trip as well, if you're skipping the pot.

Using the hammer doesn't save any time over lifting the pot.

On the way back from the eastern door, you can press either switch when going to the door on the far west side. The time difference is usually negligible, but if you have the hookshot you can save a few frames by using it to reach the right-hand pot more quickly.

Using the hookshot is slower than simply walking to the big chest.

Using the hookshot is generally slower here too.

With boots and a sword, you can charge a spin slash while going up the stairs to the big chest (wiggle diagonally for faster stair climb), then arm and activate superspeed, moving diagonally down the stairs and attempting to dodge the Stalfos on the right.

With boots and hookshot, a faster hookspeed setup can be used instead, both going up the stairs and going back down and out of the room. Note that hookspeed will need to be rearmed after opening the big chest.