Simmer water, sugar, ginger, tea bags, and lemon zest strips together in a saucepan over medium-high heat until sugar dissolves, about 5 minutes. Let stand off heat 10 minutes, then strain into a glass measuring cup. Cool tea base to room temperature.

To serve, divide tea base between two glasses filled with ice. Top each with 1 T. cream and 1 T. sweetened condensed milk. Stir briskly to blend and serve.