Pour the milk into a small saucepan and set it over medium heat. Warm it gently until you see small bubbles forming around the edges and light steam rising from the surface, but do not let it come to a full boil. Turn off the heat, then add the black tea bags, making sure they are fully submerged in the milk. Let the tea steep for 4 to 5 minutes so the milk absorbs the flavor and color of the tea. When the time is up, remove the tea bags with a slotted spoon or tongs, pressing them lightly against the side of the pan to release any remaining liquid.
Return the saucepan to medium heat. Add the ground cinnamon, ground ginger, ground cloves, ground cardamom, vanilla extract, and maple syrup or honey. Whisk thoroughly to disperse the spices and sweetener into the warm milk, breaking up any small clumps of spice. Continue heating, stirring often, until the chai latte is hot and fragrant, but not boiling.
Once heated through, pour the chai latte into mugs. For an extra cozy touch, you can froth a small portion of milk separately and spoon the foam over the top of each mug, then finish with a light dusting of ground cinnamon. Serve immediately while steaming and aromatic.