Add the water and sugar to a medium sized saucepan and bring to a low boil.
Add the kumquats.
Press down using a potato masher to release more flavor from the fruit.
Bring back to a low boil and turn the heat off.
Allow the mixture to cool and strain it into a clean container.
Mix in the vodka to preserve for up to one month.