Preheat oven to 350 degrees Fahrenheit, and bring water to a boil in a medium-sized pot.
Add cubed potatoes and boil until you can easily pierce cubes with a fork.
Drain and put cubed cooked potatoes into a large bowl, then add milk, vanilla, ¼ cup of brown sugar, ½ stick of butter, cinnamon, cloves, and nutmeg, and stir well until all ingredients are thoroughly mixed.
Place the contents from the bowl into a 8x8-inch casserole dish sprayed with non-stick spray.
Slice the other half of the stick of butter into pats (approximately 6) and place pats of butter on top of the potato mixture, then sprinkle the other ¼ cup of brown sugar over the butter.
If using, sprinkle the pecans on top and place in a preheated oven.
Bake for 20 minutes until butter and brown sugar have melted together, then serve piping hot.