They can start with asking simple math questions and going on to harder questions, as the child gets older. Parents should continually ask children mathematical computation questions and give positive feedback when they respond. Children love to receive positive feedback and that encourages continues growth.
The children also compete locally, state wide, and on the national level. The experience is invaluable. There are also other mathematical games and clubs that children can join that will help develop skills and are fun. Parents should contact their local school district or state level office of Gifted and Talented Programs for this information.
Get in the Kitchen! I was very hesitant for a while with my son when it came to the kitchen. I worried about the GIANT mess that would be left when he was done "helping". You don't even have to take on the entire project with them! You can start small and let your child help with measuring certain ingredients. You can modify the difficulty of the 'lesson' by talking about the different kinds of measuring cups and seeing what other measurements can also add up to equal one cup, etc.
Use things around the house that they already know and love! : My son has a HUGE adoration for his Thomas Trains... he can tell you every single trains name, number and color. When we started working on recognizing numbers and colors, I tried to use posters, games, workbooks, etc that would help him learn to recognize them... all to no avail! One day, we were playing with his trains, and HE asked me what number one of the trains was. Bells went off in my head and I realized that I could cater his natural curiosity about his beloved trains, and still be 'teaching' him to recognize numbers at the same time!