There are little kits with seeds, soil, and pots or window boxes that are good for beginners. Sometimes, you can find them at hardware stores and garden centers.

A kit might be the best way to get started!