Starch synthases (SSs) are responsible for depositing the majority of glucoses in starch. Structural knowledge on these enzymes that is available from the crystal structures of rice granule bound starch synthase (GBSS) and barley SSI provides incomplete information on substrate binding and active site architecture. Here we report the crystal structures of the catalytic domains of SSIV from Arabidopsis thaliana, of GBSS from the cyanobacterium CLg1 and GBSSI from the glaucophyte Cyanophora paradoxa, with all three bound to ADP and the inhibitor acarbose. The SSIV structure illustrates in detail the modes of binding for both donor and acceptor in a plant SS. CLg1GBSS contains, in the same crystal structure, examples of molecules with and without bound acceptor, which illustrates the conformational changes induced upon acceptor binding that presumably precede catalytic activity. With structures available from several isoforms of plant and non-plant SSs, as well as the closely related bacterial glycogen synthases, we analyze, at the structural level, the common elements that define a SS, the elements that are necessary for substrate binding and singularities of the GBSS family that could underlie its processivity. While the phylogeny of the SSIII/IV/V has been recently discussed, we now further report the detailed evolutionary history of the GBSS/SSI/SSII type of SSs enlightening the origin of the GBSS enzymes used in our structural analysis.