Bottle brush: A larger brush with a long handle, often with a sponge or silicone bristles, for cleaning the inside of the bottle.
Nipple brush: A smaller brush, sometimes with a pointed head, for cleaning the bottle's nipple or teat.
Straw cleaner: A very thin brush for cleaning straws in sippy cups (not always included, but common in sets).