Assign the Color attribute to your product and select the terms. Use the attribute as variation:
The color/image swatches work like other variation. Product variations are part of the WooCommerce core functionality. The only difference is in the options presentation.