We constructed a convolutional neural network to estimate average grain size from microstructure images. In the previous study from our research group, the network was trained using GB-type images in which the grain matrix and grain boundary were represented in white and black, respectively. The model well estimated the same GB-type images, but did not properly predict CL-type images where grain boundaries were defined by color contrast between grains. In the present study, the convolutional neural network was trained using CL-type microstructure images, and evaluated the average grain size, for comparison with the previous GB-type model. The relationship between the microstructure image and the average grain size was determined using regression rather than classification. Then, the results were compared with the previous ones. Finally, the proposed approach was used for actual microstructural image analysis. Mid-layer images were extracted to examine how the network recognizes the characteristics of microstructures, such as grain color and grain boundary. Like the previous GB-type model, the present CL-type model seems to estimate the average grain size from the curvature of the grain boundary through edge detection of the grain boundaries. However, the GB- and CL-type models only properly predicted the grain size from the same kind of images as the training data, because the definitions of the grain boundaries of the two models were different. (Received 28 December, 2022; Accepted 7 Fabruary, 2023)