This research aims to evaluate and compare the performance of several deep learning architectures, especially InceptionV3 and InceptionResNetV2, with other models, such as EfficientNetB3, ResNet50, and VGG19, in classifying rice leaf diseases. In addition, this research also evaluates the impact of using data augmentation on model performance. Three different datasets were used in this experiment, varying the number of images and class distribution. The results show that InceptionV3 and InceptionResNetV2 consistently perform excellently and accurately on most datasets. Data augmentation has varying effects, providing slight advantages on datasets with lower variation. The findings from this research are that the InceptionV3 model is the best model for classifying rice diseases based on leaf images. The InceptionV3 model produces accuracies of 99.53, 58.94, and 90.00 for datasets 1, 2, and 3, respectively. It is also necessary to be wise in carrying out data augmentation by considering the dataset's characteristics to ensure the resulting model can generalize well.