In optical communication systems, the Q-factor is an important performance metric to evaluate the performance of an optical link. In this paper, a deep learning-based eye diagram analyzer is proposed to estimate the Q-factor. CNN architectures such as LeNet, Wide ResNet, and Inception-v4 are used for ON-Off Keying (OOK) and Pulse Amplitude Modulation (PAM) formats’ eye diagrams. The performance of these architectures is evaluated in terms of accuracy, Mean Squared Error (MSE), and error tolerance. This work shows that Wide ResNet demonstrates better performance in both OOK and PAM4 transmission schemes, achieving MSE values of 0.00188 and 0.00036, respectively. Additionally, it attains a high R-squared (R2) value of 0.9998. This deep learning-based eye diagram analyzer may be a promising approach for analyzing and optimizing optical communication systems without extensive human intervention.