The growing use of medical imaging with an increased level of digitization poses concerns over data security, where strong encryption methods are required. This work envisions a secure system for medical image encryption utilizing a chaotic asymmetric cryptosystem to protect sensitive healthcare information. The solution combines chaos theory and asymmetric encryption by utilizing chaotic maps to produce highly unpredictable keys, increasing encryption complexity and security. The system provides confidentiality and integrity while storing and transmitting the data, which restricts unauthorized access. Developed in MATLAB, the cryptosystem is highly sensitive to initial conditions, has effective key management, and is robustly encrypted. Performance analysis using entropy analysis, correlation coefficient, and key sensitivity proves resistance to crypto attacks. The system is scalable, effective, and flexible enough to accommodate different medical imaging modalities, responding to the increased demand for secure medical data transfer in contemporary health applications.