In a fine adjustment mechanism of the second crystal in a double-crystal monochromator, a compression spring is usually used as a return force element, but it often produces permanent deform after some time. A novel fine adjustment mechanism is put forward, which utilizes permanent-magnet as the return force element instead of a compression spring. Its principle and advantages of adjusting the pitch angle and the roll angle are analyzed, and the structure parameters of the permanent-magnet, which is the key part of the fine adjustment mechanism, are optimized. The magnetically adsorbed fine adjustment mechanism has been testified and applied successfully in the double-crystal monochromator of 4W1B beam line in Beijing Synchrotron Radiation Facility (BSRF).