The mechanism construction and procedural arrangement of keeping “Administrative penalty taking priority” as the principle and “criminal penalty taking priority” as an exception within administrative-criminal penalty connection is not only an accurate reflection of the essence of administrative crimes and a scientific definition of the mission of criminal justice, but also the safeguard of the state power assignment as well as the check and balance mechanism between the administrative power and judicial power. Thus, it is necessary to transfer the evidences collected from administrative law enforcement activities to criminal procedural evidence. Additionally, according to different types of evidence, we must use different transforming approaches, such as directly applying the evidences, recollecting the evidences and authorizing specialized organizations or experts to test the evidences, etc.